Obviously yes!
Plugins which have to be loaded with every page of your website, need database access, need more number of http requess and/or are not well written will definitely slow down your website.
Plugins which comes with the official version are generally checked thouroghly before they are bundeled with the setup. If you are using many third party/old plugins you can disable/delete it to see the difference yourself.