I am a speed addict and know that speed is a major impact on the "feeling" of your site.
I would suggest:
1. put all Javascript into file page.js (or a custom one)
2. compress all Javascript with http://gpbmike.github.io/refresh-sf/ (have a script.min.js and a script.full.js at hand)
3. load as few images as possible for your theme, compress them
4. enable Caching using .htaccess:
# CACHING
<IfModule mod_expires.c>
ExpiresActive On
# ExpiresDefault "access plus 2 days"
ExpiresByType text/css "access plus 1 month"
ExpiresByType text/javascript "access plus 1 month"
ExpiresByType application/javascript "access plus 1 month"
ExpiresByType application/x-javascript "access plus 1 month"
ExpiresByType image/ico "access plus 1 month"
ExpiresByType image/x-icon "access plus 1 month"
ExpiresByType image/gif "access plus 1 month"
ExpiresByType image/jpg "access plus 1 month"
ExpiresByType image/jpeg "access plus 1 month"
ExpiresByType image/png "access plus 1 month"
ExpiresByType application/x-shockwave-flash "access plus 1 month"
ExpiresByType video/mp4 "access plus 1 month"
ExpiresByType video/ogg "access plus 1 month"
ExpiresByType video/webm "access plus 1 month"
</IfModule>
5. do only necessary file loads (this is difficult with recent q2a, since each plugin provides its own script.js and own images etc.)
Just a quick list that should boost your speed.
Good luck.