When using vBulletin 4.0.4, I noticed that if I have zlib compression enabled in my php.ini file, my site also slows terribly. Disabling compression in php.ini seems to resolve the problem, and my page output is still gzipped, so I guess it's done multiple times or internally in vBulletin now (even though my vB gzip settings are all disabled).