Today I took a class on Drupal Performance and Scalability and learned the following.
Drupal is slow
Out of the box it is. If you are running a Drupal site out of the box with no configuration changes and no caching set, your users are suffering. Sure you don't have to feel the pain because you aren't going to your own site everyday, but eventually you are going to feel the pain because your users are leaving your site and not returning.