I just read an interesting short report by Jim Gray. The gist of the matter is that, since 2000, the rate of increase in computer performance per dollar has gone down. It is still exponential, but the rate of growth is much, much smaller. Gray blames memory latency.
As a side-note, how fast can you sort 16 GB of data on a typical PC? The answer is about 16 minutes.