Moore's Law will soon reach the point that further advances are no longer financially beneficial, for the same reasons that prevent most airlines from flying supersonic jets. It can be done, but the costs are astronomical. Other problems include physical limits: 10GHz chips simply won't be able to physically move electrons quick enough between the CPU and memory because of the speed of light.
Moore's Law will most likely taper off in the next century. Assuming Moore's Law (with respect to processor speed and capacity) continues to rise, in 600 years all the matter and energy in existence would make up one giant computer.