We consulted with scores of other engineers on particular new technologies, we made dozens of presentations to our DARPA sponsors, and in the end we hammered out a 278-page report [PDF], which had lots of surprises, even for us. The bottom line, though, was rather glum. The practical exaflops-class supercomputer DARPA was hoping for just wasn’t going to be attainable by 2015. In fact, it might not be possible anytime in the foreseeable future. Think of it this way: The party isn’t exactly over, but the police have arrived, and the music has been turned way down.
Kogge goes on to say that even if power and heat problems can be solved, there would still be the monumental challenge of getting 160 Million cores to work together efficiently.
Update: A 2008 IEEE podcast interview with Peter Kogge discussing Exascale computing is also available. Download the MP3.