18 Petaflop Stampede2 Supercomputer Dedicated at TACC

Print Friendly, PDF & Email

Today the National Science Foundation realized the initial phase of its $30 million investment to upgrade the nation’s computational research infrastructure through the dedication of Stampede2, one of the most powerful supercomputing systems in the world. Based at the Texas Advanced Computing Center (TACC) at The University of Texas at Austin, this strategic national resource will serve tens of thousands of researchers and educators across the U.S.

“Building on the success of the initial Stampede system, the Stampede team has partnered with other institutions as well as industry to bring the latest in forward-looking computing technologies combined with deep computational and data science expertise to take on some of the most challenging science and engineering frontiers,” said Irene Qualters, director of NSF’s Office of Advanced Cyberinfrastructure.”

Built by Dell EMC, Stampede2 is the newest strategic supercomputing resource for the nation’s research and education community, enabling scientists and engineers across the U.S., from multiple disciplines, to answer questions at the forefront of science and engineering. Importantly, Stampede2 leverages NSF’s existing investments in computational and data science, as well as user services, allowing academic researchers access to capabilities beyond the reach of a single institution while complementing other national high-performance computing infrastructure.

Further, Stampede2 builds upon the initial Stampede system, also funded by NSF, which processed more than eight million successful jobs and delivered over three billion core hours of computation since it became operational in 2013.

Stampede2 will offer more than twice the overall memory, storage capacity, bandwidth and system performance of the initial Stampede system. Yet Stampede2 will consume only half as much power and occupy just half the physical space of its predecessor. Innovations in how the supercomputer is cooled also resulted in efficiencies: Stampede2 is connected to a chilled water system that cools more cost-effectively and with less impact to the power grid than the standard air-conditioned approach.

System Specifications:

  • 18 Petaflops when fully deployed
  • 4,200 Intel Knights Landing nodes, each with 68 cores, 96GB of DDR RAM, and 16GB of high speed MCDRAM
  • 1,736 Intel Xeon Skylake nodes (to be added in fall 2017; specifications to come)
  • 100 Gb/sec Intel Omni-Path network with a fat tree topology employing six core switches
  • Two dedicated high performance Lustre file systems with a storage capacity of 31PB
  • TACC’s Stockyard-hosted Global Shared File System provides additional Lustre storage

Once additional hardware and processors are added in the summer, Stampede2 will be able to process jobs at 18 petaflops, or 18 quadrillion mathematical operations per second, at peak performance. When Stampede2 is fully operational later this fall, the system will have roughly the processing power of 100,000 desktop computers; this increased speed and power will allow scientists and engineers to tackle larger, more complex problems that were not previously possible.

Computational scientists and engineers pursuing a wide range of applications — from researchers who conduct large-scale simulations and data analyses on large swaths of the system, to those who interact with the system through web-based community platforms — will access Stampede2 through the NSF-supported eXtreme Science and Engineering Discovery Environment (XSEDE).

Researchers have already started using the system to conduct large-scale scientific studies. Some preliminary findings from early user projects include:

  • Tumor identification from magnetic resonance imaging (MRI) data at The University of Texas at Austin.
  • Real-time weather forecasting at the University of Oklahoma that has helped direct storm-chaser trucks.
  • Earthquake predictions for the Southern California region at the University of California, San Diego that achieved a fivefold performance improvement over previously reported results.
  • Teams from Stephen Hawking’s cosmology research laboratory at Cambridge University, leveraging Stampede2, achieved unprecedented comparisons of previously performed simulations with gravitational wave data observed by the NSF-funded Laser Interferometer Gravitational-wave Observatory (LIGO).

Several leading universities are collaborating with TACC to enable Stampede2, including Clemson University, Cornell University, Indiana University, The Ohio State University and the University of Colorado at Boulder. They are joined by industry partners Dell EMC, Intel Corporation and Seagate Technology, who are providing cyberinfrastructure expertise and services for the project.

Stampede2 is expected to serve the scientific community through 2021, supporting tens of thousands of researchers during this period. An additional NSF award for $24 million was recently granted to cover upcoming operations and maintenance costs for the system.

Sign up for our insideHPC Newsletter