Brookhaven Lab to Develop ECP Exascale Software

Print Friendly, PDF & Email
Scientists used X-rays at Brookhaven Lab's National Synchrotron National Light Source to determine the structure of the proton-regulated calcium channel (ribbons) that is shown above embedded in a lipid bilayer (spheres). This system will be the focus of one of the science challenges of the NWChemEx exascale computing project.

Scientists used X-rays at Brookhaven Lab’s National Synchrotron National Light Source to determine the structure of the proton-regulated calcium channel (ribbons) that is shown above embedded in a lipid bilayer (spheres). This system will be the focus of one of the science challenges of the NWChemEx exascale computing project.

Scientists at Brookhaven National Laboratory will play major roles in two of the 15 fully funded application development proposals recently selected by the DOE’s Exascale Computing Project (ECP) in its first-round funding of $39.8 million. Seven other proposals received seed funding.

The ECP’s mission is to maximize the benefits of high-performance computing for U.S. economic competitiveness, national security, and scientific discovery. Specifically, the development efforts will focus on advanced modeling and simulation applications for next-generation supercomputers to enable advances in climate and environmental science, precision medicine, cosmology, materials science, and other fields. Led by teams from national labs, research organizations, and universities, these efforts will help guide DOE’s development of a U.S. exascale computing ecosystem. Exascale computing refers to systems that can perform at least a billion-billion calculations per second, or a factor of 50 to 100 times faster than the nation’s most powerful supercomputers in use today.

At Brookhaven Lab, the Computational Science Initiative (CSI) is focused on developing extreme-scale numerical modeling codes that enable new scientific discoveries in collaboration with Brookhaven’s state-of-the-art experimental facilities, including the National Synchrotron Light Source II, the Center for Functional Nanomaterials, and the Relativistic Heavy Ion Collider–all DOE Office of Science User Facilities. This initiative brings together computer scientists, applied mathematicians, and computational scientists to develop and extend modeling capabilities in areas such as quantum chromodynamics, materials science, chemistry, biology, and climate science.

Founded only in December 2015, CSI has for the first time brought together leading experts across the lab to address the challenges of exascale computing. The two successful DOE Exascale Computing Project proposals demonstrate the strength of this interdisciplinary team,” said CSI Director Kerstin Kleese van Dam.

Computational physics

ECP1One of the two projects Brookhaven Lab will contribute to is called “Exascale Lattice Gauge Theory Opportunities and Requirements for Nuclear and High Energy Physics,” led by Fermi National Accelerator Laboratory. Collaborators on the project are DOE’s Jefferson Lab, Boston University, Columbia University, University of Utah, Indiana University, University of Illinois Urbana-Champaign, Stony Brook University, and College of William & Mary.

The team at Brookhaven will develop algorithms, language environments, and application codes that will enable scientists to perform lattice quantum chromodynamics (QCD) calculations on next-generation supercomputers. These calculations, along with experimental data produced by particle collisions at Brookhaven’s Relativistic Heavy Ion Collider and other facilities, help physicists understand the fundamental interactions between elementary particles called quarks and gluons that represent 99% of the mass in the visible universe.

Brookhaven physicist Chulwoo Jung and Brookhaven collaborator Peter Boyle of the University of Edinburgh will apply their expertise in QCD and lead the efforts to design new algorithms and software frameworks that are crucial for the success of lattice QCD on exascale machines. Barbara Chapman, head of Brookhaven’s Computer Science and Mathematics Group and a professor in the Computer Science Department at Stony Brook University, and Brookhaven computational scientist Meifeng Lin will tackle the challenge of developing high-performance programing models that will enable scientists to create software with portable performance across different exascale architectures.

Computational chemistry

The other project that Brookhaven will contribute to, “NWChemEx: Tackling Chemical, Materials and Biomolecular Challenges in the Exascale Era,” will improve the scalability, performance, extensibility, and portability of the popular computational chemistry code NWChem to take full advantage of exascale computing technologies. Robert Harrison, chief scientist of CSI and director of Stony Brook University’s Institute for Advanced Computational Science, will serve as chief architect, working with project director Thom Dunning of Pacific Northwest National Laboratory (PNNL) and deputy project director Theresa Windus of Ames National Laboratory to oversee a team of computational chemists, computer scientists, and applied mathematicians. Argonne, Lawrence Berkeley, and Oak Ridge national labs and Virginia Tech are partners on the project.

The team will work to redesign the architecture of NWChem so that it is compatible with the pre-exascale and exascale computers to be deployed at the DOE’s Leadership Computing Facilities and the National Energy Research Scientific Computing Center. This effort will be guided by the requirements of scientific challenges in two application areas related to biomass-based energy production: developing energy crops that are resilient to adverse environmental conditions such as drought and salinity (led by Brookhaven structural biologist Qun Liu) and designing catalytic processes for sustainable biomass-to-fuel conversion (led by PNNL scientists).

Hubertus van Dam, a computational chemist at Brookhaven, will lead the testing and assessment efforts, which are designed to ensure that the project outcomes optimize societal impact. To achieve this goal, the team’s science challenge domain experts will identify requirements–for example, the ability to build structural models from hundreds of thousands of atoms–that will be translated into computational problems of increasing complexity. As the team develops NWChemEx, it will assess the code’s ability to solve these problems.

Read the Full Story on the ECP’s 22 selected projects.

Sign up for our insideHPC Newsletter