Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


SLAC Researchers use ESnet for Record Speed Transfer of 1 Petabyte of Data

“The innovative and versatile nature of ESnet’s OSCARS enabled us to design a unique 5000-mile 100 Gbps loop, which our ESnet colleagues quickly helped establish in 2015,” said Zettar Founder and CEO Chin Fang. “We were thus able to have the data storage clusters and the data transfer nodes co-located in the same rack although they were at both ends of the loop. Physically they were separated by inches, but digitally they are separated by 5000miles. Further the clusters themselves have a self-imposed cap of 80 Gbps.”

Overcoming Roadblocks in Computational Networks

Mariam Kiran is using an early-career research award from DOE’s Office of Science to develop methods combining machine-learning algorithms with parallel computing to optimize such networks. “This type of science and the problems it can address can make a real impact, Kiran says. “That’s what excites me about research – that we can improve or provide solutions to real-world problems.”

Engineering a Better Portal for Scientific Discovery

Engineers from ESnet and the Globus team have designed a new approach that makes data sharing faster, more reliable, and more secure. As described in a new report, the “Science DMZ” provides a new architecture to meet increasing demands for accessing shared data.

Speeding Data Transfer with ESnet’s Petascale DTN Project

Researchers at the DOE are looking to dramatically increase their data transfer capabilities with the Petascale DTN project. “The collaboration, named the Petascale DTN project, also includes the National Center for Supercomputing Applications (NCSA) at the University of Illinois in Urbana-Champaign, a leading center funded by the National Science Foundation (NSF). Together, the collaboration aims to achieve regular disk-to-disk, end-to-end transfer rates of one petabyte per week between major facilities, which translates to achievable throughput rates of about 15 Gbps on real world science data sets.”

How Zettar Transferred 1 Petabyte of Data in Just 34 Hours Using AIC Servers

In the world of HPC, moving data is a sin. That may be changing. “Just a few weeks ago, AIC announced the successful completion of a landmark, 1-petabyte transfer of data in 34 hours, during a recent test by Zettar that relied on the company’s SB122A-PH, 1U 10-bay NVMe storage server. The milestone was reached using a unique 5000-mile 100Gbps loop which is a SDN layer over a shared, production 100G network operated by the US DOE’s ESNet.”

SLAC & Berkeley Researchers Prepare for Exascale

Researchers at the Department of Energy’s SLAC National Accelerator Laboratory are playing key roles in two recently funded computing projects with the goal of developing cutting-edge scientific applications for future exascale supercomputers that can perform at least a billion billion computing operations per second – 50 to 100 times more than the most powerful supercomputers in the world today.

Software Defined Networking to Speed Data for Cori Supercomputer

NERSC is working with Cray to explore new ways to more efficiently move data in and out of Cori, a powerful supercomputer being constructed in California. “We need to take advantage of a network guru’s design for moving data for a specific experiment but have SDN do all of the bookkeeping for which compute nodes need to be connected to what networks,” said Brent Draney, group lead for the Networking, Servers and Security Group at NERSC. “I would rather see our network engineers analyze the data flow and how to meet the need instead of having to manually reconfigure the network for the demands of each job.”

NSF Sponsors Women Engineers for SCinet Buildout at SC16

The Networking at SC (WINS) program officially launched today. Funded through a grant from the NSF and ESnet, the program sponsors eight career women in the research and education network community to participate in the build out and live operation of SCinet. “Not only is WINS providing hands-on engineering training to the participants but also the opportunity to present their experiences with the broader networking community throughout the year.”

ESnet Timeline Celebrates 30 Years of Servicing Science

The Department of Energy’s Energy Sciences Network (ESnet) has published a 3D timeline celebrating thirty years of service. With the launch of an interactive timeline, viewers can explore ESnet’s history and contributions.

ESnet Releases Code for Building Online Interactive Network Portals

ESnet has released open source code for building online Interactive Network Portals. “Now that the libraries are made available, the team hopes that other organizations will take the code, use it, add to it and work with ESnet to make the improvements available to the community.”