As high performance and webscale applications become mainstream, HPE’s continued focus on this market is yielding positive results for our customers,” said Bill Mannel, vice president and general manager, HPC, Big Data and IoT Servers, HPE. “Already, more than a third of the HPC market is using HPE compute platforms to enhance scientific and business innovation and gain a competitive edge. Today’s announcement reinforces our commitment to delivering new infrastructure solutions that satisfy our customers’ insatiable need for massive compute power to fuel new applications and unlock the value of their data.”
Since its beginnings in 1999 as a project at Carnegie Mellon University, Lustre, the high performance parallel file system, has come a long, long way. Designed and always focusing on performance and scalability, it is now part of nearly every High Performance Computing (HPC) cluster on the Top500.org’s list of fastest
computers in the world—present in 70 percent of the top 100 and nine out of the top ten. That’s an achievement for any developer—or community of developers, in the case of Lustre—to be proud of. Learn what the HPC Community is saying about Lustre.
GDH Consulting in Albuquerque is seeking a Lustre File Systems HPC Software Integrator Integrator in our Job of the Week. “A systems programmer with proficient coding experience in C is required to participate in the implementation of research file systems and related systems software. The qualified candidate will have the opportunity to work on innovative approaches to data movement on large scale Linux clusters, and to develop new strategies for attacking the challenging issues in the I/O arena which arise from the requirements of the file system to scale and be robust.”
Today the Open Scalable File Systems (OpenSFS) community announced the release of Lustre 2.8.0, the fastest and most scalable parallel file system. OpenSFS, founded in 2010 to advance Lustre development, is the premier non-profit organization promoting the use of Lustre and advancing its capabilities through coordinated releases of the Lustre file system.
In this podcast, Rich Brueckner interviews Hugo Saleh, Director of Marketing for the Intel High Performance Computing Platform Group. They discuss the new Intel® Xeon® processor E5-2600 v4 product family, based upon the Broadwell microarchitecture, and the first processor within Intel® Scalable System Framework (Intel® SSF). Hugo describes how the new processors improve HPC performance and examine the impact of Intel® SSF on vastly different procurements ranging from the massive 200 Petaflops Aurora system to small and large enterprise clusters plus scientific systems.
Total, one of the largest integrated oil and gas companies in the world, announced they are boosting the compute power of their SGI Pangea supercomputer with an additional 4.4 petaflops provided by a new SGI ICE X system and based on the Intel Xeon processor. Purchased last year, the new SGI system is now in production and will allow Total to determine the optimal extraction methods more quickly. The SGI supercomputer allows Total to improve complex modeling of the subsurface and to simulate the behavior of reservoirs, reducing the time and costs associated with discovering and extracting energy reserves.
Seagate Technology and Los Alamos National Laboratory are researching a new storage tier to enable massive data archiving for supercomputing. The joint effort is aimed at determining innovative new ways to keep massive amounts of stored data available for rapid access, while also minimizing power consumption and improving the quality of data-driven research. Under a Cooperative Research and Development Agreement, Seagate and Los Alamos are working together on power-managed disk and software solutions for deep data archiving, which represents one of the biggest challenges faced by organizations that must juggle increasingly massive amounts of data using very little additional energy.
“Buffered read performance under Lustre has been inexplicably slow when compared to writes or even direct IO reads. A balanced FDR-based Object Storage Server can easily saturate the network or backend disk storage using o_direct based IO. However, buffered IO reads remain at 80% of write bandwidth. In this presentation we will characterize the problem, discuss how it was debugged and proposed resolution. The format will be a presentation followed by Q&A.”
In this special guest feature, Ken Strandberg describes the highlights of panel discussion on high performance storage at SC15. “There was significant discussion about identifying the most important workflows, e.g. will checkpoint/restart continue to dominate I/O demands, difficult to analyze scientific datasets, or some new emerging science workflows. In identifying these workflows, we expect to learn where to focus storage research.”
“Intel has incorporated Intel Solutions for Lustre Software as part of the Intel SSF because it provides the performance to move data and minimize storage bottlenecks. Lustre is also open source based, and already enjoys a wide foundation of deployments in research around the world, while gaining significant traction in enterprise HPC. Intel’s version of Lustre delivers a high-performance storage solution in the Intel SSF that next-generation HPC needs to move toward the era of Exascale.”