“At ISC 2015, Seagate announced that the company has extended its alliance agreement with computing leader HP to equip its high performance computing solutions with ClusterStor scale-out storage capabilities. Building on a proven partnership, HP will resell Seagate’s ClusterStor 1500 and 9000 appliances along with its HPC solutions. This partnership will support HP’s Apollo portfolio of products and services, which manage HPC workloads in complex computing environments.”
Today Seagate announced it is integrating IBM Spectrum Scale software, based upon GPFS technology, with its ClusterStor HPC storage to deliver a new software defined storage appliance. The new appliance will help users manage the demands of data-intensive workloads, such as genomic research, computer aided design, digital media, data analytics, financial model analysis and electronic design simulations.
In this video, Kyle Lamb from the Infrastructure Team at Los Alamos National Lab describes the unique challenges he faces at a facility known for being at the forefront of technology. Kyle addresses the future of storage for High Performance Computing and the ways LANL is partnering with Seagate to tackle the changes on the horizon.
“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”
“n this session, Seagate covers configuration guidelines and tuning of LNET Routing from InfiniBand to Ethernet using Lustre 2.1 through 2.6 server/clients as well demonstrating performance results by means of a synthetic benchmark called IOR. In addition, this presentation includes the topic of LNET Router failure and recovery during I/O as well as what environments can expect during these failure events.”
Although there are a number of truly huge implementations of Lustre today, the community is still far from reaching the maximum configurations that the Lustre architecture is designed for. Inside the Lustre File System describes the basics of how the Lustre File System operates with descriptions of the newest features.
“With the current Lustre Performance Monitoring Tool (LMT) no longer in active development, and the current version incompatible with DNE based Lustre 2.5 deployments, there is a critical need for a new set of tools delivering the same basic Lustre performance metrics with the added ability to work compatibly with contemporary releases of Lustre.”
“The Cray-Seagate partnership is helping expand the boundaries of what’s possible in large-scale, data-intensive computing, far beyond what we could have imagined just 10 years ago. This continued innovation using the Lustre open file system is helping assist data-intense applications critical to advancements in important industries around the world.”