Today Seagate announced that it is combining its Cloud Storage, High Performance Computing, and Electronic Solutions groups to further align the company’s full breadth of enterprise storage hardware capabilities.
In this video, Mootaz Elnozahy from KAUST discusses the arrival of the Shaheen II supercomputer. Some 25 times more powerful than its predecessor, Shaheen II is a Cray XC40 system with DataWarp burst buffer technology, a Cray Sonexion 2000 storage system, and a Cray Tiered Adaptive Storage (TAS) system.
“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”
“n this session, Seagate covers configuration guidelines and tuning of LNET Routing from InfiniBand to Ethernet using Lustre 2.1 through 2.6 server/clients as well demonstrating performance results by means of a synthetic benchmark called IOR. In addition, this presentation includes the topic of LNET Router failure and recovery during I/O as well as what environments can expect during these failure events.”
“With the current Lustre Performance Monitoring Tool (LMT) no longer in active development, and the current version incompatible with DNE based Lustre 2.5 deployments, there is a critical need for a new set of tools delivering the same basic Lustre performance metrics with the added ability to work compatibly with contemporary releases of Lustre.”
The Seagate ClusterStor Secure Data Appliance (SDA) is the HPC industry’s first scale-out secure storage system officially ICD-503 certified to consolidate multiple previously isolated systems, maintain data security, enforce security access controls, segregate data at different security levels, and provide audit trails, all in a single scale-out file system with proven linear performance and storage scalability.
In this video from SC14, Ken Claffey from Seagate describes how the company is doubling down on high performance computing with its ClusterStor technology. Full Transcript: Ken Claffey: Hey Rich. Good to see you again. insideHPC: Oh, yeah. It’s always a pleasure. You Xyratex guys are like family. Ken Claffey: Another year rolls around, it’s […]