Sign up for our newsletter and get the latest HPC news and analysis.

HPC Storage: Current Status and Future Directions

torben

“Compared to frequent developments in CPUs and accelerators, disk and storage communication technologies as well as parallel file systems are not realizing the same rate of innovation (Moore’s Law). However, this is changing as a number of new new and interesting technologies and developments such as HAMR drives, hybrid disks, intelligent flash, and new communication protocols including 12 Gb/s SAS and PCI-E direct attach are becoming available in the industry. This presentation intends to explain these technological directions and explore what these techniques mean for HPC storage over the coming years.”

Video: Lustre Releases Presentation from LUG 2014

roadmap

“The Lustre community has banded together to work on the development of the Lustre source code. As part of that effort, we regularly discuss the roadmap for major Lustre releases. We have developed a schedule of major releases that occur every six months.”

Podcast: Lustre with Multilevel Security – the New ClusterStor Secure Data Appliance

6000_0

“The ClusterStor SDA represents an industry first, combining low level data access enforcement and logging mechanisms, purpose-built within a proven HPC and Big Data single-system solution. Since our customers need to know exactly who is doing what on their systems, as well as access to complete and explicit audit trails, the ClusterStor SDA delivers all the necessary tools and support to collaboratively share information, while strictly complying with security data protection standards.”

A Vision of Storage for Exascale Computing

eric

“Back in July 2012, Whamcloud was awarded the Storage and I/O Research & Development subcontract for the Department of Energy’s FastForward program. Shortly afterward, the company was acquired by Intel. Nearly completed now, the two-year contract scope includes key R&D necessary for a new object storage paradigm for HPC exascale computing, and the developed technology will also address next-generation storage mechanisms required by the Big Data market.”

Video: Transitioning OpenSFS to a Community Nexus

Galen Shipman

In this video from LUG 2014, Galen Shipman from OpenSFS presents: Transitioning OpenSFS to a Community Nexus.

Lustre Plus ZFS at LLNL: Production Plans and Best Practices

llnl

“LLNL’s largest supercomputer is paired with a 55-petabyte file system, known as Grove, that stores vast quantities of simulation data. Grove must transfer information to and from Sequoia at a minimum of 500 gigabytes per second. To support Grove’s high storage capacity and bandwidth requirements, LC software developers have engaged in a multi-year project to replace much of Grove’s Lustre foundation with ZFS. “

The Two-Minute Conference: LUG 2014 Time-lapse Video

ken

This Time Lapse video features sights and sounds from LUG 2014 in Miami.

OpenSFS, Lustre, and HSM: an Update from Cray

cray

“Cray Tiered Adaptive Storage (TAS) provides a complete and open archiving solution for Big Data and HPC. Powered by Versity’s open storage virtualization technology, data migration policies enable transparent data movement across up to 4 storage tiers comprised of SSD, disk, and/or tape.”

Video: Lustre Future Features

features

In this video from LUG 2014, Andreas Dilger from Intel presents: Lustre Future Features. The talk features an overview of the Feature Submission Process and a description of features proposed for Lustre 2.7 and future releases.

Integrating Array Management into Lustre

roger

In this video from LUG 2014, Roger Ronald from System Fabric Works presents: Integrating Array Management into Lustre. “Intel Enterprise Edition for Lustre Plug-ins address a significant adoption barrier by improving ease of use. Now, System Fabric Works has implemented a NetApp plug-in for Intel EE Lustre and additional plug-ins for storage, networks, and servers are being encouraged.”