Sign up for our newsletter and get the latest HPC news and analysis.

HPC Storage: Current Status and Future Directions

torben

“Compared to frequent developments in CPUs and accelerators, disk and storage communication technologies as well as parallel file systems are not realizing the same rate of innovation (Moore’s Law). However, this is changing as a number of new new and interesting technologies and developments such as HAMR drives, hybrid disks, intelligent flash, and new communication protocols including 12 Gb/s SAS and PCI-E direct attach are becoming available in the industry. This presentation intends to explain these technological directions and explore what these techniques mean for HPC storage over the coming years.”

Video: CUDA 6 and Beyond

Mark Harris

In this video, Nvidia’s Mark Harris, provides a detailed look at the top new features of CUDA 6, including a deep-dive review of Unified Memory, which makes GPU programming easier by automatically migrating data between the CPU and GPU.

Video: Lustre Releases Presentation from LUG 2014

roadmap

“The Lustre community has banded together to work on the development of the Lustre source code. As part of that effort, we regularly discuss the roadmap for major Lustre releases. We have developed a schedule of major releases that occur every six months.”

A Vision of Storage for Exascale Computing

eric

“Back in July 2012, Whamcloud was awarded the Storage and I/O Research & Development subcontract for the Department of Energy’s FastForward program. Shortly afterward, the company was acquired by Intel. Nearly completed now, the two-year contract scope includes key R&D necessary for a new object storage paradigm for HPC exascale computing, and the developed technology will also address next-generation storage mechanisms required by the Big Data market.”

Video: Transitioning OpenSFS to a Community Nexus

Galen Shipman

In this video from LUG 2014, Galen Shipman from OpenSFS presents: Transitioning OpenSFS to a Community Nexus.

Panel: 2020 HPC Platform Architectures and Their Impact on Storage

panel

In this panel discussion from LUG 2014, Lustre users predict 2020 HPC Platform Architectures and Their Impact on Storage. “What will the future of HPC storage look like in the National Labs? This panel discussion suggest that storage will be vectoring off into some very new and interesting directions.”

Lustre Plus ZFS at LLNL: Production Plans and Best Practices

llnl

“LLNL’s largest supercomputer is paired with a 55-petabyte file system, known as Grove, that stores vast quantities of simulation data. Grove must transfer information to and from Sequoia at a minimum of 500 gigabytes per second. To support Grove’s high storage capacity and bandwidth requirements, LC software developers have engaged in a multi-year project to replace much of Grove’s Lustre foundation with ZFS. “

The Two-Minute Conference: LUG 2014 Time-lapse Video

ken

This Time Lapse video features sights and sounds from LUG 2014 in Miami.

OpenSFS, Lustre, and HSM: an Update from Cray

cray

“Cray Tiered Adaptive Storage (TAS) provides a complete and open archiving solution for Big Data and HPC. Powered by Versity’s open storage virtualization technology, data migration policies enable transparent data movement across up to 4 storage tiers comprised of SSD, disk, and/or tape.”

Video: Lustre Future Features

features

In this video from LUG 2014, Andreas Dilger from Intel presents: Lustre Future Features. The talk features an overview of the Feature Submission Process and a description of features proposed for Lustre 2.7 and future releases.