Sign up for our newsletter and get the latest HPC news and analysis.

Current Status: Adoption of ZFS as Backend File System for Lustre

zfs-linux

In this video from the LAD’14 Conference in Reims, Gabriele Paciucci from Intel presents: Current Status of the Adoption of ZFS as Backend File System for Lustre. “With the release of Lustre 2.4 support for ZFS Lustre servers has arrived. Historically, Lustre has only supported ext4/ldiskfs servers and while those servers have performed well they do suffer from a number of well known limitations. Extending Lustre to use a next generation filesystem like ZFS allows it to achieve greater levels of scalability and introduces new functionality.”

SGI Rolls Out DMF for Lustre

lustre_dmf_diagram

Today SGI announced the immediate availability DMF for Lustre. “With SGI DMF for Lustre, enterprises can ensure constant access to data while leveraging the significant cost benefits and scalability of tiered storage.”

Commercial Grade Lustre File Systems

commercial grade lustre sm

With the release of Intel Enterprise Edition (EE) for Lustre software, commercial customers have an opportunity to employ a production-ready version of Lustre optimized for business HPDA. Intel EE for Lustre includes the open source distribution of Lustre with the latest features, fully tested and supported by Intel, a major collaborator in the development of the Lustre parallel file system.

Terascala Speeds File System Management at Virginia Tech

terascala

Today Terascala announced that an HPC storage appliance managed by Terascala is simplifying Lustre file system management at Virginia Tech’s Advanced Research Computing (ARC) facility.

Lustre & SELinux: In Theory and in Practice

lustre-logo2

In this video from the LAD’14 Conference in Reims, Sébastien Buisson from Bull Atos presents: Lustre & SELinux: In Theory and in Practice.

Video: SFA12KX and Lustre Update

ddn

“DDN presents some key features of the SFA12KX such as partial rebuild and QoS for reads which are quite unique in HPC. We also discuss the latest performance results from Lustre benchmarking, particularly as they apply to awkward workloads such as seen in genomics or energy exploration, that require both streaming and transactional performance. In this talk, we present an evaluation of transactional performance and scalability in Lustre today, including random read and write performance, small file performance, and metadata performance as run on DDN SFA12KX systems.”

Eric Barton on Improving Lustre RAS with Fast Forward Collectives

ericbarton

In this video, Eric Barton from Intel describes how the company is leveraging Fast Forward Collectives to improve Lustre RAS.

Building a CIFS/NFS Gateway to Lustre

cifs

“The acceptance and adoption of ClusterStor since its market introduction is a testament to the experience and stability that comes with a solution provider such as Xyratex,” said Earl Joseph, IDC program vice president for HPC. “With the release of the CIFS/NFS Gateway, we expect further market acceptance given that the Gateway aims to open avenues to Windows and Linux environments that were previously unavailable for the Lustre file system.”

Video: First Experience with Lustre DNE

imgres

“HPC systems have kept growing in the last decades, producing vast amounts of data. Over time, we noticed how increasingly difficult it is to manage these data. Lustre as parallel filesystem is widely used in the HPC domain. It answers most of the requirements of the new generations of the HPC systems. Before Lustre 2.4, the metadata operation was managed by single metadata server and target. Such single operation became a kind of bottleneck. As a first step to help solving this problem Lustre multiple metadata server and targets (DNE) came out with Lustre 2.4. This talk will cover the first experience with Lustre DNE, showing some results and discussing the next step.”

What is Lustre?

lustre

Fifteen years ago, the HPC community began developing a super fast and highly scalable parallel file system in response to the limitations of NFS. Called Lustre, it is the dominant file system technology now in use at half of the top 100 supercomputer installations worldwide (top500.org).