In this video, Eric Barton from Intel describes how the company is leveraging Fast Forward Collectives to improve Lustre RAS.
“The acceptance and adoption of ClusterStor since its market introduction is a testament to the experience and stability that comes with a solution provider such as Xyratex,” said Earl Joseph, IDC program vice president for HPC. “With the release of the CIFS/NFS Gateway, we expect further market acceptance given that the Gateway aims to open avenues to Windows and Linux environments that were previously unavailable for the Lustre file system.”
“HPC systems have kept growing in the last decades, producing vast amounts of data. Over time, we noticed how increasingly difficult it is to manage these data. Lustre as parallel filesystem is widely used in the HPC domain. It answers most of the requirements of the new generations of the HPC systems. Before Lustre 2.4, the metadata operation was managed by single metadata server and target. Such single operation became a kind of bottleneck. As a first step to help solving this problem Lustre multiple metadata server and targets (DNE) came out with Lustre 2.4. This talk will cover the first experience with Lustre DNE, showing some results and discussing the next step.”
In this video from the 2014 HPC Advisory Council Spain Conference, James Coomer from DDN presents: Adventures in Parallel Filesystems. “IT is currently in the middle of a rapid evolution in both hardware (flash-technolo- gies) and software (object-storage approaches). With respect to parallel filesystems these advances can potentially both speed up IO and better cope with the volume of data – all at lower cost. We report the results of a number of technology evaluations around parallel filesystems and provide some insights into how flash and object-stores will impact HPC in the coming years.”
The Lustre file system is a open source, parallel file system that supports the requirements of leadership class HPC and Enterprise environments worldwide. Lustre provides a POSIX compliant interface and scales to thousands of clients, petabytes of storage, and has demonstrated over a terabyte per second of sustained I/O bandwidth. Many of the largest and most powerful supercomputers on Earth today are powered by the Lustre file system, including over 60% of the TOP100 sites.
The recent release of a commercial version of the Lustre* parallel file system was big news for business data centers facing ever expanding data analysis and storage demands. Now, Lustre, the predominant high-performing file system installed in most of the supercomputer installations around the world, could be deployed to business customers in a hardened, tested, easy to manage and fully supported distribution.