In this video from the LAD’14 Conference in Reims, Gabriele Paciucci from Intel presents: Current Status of the Adoption of ZFS as Backend File System for Lustre. “With the release of Lustre 2.4 support for ZFS Lustre servers has arrived. Historically, Lustre has only supported ext4/ldiskfs servers and while those servers have performed well they do suffer from a number of well known limitations. Extending Lustre to use a next generation filesystem like ZFS allows it to achieve greater levels of scalability and introduces new functionality.”
With the release of Intel Enterprise Edition (EE) for Lustre software, commercial customers have an opportunity to employ a production-ready version of Lustre optimized for business HPDA. Intel EE for Lustre includes the open source distribution of Lustre with the latest features, fully tested and supported by Intel, a major collaborator in the development of the Lustre parallel file system.
“DDN presents some key features of the SFA12KX such as partial rebuild and QoS for reads which are quite unique in HPC. We also discuss the latest performance results from Lustre benchmarking, particularly as they apply to awkward workloads such as seen in genomics or energy exploration, that require both streaming and transactional performance. In this talk, we present an evaluation of transactional performance and scalability in Lustre today, including random read and write performance, small file performance, and metadata performance as run on DDN SFA12KX systems.”
“The acceptance and adoption of ClusterStor since its market introduction is a testament to the experience and stability that comes with a solution provider such as Xyratex,” said Earl Joseph, IDC program vice president for HPC. “With the release of the CIFS/NFS Gateway, we expect further market acceptance given that the Gateway aims to open avenues to Windows and Linux environments that were previously unavailable for the Lustre file system.”
“HPC systems have kept growing in the last decades, producing vast amounts of data. Over time, we noticed how increasingly difficult it is to manage these data. Lustre as parallel filesystem is widely used in the HPC domain. It answers most of the requirements of the new generations of the HPC systems. Before Lustre 2.4, the metadata operation was managed by single metadata server and target. Such single operation became a kind of bottleneck. As a first step to help solving this problem Lustre multiple metadata server and targets (DNE) came out with Lustre 2.4. This talk will cover the first experience with Lustre DNE, showing some results and discussing the next step.”