In this video from LUG 2015 in Denver, Steve Simms from Indiana University presents: Scalability Testing of DNE2 in Lustre 2.7.
The Lustre Distributed Namespace (DNE) feature allows for the distribution of file and directory metadata across multiple Lustre Metadata Targets (MDT). With this, you can now effectively scale your metadata load across a near unlimited number of targets. This both helps in reducing single metadata server hardware requirements as well as greatly expanding the maximum number of files your Lustre file system may contain. DNE Phase 2 enables deployment of striped directories on multiple MDS nodes and improved versatility.
Increasing Lustre’s metadata performance is something that Indiana University HPC users greatly desire. Because of the many user comments and requests, the High Performance File Systems group at IU has been looking into metadata performance using solid state storage devices. The most recent tests that we have performed involved the use of multiple metadata servers and the striped directory functionality provided by DNE2. This presentation will feature the data we have gathered on the relationship between metadata performance and MDT count using DNE2.”
Download the Slides * See more talks in the LUG 2015 Video Gallery. * Sign up for our insideHPC Newsletter.
