High-Performance Computing News Analysis | insideHPC
At the Convergence of HPC, AI and Quantum
Subscribe
  • News
    • Business of HPC
    • New Installations
  • HPC Hardware
    • Compute
    • CPUs, GPUs, FPGAs
    • Exascale
    • Future Technology
    • Green HPC
    • HPC/AI Chips and Systems
    • Network
    • Quantum Computing
    • Storage
  • HPC Software
    • AI & Machine Learning
    • Cloud HPC
    • High Performance Analytics
    • Lustre
    • Parallel Programming
    • Systems Management
    • Tools
    • Visualization
  • Industry Segments
    • Collaboration
    • Data Center
    • Enterprise HPC
    • Financial Services
    • Government
    • Manufacturing
    • Research / Education
  • Resources
    • Dell Technologies Spotlight
    • Education / Training
    • Events
    • Events Calendar
    • HPC Career Notes
    • Industry Perspectives
    • Jobs Board
    • Research / Reports
    • Rock Stars of HPC
    • The Exascale Report Archives
  • Special Reports
    • White Papers
  • Podcasts & Videos
    • @HPCpodcast
    • Other Podcasts
    • Videos
  • Jobs in HPC
  • Search

Video: Scalability Testing of DNE2 in Lustre 2.7

May 4, 2015 by Doug Black
Print Friendly, PDF & Email
  • tweet 
  • share 
  • share  
  • share  
  • email 

In this video from LUG 2015 in Denver, Steve Simms from Indiana University presents: Scalability Testing of DNE2 in Lustre 2.7.

The Lustre Distributed Namespace (DNE) feature allows for the distribution of file and directory metadata across multiple Lustre Metadata Targets (MDT). With this, you can now effectively scale your metadata load across a near unlimited number of targets. This both helps in reducing single metadata server hardware requirements as well as greatly expanding the maximum number of files your Lustre file system may contain. DNE Phase 2 enables deployment of striped directories on multiple MDS nodes and improved versatility.

Increasing Lustre’s metadata performance is something that Indiana University HPC users greatly desire. Because of the many user comments and requests, the High Performance File Systems group at IU has been looking into metadata performance using solid state storage devices. The most recent tests that we have performed involved the use of multiple metadata servers and the striped directory functionality provided by DNE2. This presentation will feature the data we have gathered on the relationship between metadata performance and MDT count using DNE2.”

Download the Slides * See more talks in the LUG 2015 Video Gallery. * Sign up for our insideHPC Newsletter.

  • tweet 
  • share 
  • share  
  • share  
  • email 
Filed Under: Events, HPC Software, Lustre, Resources, Videos Tagged With: DNE, LUG 2015, Metadata

Sponsored Guest Articles

HPC, AI, ML and Edge Solutions Drive Duos Railcar Inspection System Powered by Dell Technologies and Kalray

Industries such as railways are moving from traditional inspection methods to using AI and ML to perform automated inspection of railcars. Data streaming from the edge at high rates requires the compute power of a HPC cluster, storage and advanced analytics to return results in real time. The system also must effectively enable remote administration and management to ensure reliable….

White Papers

Bringing Personalized Medicine to Citizens

Novo Genomics   Healthcare start-up Novo Genomics is laying the foundation for personalized medicine in Saudi Arabia, with cutting-edge sequencing using the Lenovo Genomics Optimization And Scalability Tool (GOAST) architecture—based on Lenovo ThinkSystem SR630 V2 Servers powered by 3rd Gen Intel® Xeon® Scalable processors. The organization aims to harness genomics and multiomics to develop personalized […]

Download
More White Papers

Join Us On Social Media

Related Posts

Featured From

RSS Featured RSS Feed

  • Why FinOps Needs DataOps Observability
    In this special guest feature, Chris Santiago, Vice President/Solutions Engineering, Unravel Data, talks about controlling cloud spend through three phases of the FinOps lifecycle.

RSS More News from insideBIGDATA

  • What Does the Commercialization of Generative AI Mean for Society?
  • Video Highlights: Vicuña, Gorilla, Chatbot Arena and Socially Beneficial LLMs — with Prof. Joey Gonzalez
  • Anaconda’s State of Data Science Report Report Reveals Surge in AI Upskilling Among Data and IT Professionals
  • “Above the Trend Line” – Your Industry Rumor Central for 9/29/2023
  • Unleashing the Power of AI in Paid Search Marketing: Insights from Industry Expert
  • insideBIGDATA AI News Briefs – 9/28/2023
  • Automating Model Monitoring in MLOps: Leveraging AI to Track Performance and Detect Anomalies
  • About insideHPC
  • Contact
  • Advertise with insideHPC
  • Visit Our Other Site – insideBIGDATA
  • Terms of Service & Copyright
  • Privacy Policy
High-Performance Computing News Analysis | insideHPC
Copyright © 2023