Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


DAOS: Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergence

As an all-new parallel file system, DAOS will be a key component of the the upcoming Aurora supercomputer coming to Argonne National Laboratory in 2021. “DAOS is an open source software-defined scale-out object store that provides high bandwidth, low latency, and high I/O operations per second (IOPS) storage containers to HPC applications. It enables next-generation data-centric workflows that combine simulation, data analytics, and AI.”

HPE Scalable Storage for Lustre: The Middle Way

Lustre is a widely-used parallel file system in the High Performance Computing (HPC) market. It offers the performance required for HPC workloads, with its parallel design, flexibility, and scalability. This sponsored post explores HPE scalable storage and the Lustre parallel file system, and outlines ‘a middle ground’ available via solutions that offer the combination of Community Lustre within a qualified hardware solution.

Video: Whamcloud is Back – Lustre Today and Future

Robert Triendl from DDN gave this talk at ISC 2018. “With their new Whamcloud Business Unit, DDN has already brought key Lustre developers on board to accelerate their high performance computing solutions. The acquisition also enables DDN to expand Lustre’s leading position from HPC and Exascale into high growth markets such as analytics, AI and hybrid cloud.”

Eric Barton Joins DDN as CTO for Software-Defined Storage

Today DDN appointed Eric Barton as the company’s chief technology officer for software-defined storage. In this role, Barton will lead the company’s strategic roadmap, technology architecture and product design for DDN’s newly created Infinite Memory Engine business unit. Barton brings with him more than 30 years of technology innovation, entrepreneurship and expertise in networking, distributed systems and storage software.

Video: Tianhe-1A Supercomputer at Work

In this video, researchers describe how the Tianhe-1 supercomputer supports scientific research. “Currently #43 on the TOP500, the 2.56 Petaflop Tianhe-1A carries out 1,400 computing tasks per day. It is mainly used to serve universities, research institutions, small and medium-sized enterprises, and provide scientific computing services.”

Lustre Dell Storage for HPC with Intel

The following sections of this paper will describe the Lustre File System, the Dell Storage for HPC with Intel EE for Lustre solution followed by performance analysis and conclusions. Appendix A: Benchmark Command Reference

Lustre Parallel File System

Lustre is a complex set of codes that takes time
to enhance and expand with new capabilities. Thus, the Lustre community of developers remains committed to keep it not only as the fastest and most scalable, open source parallel file system available, but to also add the rich enhancements the user community desires.

Lustre File System High Performance Guide

Today, Lustre File System is based entirely on Linux and is using kernel- based server modules to deliver the expected performance. Lustre can support many types of clients and runs on almost any modern hardware. Scalability is one of the most important features of Lustre File System and can be used to create a single namespace of what appears to be almost limitless capacity.

Lustre Software for Intel Cloud

Even the largest HPC clusters can experience degradation due to poor I/O performance. This occurs as massive amounts of data and increasingly large individual files combine limited disk drive hardware capacity to cause significant bottlenecks. Lustre is an open source parallel file system that improves the overall scalability and performance of HPC clusters. It provides cluster client nodes with shared access to file system data in parallel, greatly increasing throughout and performance. Lustre is the most widely used HPC storage system in the world-with parallel storage capabilities utilized by over 50% of HPC deployments-and can scale to tens of thousands of clients.

insideHPC Guide to Lustre Solutions for Business

In this Guide, we take a look at what an HPC solution like Lustre can deliver for a broad community of business and commercial organizations struggling with the challenge of big data and demanding storage growth.