In this sponsored post, our friends over at Lenovo and Intel highlight how Lenovo is doing some exciting stuff with Intel’s DAOS software. DAOS, or Distributed Asynchronous Object Storage, is a scale-out HPC storage stack that uses the object storage paradigm to bypass some of the limitations of traditional parallel file system architectures.
Long Live Posix – HPC Storage and the HPC Datacenter
April 29, 2019 by
Robert Triendl from DDN gave this talk at the Swiss HPC Conference. “The Portable Operating System Interface (POSIX) is a family of standards specified by the IEEE Computer Society for maintaining compatibility between operating systems. Since it was developed over 30 years ago, storage has changed dramatically. To improve the IO performance of applications, many users have called for the relaxation in POSIX IO that could lead to the development of new storage mechanisms to improve not only application performance, but management, reliability, portability, and scalability.”
MarsFS – A Near-POSIX Namespace Leveraging Scalable Object Storage
May 10, 2016 by
David Bonnie from LANL presented this talk at the 2016 MSST Conference. “As we continue to scale system memory footprint, it becomes more and more challenging to scale the long-term storage systems with it. Scaling tape access for bandwidth becomes increasingly challenging and expensive when single files are in the many terabytes to petabyte range. Object-based scale out systems can handle the bandwidth requirements we have, but are also not ideal to store very large files as objects. MarFS sidesteps this while still leveraging the large pool of object storage systems already in existence by striping large files across many objects.”
