Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:

Long Live Posix – HPC Storage and the HPC Datacenter

Robert Triendl from DDN gave this talk at the Swiss HPC Conference. “The Portable Operating System Interface (POSIX) is a family of standards specified by the IEEE Computer Society for maintaining compatibility between operating systems. Since it was developed over 30 years ago, storage has changed dramatically. To improve the IO performance of applications, many users have called for the relaxation in POSIX IO that could lead to the development of new storage mechanisms to improve not only application performance, but management, reliability, portability, and scalability.”

MarsFS – A Near-POSIX Namespace Leveraging Scalable Object Storage

David Bonnie from LANL presented this talk at the 2016 MSST Conference. “As we continue to scale system memory footprint, it becomes more and more challenging to scale the long-term storage systems with it. Scaling tape access for bandwidth becomes increasingly challenging and expensive when single files are in the many terabytes to petabyte range. Object-based scale out systems can handle the bandwidth requirements we have, but are also not ideal to store very large files as objects. MarFS sidesteps this while still leveraging the large pool of object storage systems already in existence by striping large files across many objects.”