In this video from the 2016 MSST Conference, David Bonnie from LANL presents: MarsFS – A Near-POSIX Namespace Leveraging Scalable Object Storage.
“As we continue to scale system memory footprint, it becomes more and more challenging to scale the long-term storage systems with it. Scaling tape access for bandwidth becomes increasingly challenging and expensive when single files are in the many terabytes to petabyte range. Object-based scale out systems can handle the bandwidth requirements we have, but are also not ideal to store very large files as objects. MarFS sidesteps this while still leveraging the large pool of object storage systems already in existance by striping large files across many objects.”
Read our insideHPC interview with David Bonnie
Read the Apex Workflows Document
