Los Alamos Releases File Index Product to Open Source

“We anticipate that the Grand Unified File Index will have a big impact on the ability for many levels of users to search data and get a fast response,” said Gary Grider, division leader for High Performance Computing at Los Alamos. “Compared with other methods, the Grand Unified File Index has the advantages of not requiring the system administrator to do the query, and it honors the user access controls allowing users and admins to use the same indexing system,” he said.

Persistent Memory Programming: The Current State of the Ecosystem

“In this presentation, Andy Rudoff from Intel reports on the latest developments around persistent memory programming. He’ll describing current discussions in the SNIA NVM Programming Technical Work Group, the current state of operating system support, recent tool and library development, and finally he’ll describe some of the upcoming challenges for high performance persistent memory use.”

Livestream: 2017 MSST Mass Storage Conference

We are very excited to bring you this livestream of the 2017 MSST Conference in Santa Clara. We’ll be broadcasting all the talks Wednesday, May 17 starting at 8:30am PDT.

Radio Free HPC Previews the MSST Mass Storage Conference

In this podcast, the Radio Free HPC team discusses the upcoming MSST Mass Storage Conference with Program Chair Matthew O’Keefe from Oracle. “Since the conference was founded by the leading national laboratories, MSST has been a venue for massive-scale storage system designers and implementers, storage architects, researchers, and vendors to share best practices and discuss building and securing the world’s largest storage systems for HPC, web-scale systems, and enterprises.”

Call for Participation: MSST 2017 in Santa Clara

The International Conference on Massive Storage Systems and Technology (MSST 2017) has issued its Call for Participation. The event takes place May 15-19, 2017 in Santa Clara, California. “MSST 2017 will dedicate five days to computer-storage technology, including a day of tutorials, two days of invited papers, two days of peer-reviewed research papers, and a vendor exposition.”

Learnings from Operating 200 PB of Disk-Based Storage

Gleb Budman from Backblaze presented this talk at the 2016 MSST Conference. “For Q1 2016 we are reporting on 61,590 operational hard drives used to store encrypted customer data in our data center. In Q1 2016, the hard drives in our data center, past and present, totaled over one billion hours in operation to date. That’s nearly 42 million days or 114,155 years worth of spinning hard drives. Let’s take a look at what these hard drives have been up to.”

Video: Whither Hard Disk Archives?

In this video from the 2016 MSST Conference, Dave Anderson from Seagate presents: Whither Hard Disk Archives? The talk was part of a panel discussion on Data-intensive Workflows.

MarsFS – A Near-POSIX Namespace Leveraging Scalable Object Storage

David Bonnie from LANL presented this talk at the 2016 MSST Conference. “As we continue to scale system memory footprint, it becomes more and more challenging to scale the long-term storage systems with it. Scaling tape access for bandwidth becomes increasingly challenging and expensive when single files are in the many terabytes to petabyte range. Object-based scale out systems can handle the bandwidth requirements we have, but are also not ideal to store very large files as objects. MarFS sidesteps this while still leveraging the large pool of object storage systems already in existence by striping large files across many objects.”

Storage Performance Modeling for Future Systems

In this video from the 2016 MSST Conference, Yoonho Park from IBM presents: Storage Performance Modeling for Future Systems. “The burst buffer is an intermediate, high-speed layer of storage that is positioned between the application and the parallel file system (PFS), absorbing the bulk data produced by the application at a rate a hundred times higher than the PFS, while seamlessly draining the data to the PFS in the background.”

Video: Versity HSM – Archiving to Objects

In this video from the 2016 MSST Conference, Harriet Coverston from Versity presents: Versity – Archiving to Objects. “Introducing Versity Storage Manager – an enterprise-class storage virtualization and archiving system that runs on Linux. Offering comprehensive data management for tiered storage environments and the ability to preserve and protect your data forever. Maximum protection at a minimum cost. Versity supports nearly unlimited volumes of storage and offers the most robust archive policy engine on the market.”