Podcast: The Trouble with ZFS

In this podcast, the Radio Free HPC team discuss whether ZFS is ever going to meet its potential. “Henry weighs in on the evolution of ZFS and how his opinion of ZFS has changed over the last decade or so. Both Shahin and Henry feel ZFS is unique and highly useful and that maybe Linus isn’t up on current ZFS capabilities.”

Raid Inc. Partners with Whamcloud for Turnkey Lustre on ZFS Appliance

Today RAID Incorporated announced the launch of Pangea, the first turnkey Lustre on ZFS appliance in the market. “RAID Inc. has partnered with Whamcloud to provide this preconfigured, highly available software stack for Lustre. Easy to manage, this stack ensures systems won’t breakdown. Pangea is also fully supported by RAID Inc. and Whamcloud for deployments of all sizes.”

Video: Lustre / ZFS at Indiana University

Steve Simms from Indiana University gave this talk at the DDN User Group meeting in Frankfurt. “ZFS backed OST’s can be migrated to new hardware or to existing reconfigured hardware by leveraging ZFS snapshots and ZFS send/receive operations. The ZFS snapshot/send/receive migration method leverages incremental data transfers, allowing an initial data copy to be “caught up” with subsequent incremental changes.”

RAID Inc. Joins OpenSFS to Support the Lustre File System

RAID Incorporated has joined OpenSFS (Open Scalable File Systems, Inc.). OpenSFS is a non-profit organization that supports the vendor-neutral development of Lustre. Since 2010, OpenSFS has utilized working groups, events, and funding initiatives to encourage the growth and stability of the Lustre community, as well as facilitate collaborative benefits of its members, to ensure Lustre remains open, free, and flourishing. “RAID Incorporated undoubtedly brings great value to OpenSFS and will aid in boosting the continued innovation and advancements of the Lustre file system,” said OpenSFS President Sarp Oral.

Video: ZFS Improvements for Lustre

In this video from LAD’17 in Paris, Adreas Dilger from Intel presents: ZFS Improvements for Lustre. “Lustre is the Parallel file system of choice for High Performance Computing and large file applications. To meet the capacity and throughput requirements of HPC workloads, Lustre has traditionally required adoption of custom proprietary storage products leading to vendor lock-in and reduced innovation. The evolution of software defined high availability platforms like ZFS running on Linux now make it possible to meet the performance requirements of HPC on open industry standard x86 platforms.”

NEC’s Aurora Vector Engine & Advanced Storage Speed HPC & Machine Learning at ISC 2017

In this video from ISC 2017, Oliver Tennert from NEC Deutschland GmbH introduces the company’s advanced technologies for HPC and Machine Learning. “Today NEC Corporation announced that it has developed data processing technology that accelerates the execution of machine learning on vector computers by more than 50 times in comparison to Apache Spark technologies.”

DDN Storage Innovations Enhance Performance and Reliability at Scale

“Today DDN announced a series of performance and reliability innovations across its storage appliances, aimed at meeting the growing demand for storage performance, simplicity and reliability at scale in a new era of data-centric computing. Infinite Memory Engine (IME) and Storage Fusion Architecture (SFA) product lines now feature significant new data protection and performance improvements that allow DDN customers to deploy a complete suite of storage services across even the most demanding emerging IoT, deep learning and technical HPC environments.”

Bridging Big – Small, Fast – Slow with Campaign Storage

Peter Braam gave this talk at the MSST 2017 Mass Storage Conference. “Campaign Storage offers radical revisions of old workflows and adapts to new technologies. But it also leverages widely available technologies and interfaces to offer stability from the ground up and blend in with the past. We’ll discuss how a simple combination of components can support scalability, data analytics and efficient integration with memory based storage.”

Interview: Peter Braam on How Campaign Storage Bridges the Small & Big, Fast & Slow

Peter Braam is well-known in the HPC Community for his early work with Lustre and other projects like the SKA telescope Science Data Processor. As one of the featured speakers at the upcoming MSST Mass Storage Conference, Braam will describe how his Campaign Storage Startup provides tools for massive parallel data movement between the new low cost, industry standard campaign storage tiers with premium storage for performance or availability.

RWTH Aachen University Deploys NEC LX Supercomputer

Today NEC Corporation announced the deployment of an LX supercomputer at RWTH Aachen University in Germany. Featuring offering high performance computing services for engineering and scientific research. “We selected the NEC LX technology because of its superior performance, as well as low total cost of ownership due to innovative cooling technology,” said Professor Matthias Muller, head of the IT Center at RWTH Aachen University. “Going forward, we are excited to work with NEC as a strong corporate partner in expanding our IT research.”