Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Video: Lustre / ZFS at Indiana University

Steve Simms from Indiana University gave this talk at the DDN User Group meeting in Frankfurt. “ZFS backed OST’s can be migrated to new hardware or to existing reconfigured hardware by leveraging ZFS snapshots and ZFS send/receive operations. The ZFS snapshot/send/receive migration method leverages incremental data transfers, allowing an initial data copy to be “caught up” with subsequent incremental changes.”

RAID Inc. Joins OpenSFS to Support the Lustre File System

RAID Incorporated has joined OpenSFS (Open Scalable File Systems, Inc.). OpenSFS is a non-profit organization that supports the vendor-neutral development of Lustre. Since 2010, OpenSFS has utilized working groups, events, and funding initiatives to encourage the growth and stability of the Lustre community, as well as facilitate collaborative benefits of its members, to ensure Lustre remains open, free, and flourishing. “RAID Incorporated undoubtedly brings great value to OpenSFS and will aid in boosting the continued innovation and advancements of the Lustre file system,” said OpenSFS President Sarp Oral.

Video: ZFS Improvements for Lustre

In this video from LAD’17 in Paris, Adreas Dilger from Intel presents: ZFS Improvements for Lustre. “Lustre is the Parallel file system of choice for High Performance Computing and large file applications. To meet the capacity and throughput requirements of HPC workloads, Lustre has traditionally required adoption of custom proprietary storage products leading to vendor lock-in and reduced innovation. The evolution of software defined high availability platforms like ZFS running on Linux now make it possible to meet the performance requirements of HPC on open industry standard x86 platforms.”

NEC’s Aurora Vector Engine & Advanced Storage Speed HPC & Machine Learning at ISC 2017

In this video from ISC 2017, Oliver Tennert from NEC Deutschland GmbH introduces the company’s advanced technologies for HPC and Machine Learning. “Today NEC Corporation announced that it has developed data processing technology that accelerates the execution of machine learning on vector computers by more than 50 times in comparison to Apache Spark technologies.”

DDN Storage Innovations Enhance Performance and Reliability at Scale

“Today DDN announced a series of performance and reliability innovations across its storage appliances, aimed at meeting the growing demand for storage performance, simplicity and reliability at scale in a new era of data-centric computing. Infinite Memory Engine (IME) and Storage Fusion Architecture (SFA) product lines now feature significant new data protection and performance improvements that allow DDN customers to deploy a complete suite of storage services across even the most demanding emerging IoT, deep learning and technical HPC environments.”

Bridging Big – Small, Fast – Slow with Campaign Storage

Peter Braam gave this talk at the MSST 2017 Mass Storage Conference. “Campaign Storage offers radical revisions of old workflows and adapts to new technologies. But it also leverages widely available technologies and interfaces to offer stability from the ground up and blend in with the past. We’ll discuss how a simple combination of components can support scalability, data analytics and efficient integration with memory based storage.”

Interview: Peter Braam on How Campaign Storage Bridges the Small & Big, Fast & Slow

Peter Braam is well-known in the HPC Community for his early work with Lustre and other projects like the SKA telescope Science Data Processor. As one of the featured speakers at the upcoming MSST Mass Storage Conference, Braam will describe how his Campaign Storage Startup provides tools for massive parallel data movement between the new low cost, industry standard campaign storage tiers with premium storage for performance or availability.

RWTH Aachen University Deploys NEC LX Supercomputer

Today NEC Corporation announced the deployment of an LX supercomputer at RWTH Aachen University in Germany. Featuring offering high performance computing services for engineering and scientific research. “We selected the NEC LX technology because of its superior performance, as well as low total cost of ownership due to innovative cooling technology,” said Professor Matthias Muller, head of the IT Center at RWTH Aachen University. “Going forward, we are excited to work with NEC as a strong corporate partner in expanding our IT research.”

RAID Inc. Steps up with ZFS on Lustre at SC16

In this video from SC16, Brad Merchant from RAID Inc. describes the company’s new Lustre ZFS Building Block. “RAID Inc. offers a suite of building block product families that can be purchased individually or in conjunction with other RAID products to solve customer’s needs in the most demanding data-storage environments. Each product is customized to address customer’s individual requirements of performance, reliability, scalability and price. Each product is put through extensive testing and a burn-in/staging process which ensures customers will receive a solution designed to function as specified in their unique environment.”

Intel Enterprise Edition for Lustre Updates in time for SC16

Intel has announced the availability of Intel Enterprise Edition for Lustre* software V3.0.1.3. This maintenance release has the latest CVE updates from RHEL 7.2. Intel also announced a pair of Lustre events coming to SC16 in Salt Lake City.