Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Video: Lustre Community Release Update

In this video from LAD’19 in Paris, Peter Jones from Whamcloud presents: Lustre Community Release Update. “Lustre is a vibrant Open Source project with many organizations working on new features and improvements in parallel. We coordinate those efforts primarily through OpenSFS and EOFS. Meeting development target dates is a difficult task for any software project, but doubly so in a globally distributed Open Source project.”

OpenSFS Announces Lustre 2.13.0 Release

On December 5, OpenSFS announced Lustre 2.13.0 Release has been declared GA and is available for download. The Lustre file system is a open source, parallel file system that supports the requirements of leadership class HPC and Enterprise environments worldwide. Lustre provides a POSIX compliant interface and scales to thousands of clients, petabytes of storage, and has demonstrated over a terabyte per second of sustained I/O bandwidth. “New features include: Persistent Client Cache, Multi-Rail Routing, Overstriping, and self-extending layouts.”

Podcast: UnifyFS Software Project steps up to Exascale

In this Let’s Talk Exascale podcast, Kathryn Mohror LLNL and Sarp Oral of ORNL provide an update ECP’s ExaIO project and UnifyFS. “UnifyFS can provide ECP applications performance-portable I/O across changing storage system architectures, including the upcoming Aurora, Frontier, and El Capitan exascale machines. “It is critically important that we provide this portability so that application developers don’t need to spend their time changing their I/O code for every system.”

Aldec’s new FPGA-based NVMe Data Storage Targets HPC Applications

Today Aldec, Inc. launched a powerful, versatile and time-saving FPGA-based NVMe Data Storage solution to aid in the development of High Performance Computing applications such as High Frequency Trading and Machine Learning. “NVMe SSDs are very popular in a wide range of high-performance computing applications, as are FPGAs because of their ability to handle parallel processing, their speed and programmability, plus the fact MPSoC FPGAs also feature ARM processor cores,” comments Louie De Luna, Director of Marketing. “Our newest FPGA-based embedded solution is aimed at engineers developing systems that will combine the power and benefits of NVMe and FPGAs.”

Building a Tiered Digital Storage Environment Based on User-Defined Metadata to Enable eResearch

In this special guest feature, David Fellinger from the iRODS Consortium writes that, as eResearch has evolved to accommodate sensor and other types of big data, iRODS can enable complete workflow control, data lifecycle management, and present discoverable data sets with assured traceability and reproducibility.

Lightbits Labs Launches Industry’s First NVMe/TCP Clustered Storage Solution

Today Lightbits Labs announced it has delivered the industry’s first NVMe/TCP clustered storage solution with the company’s LightOS technology. “At cloud scale, everything fails, so we built LightOS to capture all the benefits of disaggregated storage while providing exceptional durability and availability to prevent service disruption,” said Kam Eshghi, Chief Strategy Officer at Lightbits Labs.”

Innoviz to Accelerate AI for Autonomous Vehicles with WekaIO

Today WekaIO announced that Innoviz, a leading manufacturer of high-performance, solid-state Light Detection and Ranging (LiDAR) sensors and Perception Software that enables the mass-production of autonomous vehicles, has selected the Weka File System (WekaFS) to accelerate its Artificial Intelligence (AI) and deep learning workflows. WekaFS has been chosen by Innoviz to improve application performance at scale and deliver high bandwidth I/O to its GPU cluster.

NGD Systems Steps up with Arm Processors on SSDs at SC19

In this video from the Arm booth at SC19, Scott Shadley from NGD Systems describes the company’s innovative computational storage technology. “In a nutshell, Computational Storage is an IT architecture where data is processed at the storage device level to reduce the amount of data that has to move between the storage and compute planes. As such, the technology provides a faster and more efficient means to address the unique challenges of our data-heavy world – satisfying reduced excess bandwidth and providing very low latency response times by reducing data movement and allowing response for analytics as much as 20 to 40-times faster.”

IDC: DDN is Fastest Growing Supplier of All-Flash Arrays

Today DDN announced that it has leaped into the rankings of major all-flash array vendors as tracked by IDC over the first half of 2019. Through organic growth, investment in recent acquisitions and the closing of the transaction with Western Digital for the IntelliFlash business unit, DDN built an all-flash array portfolio which grew at a much larger percentage (78.7%) than rivals such as Dell Technologies, NetApp, Pure Storage and IBM. “It is increasingly critical for organizations to connect the right data to the right compute over the right interface at the right time. Our products and services are engineered to excel across all platforms and all providers, simultaneously. No one else in the marketplace delivers such a degree of data management freedom, flexibility and scalability.”

Video: GigaIO Optimizes FabreX Fabric with GPU Sharing and Composition Technology

In this video from SC19, Alan Benjamin from GigaIO describes how the company’s FabreX Architecture integrates computing, storage ans I/O into a single-system cluster PCIe-based fabric for flawless server-to-server communication and true cluster scale networking. “At the show, GigaIO announced the FabreX implementation of GPU Direct RDMA (GDR) technology, accelerating communication for GPU storage devices with the industry’s highest throughput and lowest latency.”