Sign up for our newsletter and get the latest big data news and analysis.
Daily
Weekly

Elbencho – A New Storage Benchmark for AI

Germany, Feb 03, 2021 — Elbencho, a new open-source storage benchmark tool, is now available to help organizations that demand high performance and need to evaluate performance of modern storage systems, optionally including GPUs in the storage access. Elbencho is available for download at: https://github.com/breuner/elbencho Traditionally, storage system vendors published numbers primarily based on simple […]

A2I POWER Processor Core Contributed to OpenPOWER Community

The IBM-led OpenPOWER Foundation announced the contribution of the IBM A2I POWER processor core design and associated FPGA environment to the open source ecosystem. The release, which took place today at the Linux Foundation Open Source Summit, follows the opening of the POWER Instruction Set Architecture (ISA) last August and is intended to enable the […]

Video: LANL Open Sources DeltaFS software for Wrangling Trillions of Files

A new distributed file system for HPC being distributed today via GitHub provides unprecedented performance for creating, updating and managing extreme numbers of files. “We designed DeltaFS to enable the creation of trillions of files,” said Brad Settlemyer, a Los Alamos computer scientist and project leader. “Such a tool aids researchers in solving classical problems in high-performance computing, such as particle trajectory tracking or vortex detection.”

Microsoft Releases Batch Shipyard on GitHub for Docker on Azure

“Available on GitHub as Open Source, the Batch Shipyard toolkit enables easy deployment of batch-style Dockerized workloads to Azure Batch compute pools. Azure Batch enables you to run parallel jobs in the cloud without having to manage the infrastructure. It’s ideal for parametric sweeps, Deep Learning training with NVIDIA GPUs, and simulations using MPI and InfiniBand.”