Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:

E8 Storage steps up to HPC with InfiniBand Support

Today E8 Storage announced availability of InfiniBand support to its high performance, NVMe storage solutions. The move comes as a direct response to HPC customers that wish to take advantage of the high speed, low latency throughput of InfiniBand for their data hungry applications. E8 Storage support for InfiniBand will be seamless for customers who now have the flexibility to connect via Ethernet or InfiniBand when paired with Mellanox ConnectX InfiniBand/VPI adapters. “Today we demonstrate once again that E8 Storage’s architecture can expand, evolve and always extract the full potential of flash performance,” comments Zivan Ori, co-founder and CEO of E8 Storage. “Partnering with market leaders like Mellanox that deliver the very best network connectivity technology ensures we continue to meet and, frequently, exceed the needs of our HPC customers even in their most demanding environments.”

Ceph on the Brain: Storage and Data-Movement Supporting the Human Brain Project

Adrian Tate from Cray and Stig Telfer from StackHPC gave this talk at the 2018 Swiss HPC Conference. “This talk will describe how Cray, StackHPC and the HBP co-designed a next-generation storage system based on Ceph, exploiting complex memory hierarchies and enabling next-generation mixed workload execution. We will describe the challenges, show performance data and detail the ways that a similar storage setup may be used in HPC systems of the future.”

Scratch to Supercomputers: Bottoms-up Build of Large-scale Computational Lensing Software

Gilles Fourestey from EPFL gave this talk at the Swiss HPC Conference. “LENSTOOL is a gravitational lensing software that models mass distribution of galaxies and clusters. It is used to obtain sub-percent precision measurements of the total mass in galaxy clusters and constrain the dark matter self-interaction cross-section, a crucial ingredient to understanding its nature.”

Shifter – Docker Containers for HPC

Alberto Madonaa gave this talk at the Swiss HPC Conference. “In this work we present an extension to the container runtime of Shifter that provides containerized applications with a mechanism to access GPU accelerators and specialized networking from the host system, effectively enabling performance portability of containers across HPC resources. The presented extension makes possible to rapidly deploy high-performance software on supercomputers from containerized applications that have been developed, built, and tested in non-HPC commodity hardware, e.g. the laptop or workstation of a researcher.”

Exploiting HPC Technologies for Accelerating Big Data Processing and Associated Deep Learning

DK Panda from Ohio State University gave this talk at the Swiss HPC Conference. “This talk will provide an overview of challenges in accelerating Hadoop, Spark, and Memcached on modern HPC clusters. An overview of RDMA-based designs for Hadoop (HDFS, MapReduce, RPC and HBase), Spark, Memcached, Swift, and Kafka using native RDMA support for InfiniBand and RoCE will be presented. Enhanced designs for these components to exploit NVM-based in-memory technology and parallel file systems (such as Lustre) will also be presented.”

New Types of Memory, their support in Linux, and how to use them via RDMA

Christoph Lameter from Jump Trading LLC gave this talk at the OpenFabrics Workshop. “Recently new types of memory have shown up like HBM (High Bandwidth Memory), Optane, 3DXpoint, NVDIMM, NVME and various “nonvolatile” types memory. This talk gives a brief rundown on what is available and gives some example on how the vendors enable the actual use of this memory in the operating system (f.e. DAX and filesystems) and then show how an application would make use of this memory. In particular then we will be looking at what considerations are important for the use of RDMA to those memory devices.”

The Transformation of HPC: Simulation and Cognitive Methods in the Era of Big Data

Dave Turek from IBM gave this talk at the Swiss HPC Conference. “There is a shift underway where HPC is beginning to be addressed with novel techniques and technologies including cognitive and analytic approaches to HPC problems and the arrival of the first quantum systems. This talk will showcase how IBM is merging cognitive, analytics, and quantum with classic simulation and modeling to create a new path for computational science.”

Intel’s Bill Magro Presents: Software Foundation for High-Performance Fabrics in the Cloud

Bill Magro from Intel gave this talk at the 2018 OpenFabrics Workshop. “Artificial Intelligence and High Performance Data Analytics workloads in the cloud are being fed by a deluge of data emanating from the Internet-connected population or people and things. This talk highlights the broadening role of OpenFabrics, in general, and the Open Fabrics Interface, in particular, to rise to the challenge of meeting the emerging requirements and become the software foundation for high-performance cloud fabrics.”

Call for Submissions: 2018 Perth HPC Conference

The 2018 Perth HPC Conference has announced their Call for Submissions. Hosted by the Pawsey Supercomputing Centre, The event takes place August 28-29 in Perth, Australia. “The second annual HPCAIAC Perth Conference will bring industry luminaries and leading subject matter experts together from all over the world to explore major and emerging domains and share in-depth insights on AI, Data Sciences, HPC, Deep/Machine Learning, Visualization and more.”

Mellanox powers NVIDIA DGX-2 AI Supercomputer

Today Mellanox announced that the company’s InfiniBand and Ethernet solutions have been chosen to accelerate the new NVIDIA DGX-2 artificial intelligence system. DGX-2 is the first 2 Petaflop system that combines sixteen GPUs and eight Mellanox ConnectX adapters, supporting both EDR InfiniBand and 100 gigabit Ethernet connectivity. The technological advantages of the Mellanox adapters with smart acceleration engines enable the highest performance for AI and Deep Learning applications.