Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Accelerating Apache Spark with RDMA

Yuval Degani from Mellanox presented this talk at the OpenFabrics Workshop. “In this talk, we present a Java-based, RDMA network layer for Apache Spark. The implementation optimized both the RPC and the Shuffle mechanisms for RDMA. Initial benchmarking shows up to 25% improvement for Spark Applications.”

Video: State of the OpenFabrics Alliance

In this video from the OpenFabrics Workshop, Susan Coulter from LANL presents: State of the OpenFabrics Alliance. “The OpenFabrics Alliance (OFA) is an open source-based organization that develops, tests, licenses, supports and distributes OpenFabrics Software (OFS). The Alliance’s mission is to develop and promote software that enables maximum application efficiency by delivering wire-speed messaging, ultra-low latencies and maximum bandwidth directly to applications with minimal CPU overhead.”

Accelerating Hadoop, Spark, and Memcached with HPC Technologies

“This talk will present RDMA-based designs using OpenFabrics Verbs and heterogeneous storage architectures to accelerate multiple components of Hadoop (HDFS, MapReduce, RPC, and HBase), Spark and Memcached. An overview of the associated RDMA-enabled software libraries (being designed and publicly distributed as a part of the HiBD project for Apache Hadoop.”

Recent Topics in the IBTA… and a Look Ahead

Bill Magro from IBTA gave this talk at the OpenFabrics Workshop. “This talk discusses some recent activities in the InfiniBand Trade Association including recent specification updates. It also provides a glimpse into the future for the IBTA.” Bill Magro is an Intel Fellow and Intel’s Chief Technologist for HPC software. In this role, he serves as the technical lead and strategist for Intel’s high-performance computing software and provides HPC software requirements for Intel product roadmaps.”

Video: RDMA on ARM

Pavel Shamis from ARM Research presented this talk at the OpenFabrics Workshop. “With the emerging availability server platforms based on ARM CPU architecture, it is important to understand ARM integrates with RDMA hardware and software eco-system. In this talk, we will overview ARM architecture and system software stack. We will discuss how ARM CPU interacts with network devices and accelerators. In addition, we will share our experience in enabling RDMA software stack (OFED/MOFED Verbs) and one-sided communication libraries (Open UCX, OpenSHMEM/SHMEM) on ARM and share preliminary evaluation results.”

Mellanox Doubles Silicon Photonics Ethernet Transceiver Speeds to 200Gb/s

Today Mellanox introduced a new line of 200Gb/s silicon photonics and VCSEL-based transceivers in the same QSFP28 package as today’s 100Gb/s products. These new transceivers double the bandwidth for hyperscale Web 2.0 and cloud 100Gb/s networks. Mellanox is also introducing 200Gb/s Active Optical Cables (AOCs) and Direct Attach Copper Cables (DACs), including breakout cables, to […]

OFA Workshop in Austin to Put Spotlight on InfiniBand and RoCE

“The OpenFabrics Alliance (OFA) workshop is an annual event devoted to advancing the state of the art in networking. The workshop is known for showcasing a broad range of topics all related to network technology and deployment through an interactive, community-driven event. The comprehensive event includes a rich program made up of more than 50 sessions covering a variety of critical networking topics, which range from current deployments of RDMA to new and advanced network technologies.”

Overview of the HGX-1 AI Accelerator Chassis

“The Project Olympus hyperscale GPU accelerator chassis for AI, also referred to as HGX-1, is designed to support eight of the latest “Pascal” generation NVIDIA GPUs and NVIDIA’s NVLink high speed multi-GPU interconnect technology, and provides high bandwidth interconnectivity for up to 32 GPUs by connecting four HGX-1 together. The HGX-1 AI accelerator provides extreme performance scalability to meet the demanding requirements of fast growing machine learning workloads, and its unique design allows it to be easily adopted into existing datacenters around the world.”

Ethernet Alliance to Demo 400G Networks at OFC 2017

Today the Ethernet Alliance announced plans of details of its upcoming OFC 2017 interoperability demo featuring the full spectrum of Ethernet speeds from 1 Gigabit (1G) to 400 Gigabit (400G). “It’s an incredibly exciting time in the industry as investments in next-generation Ethernet standards are coming to fruition. Our members – including equipment manufacturers, system and component vendors, test and measurement, and everyone else in-between – are developing the solutions that will enable these standards,” said John D’Ambrosia, chairman, Ethernet Alliance; and senior principal engineer, Huawei.

Women in IT: Apply for WINS Program at SC17

Applications are now being accepted for the Women in IT Networking at SC (WINS) program at SC17. The conference takes place Nov. 12-17 in Denver. “The WINS program seeks qualified female U.S. candidates in their early to mid-career to join the SCinet volunteer team to help build and operate SCinet for SC17. Selected candidates will receive full travel support and mentoring by well-known engineering experts in the research and education community.”