Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV IB Clusters

Xiaoyi Lu from Ohio State University

In this video from the OpenFabrics Workshop, Xiaoyi Lu from Ohio State University presents: Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV InfiniBand Clusters.

“Single Root I/O Virtualization (SR-IOV) technology has been steadily gaining momentum for high performance interconnects such as InfiniBand. SR-IOV can deliver near native performance but lacks locality-aware communication support. This talk presents an efficient approach to building HPC clouds based on MVAPICH2 and RDMA-Hadoop with SR-IOV. We discuss high-performance designs of the virtual machine and container aware MVAPICH2 library over SR-IOV enabled HPC Clouds.”

This talk will also present a high-performance virtual machine migration framework for MPI applications on SR-IOV enabled InfiniBand clouds. The MVAPICH2 software for building HPC Clouds presented in this talk is publicly available. We will also discuss how to leverage the high-performance networking features (e.g., RDMA, SR-IOV) on cloud environments to accelerate data processing through RDMAHadoop package, which is publicly available. Comprehensive performance evaluations on NSF-supported Chameleon Cloud show that our design can deliver the near bare-metal performance.”

See more talks in the OpenFabrics Workshop Video Gallery

Sign up for our insideHPC Newsletter

Leave a Comment

*

Resource Links: