DK Panda from Ohio State University gave this talk at the Swiss HPC Conference. “This talk will provide an overview of challenges in accelerating Hadoop, Spark, and Memcached on modern HPC clusters. An overview of RDMA-based designs for Hadoop (HDFS, MapReduce, RPC and HBase), Spark, Memcached, Swift, and Kafka using native RDMA support for InfiniBand and RoCE will be presented. Enhanced designs for these components to exploit NVM-based in-memory technology and parallel file systems (such as Lustre) will also be presented.”
Exploiting HPC Technologies for Accelerating Big Data Processing and Associated Deep Learning
April 13, 2018 by Leave a Comment
DK Panda Launches X-ScaleSolutions Startup for HPC Applications
April 10, 2018 by Leave a Comment
In this video, DK Panda from X-ScaleSolutions describes how the company optimizes and supports open source software for HPC. “At X-ScaleSolutions, we align cutting edge technology into a convergent trajectory so that business analytics with Big Data/Deep Learning can be solved with high-performance and scalability while exploiting the latest HPC and Cloud technologies. The vision of X-ScaleSolutions is to bring innovative and efficient end-to-end solutions, services, support, and training to our customers.”
Video: How MVAPICH & MPI Power Scientific Research
September 28, 2017 by Leave a Comment
Adam Moody from LLNL presented this talk at the MVAPICH User Group. “High-performance computing is being applied to solve the world’s most daunting problems, including researching climate change, studying fusion physics, and curing cancer. MPI is a key component in this work, and as such, the MVAPICH team plays a critical role in these efforts. In this talk, I will discuss recent science that MVAPICH has enabled and describe future research that is planned. I will detail how the MVAPICH team has responded to address past problems and list the requirements that future work will demand.”
Benefits of Multi-rail Cluster Architectures for GPU-based Nodes
September 13, 2017 by Leave a Comment
Craig Tierney from NVIDIA gave this talk at the MVAPICH User Group meeting. “As high performance computing moves toward GPU-accelerated architectures, single node application performance can be between 3x and 75x faster than the CPUs alone. Performance increases of this size will require increases in network bandwidth and message rate to prevent the network from becoming the bottleneck in scalability. In this talk, we will present results from NVLink enabled systems connected via quad-rail EDR Infiniband.”
Overview of the MVAPICH Project and Future Roadmap
September 8, 2017 by Leave a Comment
“This talk will provide an overview of the MVAPICH project (past, present and future). Future roadmap and features for upcoming releases of the MVAPICH2 software family (including MVAPICH2-X, MVAPICH2-GDR, MVAPICH2-Virt, MVAPICH2-EA and MVAPICH2-MIC) will be presented. Current status and future plans for OSU INAM, OEMT and OMB will also be presented.”
Challenges and Opportunities for HPC Interconnects and MPI
September 4, 2017 by Leave a Comment
“This talk will reflect on prior analysis of the challenges facing high-performance interconnect technologies intended to support extreme-scale scientific computing systems, how some of these challenges have been addressed, and what new challenges lay ahead. Many of these challenges can be attributed to the complexity created by hardware diversity, which has a direct impact on interconnect technology, but new challenges are also arising indirectly as reactions to other aspects of high-performance computing, such as alternative parallel programming models and more complex system usage models.”
OSC Hosts fifth MVAPICH Users Group
August 14, 2017 by Leave a Comment
A broad array of system administrators, developers, researchers and students who share an interest in the MVAPICH open-source library for high performance computing will gather this week for the fifth meeting of the MVAPICH Users Group (MUG). “Dr. Panda’s library is a cornerstone for HPC machines around the world, including OSC’s systems and many of the Top 500,” said Dave Hudak, Ph.D., interim executive director of OSC. “We’ve gained a lot of insight and expertise from partnering with DK and his research group throughout the years.”
Agenda Posted: August MVAPICH User Group Meeting in Ohio
July 21, 2017 by Leave a Comment
The MVAPICH User Group Meeting (MUG) has posted its meeting agenda. The event takes place August 14-16, 2017 in Columbus, Ohio. “As the annual gathering of MVAPICH2 users, researchers, developers, and system administrators, the MUG event includes Keynote Talks, Invited Tutorials, Invited Talks, Contributed Presentations, Open MIC session, and hands-on sessions.”
Call for Presentations: MVAPICH User Group Meeting (MUG)
June 2, 2017 by Leave a Comment
The MVAPICH User Group Meeting (MUG) has issued its Call for Presentations. As the annual gathering of MVAPICH2 users, researchers, developers, and system administrators, the MUG event includes Keynote Talks, Invited Tutorials, Invited Talks, Contributed Presentations, Open MIC session, and hands-on sessions. The event takes place August 14-16, 2017 in Columbus, Ohio.
Rock Stars of HPC: DK Panda
May 3, 2017 by 1 Comment
As our newest Rock Star of HPC, DK Panda sat down with us to discuss his passion for teaching High Performance Computing. “During the last several years, HPC systems have been going through rapid changes to incorporate accelerators. The main software challenges for such systems have been to provide efficient support for programming models with high performance and high productivity. For NVIDIA-GPU based systems, seven years back, my team introduced a novel `CUDA-aware MPI’ concept. This paradigm allows complete freedom to application developers for not using CUDA calls to perform data movement.”
