DK Panda from Ohio State University gave this talk at the 2019 Stanford HPC Conference. “This talk will provide an overview of challenges in designing convergent HPC and BigData software stacks on modern HPC clusters. An overview of RDMA-based designs for Hadoop (HDFS, MapReduce, RPC and HBase), Spark, Memcached, Swift, and Kafka using native RDMA support for InfiniBand and RoCE will be presented. Enhanced designs for these components to exploit HPC scheduler (SLURM), parallel file systems (Lustre) and NVM-based in-memory technology will also be presented. Benefits of these designs on various cluster configurations using the publicly available RDMA-enabled packages from the OSU HiBD project will be shown.”
Designing Convergent HPC and Big Data Software Stacks: An Overview of the HiBD Project
February 16, 2019 by Leave a Comment
GigaIO Technology Boosts Performance at the SC18 Student Cluster Competition
February 13, 2019 by Leave a Comment
Today GigaIO, announced that that the company’s new FabreX product was successfully used in the Student Cluster Competition at SC18. Students from the University of Warsaw incorporated GigaIO’s alpha product into their self-designed supercomputing cluster, marking the team’s fourth cluster competition event. “GigaIO offers cutting-edge high-performance computing technology, so it was a privilege to be among the first group to experiment with their newest product, FabreX.”
Podcast: What is an Ai Supercomputer?
February 12, 2019 by Leave a Comment
In this podcast, the Radio Free HPC team asks whether a supercomputer can or cannot be a “AI Supercomputer.” The question came up after HPE announced a new AI system called Jean Zay that will double the capacity of French supercomputing. “So what are the differences between a traditional super and a AI super? According to Dan, it mostly comes down to how many GPUs the system is configured with, while Shahin and Henry think it has something to do with the datasets.”
The State of High-Performance Fabrics: A Chat with the OpenFabrics Alliance
February 11, 2019 by Leave a Comment
In this special guest feature, Paul Grun and Doug Ledford from the OpenFabrics Alliance describe the industry trends in the fabrics space, its state of affairs and emerging applications. “Originally, ‘high-performance fabrics’ were associated with large, exotic HPC machines. But in the modern world, these fabrics, which are based on technologies designed to improve application efficiency, performance, and scalability, are becoming more and more common in the commercial sphere because of the increasing demands being placed on commercial systems.”
Stanford HPC Conference: Innovating the Way to the Future
February 7, 2019 by Leave a Comment
In this special guest feature, Cydney Ewald Stevens from the HPC Ai Advisory Council writes that the Stanford HPC Conference will focus using technology to build a better world. “AI and HPC practitioners share passions for cutting-edge technology and breakthrough R&D at Stanford University next week at the ninth annual Stanford Conference. The two-day conference will bring leaders from academia, government and industry together to share first-hand insights on innovative research, techniques, tools and technologies that are fueling economies, productivity and progress globally.”
WekaIO Beats Big Systems on the IO-500 10 Node Challenge
February 6, 2019 by Leave a Comment
Today WekaIO announced record performance on the IO-500 10 Node Challenge benchmark. The Virtual Institute for I/O has placed WekaIO Matrix in first place on the IO-500 10 Node Challenge list, beating out massive supercomputer installations. VI4IO republished the 10 Node Challenge list with the new rankings indicating Matrix as number one—31 percent faster than IBM Spectrum Scale and 85 percent faster than DDN Lustre.
Agenda Posted for Stanford HPC Conference Next Week
February 6, 2019 by Leave a Comment
The HPC Ai Advisory Council has posted the Agenda for the Stanford HPC Conference. The event takes place Feb. 14-15 in Palo Alto. “Focused on contributing to making the world a better place, our only US-based conference draws together renowned subject matter experts (SMEs) – from private and public sectors to startups and global giants, from across interests and industries in the valley and beyond – to explore the domains and disciplines fueling huge advances in new and ongoing research, innovation, and breakthrough discoveries.”
Why HPC Cloud is your Competitive Advantage
February 1, 2019 by Leave a Comment
In this special guest post, Thomas Francis writes that the Cloud is stepping up to answer the computational challenges of Ai and HPC. “Cloud delivers cost savings and efficiencies which are nice to have. But the reason companies are adopting the cloud is because suddenly it is a competitive advantage. And conversely, using your company’s precious resources on buying and managing aging hardware is a disadvantage.”
Video: Computing for the Endless Frontier at TACC
January 29, 2019 by Leave a Comment
In this talk from the Intel User Forum at SC18, Dan Stanzione from TACC presents: Computing for the Endless Frontier. “Coming to TACC in 2019, the Frontera supercomputer will be powered by Intel Xeon Scalable processors. It will be the first major HPC system to deploy the Intel Optane DC persistent memory technology for a range of HPC and AI uses. Anticipated early projects on Frontera include analyses of particle collisions from the Large Hadron Collider, global climate modeling, improved hurricane forecasting, and multi-messenger astronomy.”
200 Gigabit HDR InfiniBand to Power New Atos Supercomputers at CSC in Finland
January 28, 2019 by Leave a Comment
Last week in Finland, Mellanox announced that its 200 Gigabit HDR InfiniBand solutions were selected to accelerate a multi-phase supercomputer system at CSC – the Finnish IT Center for Science. The new supercomputers, set to be deployed in 2019 and 2020 by Atos, will serve the Finnish researchers in universities and research institutes, enhancing climate, renewable energy, astrophysics, nanomaterials and bioscience, among a wide range of exploration activities. The Finnish Meteorological Institute (FMI) will have their own separate partition for diverse simulation tasks ranging from ocean fluxes to atmospheric modeling and space physics.
