Why Use Containers for HPC on the NVIDIA GPU Cloud?
"Containers just make life easy. So one of the things that people have issues with running bare metal is from time to time their libraries change, maybe they want to try the new version of CUDA, the new version of cuDNN, and they forget to simlink it back to the original path. If you have packaged your app into a container, it's the same every time."
"There are so many reasons why you'd want to move to a container. Containers just make life easy. They really do. So one of the things that people have issues with running bare metal is from time to time their libraries change, maybe they want to try the new version of CUDA, the new version of cuDNN, and they forget to simlink it back to the original path. If you have packaged your app into a container, it's the same every time. Whatever's in the container, is in the container." [READ MORE...]
Featured Stories
Introducing the Cambridge Data Accelerator
In this video from the Dell EMC HPC Community meeting, Alisdair King from Cambridge University describes the new Cambridge Data Accelerator. "The Cambridge Data Accelerator is an open source software package for building Burst Buffers from high speed flash storage. With available support from Cambridge University, the Cambridge Data Accelerator offers flexibility and high performance for high performance workloads." [READ MORE...]
DDN Powers Data Solutions for AI at the GPU Technology Conference
In this video from the GPU Technology Conference, James Coomer from DDN describes how the company delivers high performance data solutions for machine learning and AI applications. "DDN customers are leveraging machine learning techniques to speed results and improve competitiveness, profitability, customer service, business intelligence, and research effectiveness. The performance and flexible sizing of DDN solutions are well-suited for large-scale machine learning programs. They have the power to feed massive training sets to high core count systems as well as the mixed I/O capabilities necessary to handle data efficiently for CPU, GPU, and mixed multi-algorithm environments from simple linear regressions to deep neural nets." [READ MORE...]
HPE Deploys "Genius" Supercomputer at KU Leuven
Today HPE announced a new supercomputer installation at KU Leuven, a Flemish research university consistently ranked as one of the five most innovative universities in the world. HPE collaborated with KU Leuven to develop and deploy Genius, a new supercomputer built to run artificial intelligence (AI) workloads. The system will be available to both academia and the industry to build applications that drive scientific breakthroughs, economic growth and innovation in Flanders, the northern region of Belgium. [READ MORE...]
Featured Resource
The Machine Learning Potential of a Combined Tech Approach
This is the first in a five-part series from a report exploring the potential of unified deep learning with CPU, GPU and FGPA technologies. This post explores the machine learning potential of taking a combined approach to these technologies. [READ MORE...]
Industry Perspectives
Radio Free HPC Looks at the New Coral-2 RFP for Exascale Computers
In this podcast, the Radio Free HPC team looks at the new Department of Energy’s RFP for Exascale Computers. "As far as predictions go, Dan thinks one machine will go to IBM and the other will go to Intel. Rich thinks HPE will win one of the bids with an ARM-based system designed around The Machine memory-centric architecture. They have a wager, so listen in to find out where the smart money is." [Read More...]
Why UIUC Built HPC Application Containers for NVIDIA GPU Cloud
In this video from the GPU Technology Conference, John Stone from the University of Illinois describes how container technology in the NVIDIA GPU Cloud help the University distribute accelerated applications for science and engineering. "Containers are a way of packaging up an application and all of its dependencies in such a way that you can install them collectively on a cloud instance or a workstation or a compute node. And it doesn't require the typical amount of system administration skills and involvement to put one of these containers on a machine." [Read More...]
Featured from insideBIGDATA
- Data Analytics, Algorithms & Machine Learning – Online Survey ResultsThis report, "Data Analytics, Algorithms & Machine Learning - Online Survey," was produced by Informa Engage on behalf of Dell EMC. The data was collected March 8, through March 26, 2018 from a wide cross section of industries. The goal was to investigate various issues around the current and future use of use of analytics, […]
News from insideBIGDATA
- As a Data Scientist, Do You Have to Start Worrying About Blockchain Any Time Soon?
- Data Analytics, Algorithms & Machine Learning – Online Survey Results
- 3 Key Infrastructure Considerations for Your Big Data Operation
- “Above the Trend Line” – Your Industry Rumor Central for 4/23/2018
- 3 Ways Marketers Should Use Data Science to Skyrocket Marketing Results
- Data Capture Challenges No One Wants to Talk About
- Kogniz Announces Launch of AICam – AI Surveillance Camera
Editor’s Choice
Fireside Chat: Jensen Huang from NVIDIA on how AI will revolutionize Medicine
In this video from the World Medical Innovation Forum, Jensen Huang from NVIDIA discusses the revolution of AI and Medicine with Keith Dreyer, Chief Data Science Officer at PHS. "Medical imaging researchers have discovered the power of deep learning. Half of the papers presented at last year’s MICCAI, the leading medical imaging conference, applied deep learning. We’re working with over 300 healthcare startups tackling challenges now possible with deep learning." [Read More...]
Quantum Computing at NIST
Carl Williams from NIST gave this talk at the HPC User Forum in Tucson. "Quantum information science research at NIST explores ways to employ phenomena exclusive to the quantum world to measure, encode and process information for useful purposes, from powerful data encryption to computers that could solve problems intractable with classical computers." [Read More...]
Containers Using Singularity on HPC
Abhinav Thota, from Indiana University gave this talk at the 2018 Swiss HPC Conference. "Container use is becoming more widespread in the HPC field. There are various reasons for this, including the broadening of the user base and applications of HPC. One of the popular container tools on HPC is Singularity, an open source project coming out of the Berkeley Lab. In this talk, we will introduce Singularity, discuss how users of Indiana University are using it and share our experience supporting it. This talk will include a brief demonstration as well." [Read More...]
Using the Titan Supercomputer to Develop 50,000 Years of Flood Risk Scenarios
Dag Lohmann from KatRisk gave this talk at the HPC User Forum in Tucson. "In 2012, a small Berkeley, California, startup called KatRisk set out to improve the quality of worldwide flood risk maps. The team wanted to create large-scale, high-resolution maps to help insurance companies evaluate flood risk on the scale of city blocks and buildings, something that had never been done. Through the OLCF’s industrial partnership program, KatRisk received 5 million processor hours on Titan." [Read More...]
Shifter - Docker Containers for HPC
Alberto Madonaa gave this talk at the Swiss HPC Conference. "In this work we present an extension to the container runtime of Shifter that provides containerized applications with a mechanism to access GPU accelerators and specialized networking from the host system, effectively enabling performance portability of containers across HPC resources. The presented extension makes possible to rapidly deploy high-performance software on supercomputers from containerized applications that have been developed, built, and tested in non-HPC commodity hardware, e.g. the laptop or workstation of a researcher." [Read More...]
