Why Use Containers for HPC on the NVIDIA GPU Cloud?
"Containers just make life easy. So one of the things that people have issues with running bare metal is from time to time their libraries change, maybe they want to try the new version of CUDA, the new version of cuDNN, and they forget to simlink it back to the original path. If you have packaged your app into a container, it's the same every time." [READ MORE...]
Featured Stories
Hyperion Research Posts Interactive Map of 765 U.S. HPC Sites
Today Hyperion Research today launched an information-rich, interactive map of 765 HPC sites in the United States. "The mapped sites include government, academic and industrial HPC data centers, along with HPC vendors. This powerful tool can be used to identify the economic impact of HPC in a user-defined area (state, Congressional district, et al.) or for the United States as a whole, or to understand where HPC jobs are located, as well as who the Congressional district representatives are." [READ MORE...]
Introducing the Cambridge Data Accelerator
In this video from the Dell EMC HPC Community meeting, Alisdair King from Cambridge University describes the new Cambridge Data Accelerator. "The Cambridge Data Accelerator is an open source software package for building Burst Buffers from high speed flash storage. With available support from Cambridge University, the Cambridge Data Accelerator offers flexibility and high performance for high performance workloads." [READ MORE...]
DDN Powers Data Solutions for AI at the GPU Technology Conference
In this video from the GPU Technology Conference, James Coomer from DDN describes how the company delivers high performance data solutions for machine learning and AI applications. "DDN customers are leveraging machine learning techniques to speed results and improve competitiveness, profitability, customer service, business intelligence, and research effectiveness. The performance and flexible sizing of DDN solutions are well-suited for large-scale machine learning programs. They have the power to feed massive training sets to high core count systems as well as the mixed I/O capabilities necessary to handle data efficiently for CPU, GPU, and mixed multi-algorithm environments from simple linear regressions to deep neural nets." [READ MORE...]
Featured Resource
The Machine Learning Potential of a Combined Tech Approach
This is the first in a five-part series from a report exploring the potential of unified deep learning with CPU, GPU and FGPA technologies. This post explores the machine learning potential of taking a combined approach to these technologies. [READ MORE...]
Industry Perspectives
Radio Free HPC Looks at the New Coral-2 RFP for Exascale Computers
In this podcast, the Radio Free HPC team looks at the new Department of Energy’s RFP for Exascale Computers. "As far as predictions go, Dan thinks one machine will go to IBM and the other will go to Intel. Rich thinks HPE will win one of the bids with an ARM-based system designed around The Machine memory-centric architecture. They have a wager, so listen in to find out where the smart money is." [Read More...]
Why UIUC Built HPC Application Containers for NVIDIA GPU Cloud
In this video from the GPU Technology Conference, John Stone from the University of Illinois describes how container technology in the NVIDIA GPU Cloud help the University distribute accelerated applications for science and engineering. "Containers are a way of packaging up an application and all of its dependencies in such a way that you can install them collectively on a cloud instance or a workstation or a compute node. And it doesn't require the typical amount of system administration skills and involvement to put one of these containers on a machine." [Read More...]
Featured from insideBIGDATA
- Beyond Moon Shots and Unicorns: AI Can Go Everywhere Thanks to New AI Training and Modeling Platform OpleArtificial intelligence and the data science behind it are in high demand. An ever-expanding swath of industries see the value in AI-driven analysis and features. Yet finding the data scientists equipped to develop and refine them proves no easy task. Ople, the platform that automates AI modeling via AI, eliminates this bottleneck, making trained data […]
News from insideBIGDATA
- Beyond Moon Shots and Unicorns: AI Can Go Everywhere Thanks to New AI Training and Modeling Platform Ople
- The Importance of Enterprise AI – A Distance Measure to the C-Suite
- As a Data Scientist, Do You Have to Start Worrying About Blockchain Any Time Soon?
- Data Analytics, Algorithms & Machine Learning – Online Survey Results
- 3 Key Infrastructure Considerations for Your Big Data Operation
- “Above the Trend Line” – Your Industry Rumor Central for 4/23/2018
- 3 Ways Marketers Should Use Data Science to Skyrocket Marketing Results
Editor’s Choice
Fireside Chat: Jensen Huang from NVIDIA on how AI will revolutionize Medicine
In this video from the World Medical Innovation Forum, Jensen Huang from NVIDIA discusses the revolution of AI and Medicine with Keith Dreyer, Chief Data Science Officer at PHS. "Medical imaging researchers have discovered the power of deep learning. Half of the papers presented at last year’s MICCAI, the leading medical imaging conference, applied deep learning. We’re working with over 300 healthcare startups tackling challenges now possible with deep learning." [Read More...]
Quantum Computing at NIST
Carl Williams from NIST gave this talk at the HPC User Forum in Tucson. "Quantum information science research at NIST explores ways to employ phenomena exclusive to the quantum world to measure, encode and process information for useful purposes, from powerful data encryption to computers that could solve problems intractable with classical computers." [Read More...]
Containers Using Singularity on HPC
Abhinav Thota, from Indiana University gave this talk at the 2018 Swiss HPC Conference. "Container use is becoming more widespread in the HPC field. There are various reasons for this, including the broadening of the user base and applications of HPC. One of the popular container tools on HPC is Singularity, an open source project coming out of the Berkeley Lab. In this talk, we will introduce Singularity, discuss how users of Indiana University are using it and share our experience supporting it. This talk will include a brief demonstration as well." [Read More...]
Using the Titan Supercomputer to Develop 50,000 Years of Flood Risk Scenarios
Dag Lohmann from KatRisk gave this talk at the HPC User Forum in Tucson. "In 2012, a small Berkeley, California, startup called KatRisk set out to improve the quality of worldwide flood risk maps. The team wanted to create large-scale, high-resolution maps to help insurance companies evaluate flood risk on the scale of city blocks and buildings, something that had never been done. Through the OLCF’s industrial partnership program, KatRisk received 5 million processor hours on Titan." [Read More...]
Shifter - Docker Containers for HPC
Alberto Madonaa gave this talk at the Swiss HPC Conference. "In this work we present an extension to the container runtime of Shifter that provides containerized applications with a mechanism to access GPU accelerators and specialized networking from the host system, effectively enabling performance portability of containers across HPC resources. The presented extension makes possible to rapidly deploy high-performance software on supercomputers from containerized applications that have been developed, built, and tested in non-HPC commodity hardware, e.g. the laptop or workstation of a researcher." [Read More...]
