Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:

Singularity: Container Workflows for Compute

Greg Kurtzer from Sylabs gave this talk at the Stanford HPC Conference. “Singularity is a widely adopted container technology specifically designed for compute-based workflows making application and environment reproducibility, portability and security a reality for HPC and AI researchers and resources. Here we will describe a high-level overview of Singularity and demonstrate how to integrate Singularity containers into existing application and resource workflows as well as describe some new trending models that we have been seeing.”

Video: Container Mythbusters

Michael Jennings from LANL gave this talk at the Stanford HPC Conference. “As containers initially grew to prominence within the greater Linux community, particularly in the hyperscale/cloud and web application space, there was very little information out there about using Linux containers for HPC at all. In this session, we’ll confront this problem head-on by clearing up some common misconceptions about containers, bust some myths born out of misunderstanding and marketing hype alike, and learn how to safely (and securely!) navigate the Linux container landscape with an eye toward what the future holds for containers in HPC and how we can all get there together!”

The Inaugural Singularity User Group Meeting: Registration Open Now

The San Diego Supercomputer Center (SDSC) and Sylabs have teamed up to bring the Community its first ever meeting of the Singularity User Group (SUG). Singularity has become what it is today through the engagement of users, developers, and providers that have collectively developed a sense of community around the software and its ecosystem. Read on as Ian Lumb, Technical Writer at Sylabs, shares the origins of the new annual Singularity User Group Meeting.

Argonne Looks to Singularity for HPC Code Portability

Over at Argonne, Nils Heinonen writes that Researchers are using the open source Singularity framework as a kind of Rosetta Stone for running supercomputing code almost anywhere. “Once a containerized workflow is defined, its image can be snapshotted, archived, and preserved for future use. The snapshot itself represents a boon for scientific provenance by detailing the exact conditions under which given data were generated: in theory, by providing the machine, the software stack, and the parameters, one’s work can be completely reproduced.”

Sylabs Tunes Singularity 3.0 Containers for Machine Learning

Today Sylabs announced that it has released a new version of its innovative container software: Singularity 3.0. With new enterprise-class features, Singularity is now the premier container runtime solution, enabling your company to seamlessly and efficiently tackle today’s most demanding AI, machine learning, and advanced analytic workloads. “Lenovo and Sylabs have collaborated for over two years around a shared vision of producing lightweight HPC containers that are flexible, secure, and reproducible, while also delivering performance that is equal to native OS performance.”

Containers: Shifter and Singularity on Blue Waters

In this video from the Blue Waters 2018 Symposium, Maxim Belkin presents a tutorial on Containers: Shifter and Singularity on Blue Waters. “Container solutions are a great way to seamlessly execute code on a variety of platforms. Not only they are used to abstract away from the software stack of the underlying operating system, they also enable reproducible computational research. In this mini-tutorial, I will review the process of working with Shifter and Singularity on Blue Waters.”

Univa Announces Collaboration with Sylabs for HPC Containers

Today Univa announced a partnership with Sylabs to offer enhanced support and integration for Sylabs’ Singularity container platform in Univa Grid Engine and other Univa products. “Customers are rapidly embracing containers for high-performance workloads and Singularity offers clear advantages,” said Gary Tyreman, CEO of Univa. “We’re delighted to be collaborating with Sylabs to make container technology easier to use and deploy. By improving interoperability between Univa products and Singularity, we can make it easier for customers to reap the benefits associated with container technology.”

Containers Using Singularity on HPC

Abhinav Thota, from Indiana University gave this talk at the 2018 Swiss HPC Conference. “Container use is becoming more widespread in the HPC field. There are various reasons for this, including the broadening of the user base and applications of HPC. One of the popular container tools on HPC is Singularity, an open source project coming out of the Berkeley Lab. In this talk, we will introduce Singularity, discuss how users of Indiana University are using it and share our experience supporting it. This talk will include a brief demonstration as well.”

Singularity: The Inner Workings of Securely Running User Containers on HPC Systems

Michael Bauer from Sylabs gave this talk at FOSDEM’17. “This presentation will provide an in-depth look at how Singularity is able to securely run user containers on HPC systems. After a brief introduction to Singularity and its relationship to other container solutions, the details of Singularity’s runtime will be explored. The way that Singularity leverages Linux features such as namespaces, bind mounts, and SUID binaries will be discussed in further detail as well.”

Sylabs Startup forms Commercial Entity behind Singularity for HPC

Today an HPC Startup called Sylabs entered the market to provide solutions and services based on Singularity, an open source container technology designed for high performance computing. Founded by the inventor and project lead for Singularity, Sylabs will license and support Singularity Pro, an enterprise version of the software, and introduce it to businesses in the enterprise and HPC commercial markets.