Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:

Decoupling EDA Toolchains from the OS with Singularity Containers

Singularity containers introduce a compelling means for unlocking the implied dependency between application toolchains and operating system. By encapsulating everything but the kernel in a single file, Singularity containers decouple the runtime and allow it to be highly portable in a trusted way. 

Benchmarking MPI Applications in Singularity Containers on Traditional HPC and Cloud Infrastructures

Andrei Plamada from ETH Zurich gave this talk at the hpc-ch forum on Cloud and Containers. “Singularity is a container solution that promises to both integrate MPI applications seamlessly and run containers without privilege escalation. These benefits make Singularity a potentially good candidate for the scientific high-performance computing community. However, the performance overhead introduced by Singularity is unclear. In this work we will analyze the overhead and the user experience on both traditional HPC and cloud infrastructures.”

Towards Reproducible Data Analysis Using Cloud and Container Technologies

Sergio Maffioletti from the University of Zurich gave this talk at the hpc-ch forum on Cloud and Containers. “In this talk, we’ll provide an overview of the challenges faced by both research infrastructure providers and Science IT units, along with best practices to improve the reproducibility of data analysis using cloud and container technologies.”

How Singularity Containers can ease the Transition to RHEL 8

The general availability of Red Hat Enterprise Linux 8 was announced this week at the Red Hat Summit in Boston. In this special guest feature, Ian Lumb writes that the company’s Singularity containers can ease the transition to RHEL 8. “RHEL 8 is a transition over time, not a discrete event in time. Singularity containers preserve your heavily vested legacy deployments, while enabling you to make the transition on your terms.”

Video: Managing large-scale cosmology simulations with Parsl and Singularity

Rick Wagner from Globus gave this talk at the Singularity User Group “We package the imSim software inside a Singularity container so that it can be developed independently, packaged to include all dependencies, trivially scaled across thousands of computing nodes, and seamlessly moved between computing systems. To date, the simulation workflow has consumed more than 30M core hours using 4K nodes (256K cores) on Argonne’s Theta supercomputer and 2K nodes (128K cores) on NERSC’s Cori supercomputer.”

SingularityPRO comes to Google Cloud

Today Sylabs announced a multi-phase collaboration with Google Cloud as a technology partner. Aimed at systematically addressing enterprise requirements in a cloud-native fashion, the first phase of the collaboration will be based upon availability of Sylabs’ SingularityPRO via the Google Cloud Platform Marketplace. “Singularity is a widely adopted container runtime that implements a unique security model to mitigate privilege escalation risks, and provides a platform to capture a complete application environment into a single file.”

SDSC and Sylabs Gather for Singularity User Group

The San Diego Supercomputer Center (SDSC) at UC San Diego, and recently hosted the first-ever Singularity User Group meeting, attracting users and developers from around the nation and beyond who wanted to learn more about the latest developments in an open source project known as Singularity. Now in use on SDSC’s Comet supercomputer, Singularity has quickly become an essential tool in improving the productivity of researchers by simplifying the development and portability challenges of working with complex scientific software.

Singularity 3.1.0 brings in Full OCI Compliance

Today Sylabs announced that Singularity 3.1.0 is now generally available. With this release, Singularity is fully compliant with standards established by the Open Containers Initiative (OCI), and benefits from enhanced management of cached images. Open source based Singularity continues to systematically incorporate code-level changes specific to the Darwin operating environment, as it progresses towards support for macOS platforms. These, and […]

Singularity: Container Workflows for Compute

Greg Kurtzer from Sylabs gave this talk at the Stanford HPC Conference. “Singularity is a widely adopted container technology specifically designed for compute-based workflows making application and environment reproducibility, portability and security a reality for HPC and AI researchers and resources. Here we will describe a high-level overview of Singularity and demonstrate how to integrate Singularity containers into existing application and resource workflows as well as describe some new trending models that we have been seeing.”

Video: Container Mythbusters

Michael Jennings from LANL gave this talk at the Stanford HPC Conference. “As containers initially grew to prominence within the greater Linux community, particularly in the hyperscale/cloud and web application space, there was very little information out there about using Linux containers for HPC at all. In this session, we’ll confront this problem head-on by clearing up some common misconceptions about containers, bust some myths born out of misunderstanding and marketing hype alike, and learn how to safely (and securely!) navigate the Linux container landscape with an eye toward what the future holds for containers in HPC and how we can all get there together!”