State of Linux Containers

Christian Kniep from Docker Inc. gave this talk at the Stanford HPC Conference. “This talk will recap the history of and what constitutes Linux Containers, before laying out how the technology is employed by various engines and what problems these engines have to solve. Afterward, Christian will elaborate on why the advent of standards for images and runtimes moved the discussion from building and distributing containers to orchestrating containerized applications at scale.”

Sylabs Startup forms Commercial Entity behind Singularity for HPC

Today an HPC Startup called Sylabs entered the market to provide solutions and services based on Singularity, an open source container technology designed for high performance computing. Founded by the inventor and project lead for Singularity, Sylabs will license and support Singularity Pro, an enterprise version of the software, and introduce it to businesses in the enterprise and HPC commercial markets.

VMware moves Virtualized HPC Forward at SC17

In this video from SC17, and Martin Yip and Josh Simons from VMware describe how the company is moving Virtualized HPC forward. “In recent years, virtualization has started making major inroads into the realm of High Performance Computing, an area that was previously considered off-limits. In application areas such as life sciences, electronic design automation, financial services, Big Data, and digital media, people are discovering that there are benefits to running a virtualized infrastructure that are similar to those experienced by enterprise applications, but also unique to HPC.”

Video: Introducing the Nitro Hypervisor – the Evolution of Amazon EC2 Virtualization

In this video from AWS Reinvent, Anthony Liguori from Amazon presents: Nitro Hypervisor – the Evolution of Amazon EC2 Virtualization. “The new Nitro hypervisor for Amazon EC2, introduced with the launch of C5 instances, is a component that primarily provides CPU and memory isolation for C5 instances. VPC networking, and EBS storage resources are implemented by dedicated hardware components that are part of all current generation EC2 instance families. It is built on core Linux Kernel-based Virtual Machine (KVM) technology, but does not include general purpose operating system components.

Univa Grid Engine adds UberCloud Parallel MPI to Docker Containers

Today Univa announced the integration of UberCloud parallel application containers with Univa Grid Engine. In May of last year, Univa, a leading innovator of workload management products, announced the availability of Docker software container support with its Grid Engine 8.4.0 product, enabling enterprises to automatically dispatch and run jobs in Docker containers, from a user specified Docker image, on a Univa Grid Engine cluster.

Ellexus Container Checker looks to Revolutionize Cloud Container Use

Ellexus has launched Container Checker on Amazon Web Services’ Marketplace, a pioneering cloud-based tool that provides visibility into the inner workings of Docker containers. “Container Checker will help people using cloud platforms to quickly detect problems within their containers before they are let loose on the cloud to potentially waste time and compute spend. Estimates suggest that up to 45% of cloud spend is wasted due in part to unknown application activity and unsuitable storage decisions, which is what we want to help businesses tackle.”

Video: The State of Linux Containers

“Linux Containers gain more and more momentum in all IT ecosystems. This talk provides an overview about what happened in the container landscape (in particular Docker) during the course of the last year and how it impacts datacenter operations, HPC and High-Performance Big Data. Furthermore Christian will give an update/extend on the ‘things to explore’ list he presented in the last Lugano workshop, applying what he learned and came across during the year 2016.”

Google Compute Engine offers VMs with 96 Skylake CPUs and 624GB of Memory

Google Compute Engine now offers new VMs with the most Skylake vCPUs of any cloud provider. “Skylake in turn provides up to 20% faster compute performance, 82% faster HPC performance, and almost 2X the memory bandwidth compared with the previous generation Xeon. Need even more compute power or memory? We’re also working on a range of new, even larger VMs, with up to 4TB of memory.”

Kubernetes Meets HPC

“While the notion of packaging a workload into a Docker container, publishing it to a registry, and submitting a YAML description of the workload is second nature to users of Kubernetes, this is foreign to most HPC users. An analyst running models in R, MATLAB or Stata simply wants to submit their simulation quickly, monitor their execution, and get a result as quickly as possible.”

Embry-Riddle University Deploys Cray CS Supercomputer for Aerospace

Today Embry-Riddle Aeronautical University announced it has deployed a Cray CS400 supercomputer. The four-cabinet system will power collaborative applied research with industry partners at the University’s new research facility – the John Mica Engineering and Aerospace Innovation Complex (“MicaPlex”) at Embry-Riddle Research Park.