Video: How Univa Helps Shared Mission-critical and High-performance Datacenters

“Univa is a workload optimization company. Our core product, Grid Engine software, creates a single virtual high throughput, high performance and hyper-scale compute pool out of distributed data center resources. Our customers efficiently run large quantities of mission-critical compute-intensive applications faster with lower overall costs.”

HPC News Bytes for Friday, June 26

While we’re always on the lookout for HPC news, not everything makes it to the front page. Notable items from this week include new benchmarks for 100GB Ethernet, the Open MPI roadmap, and Docker containers.

HPC News Bytes for June 19, 2015

While we’re always on the lookout for HPC news, not everything makes it to the front page. Notable items from this week include big boosts for Apache Spark, Containerization, and Lustre.

HPC News Bytes for June 11, 2015

While we’re always on the lookout for HPC news, not everything makes it to the front page. Global HPC news items from this week include updates from Cray, Dell, DSRC, Oak Ridge, and Sentient Technologies.

Video: Introduction to Docker

In this video, Docker Founder and CTO Soloman Hykes explains what Docker is and why developers like it. “Docker is an open-source engine that automates the deployment of any application as a lightweight, portable, self-sufficient container that will run virtually anywhere.”

Video: Docker, Monitoring, and SLURM Dashboards

“Based on a containerized HPC environment this talk shows of a state-of-the-art stack including performance monitoring, log event handling and GraphDB based inventory to provide insights into what is going on within a SLURM cluster. The framework used is QNIBTerminal incorporating the ELK stack, a graphite backend and neo4j as a GraphDB.”

Hyped Technologies that Won’t Shine in 2015

“100% Flash in the Datacenter? It won’t happen any time soon. Many (most?) tier one workloads will be moved to flash of course, but data is adding up so quickly that it’s highly unlikely you will be seeing a 100% datacenter any time soon. It will take a few years to have about 10/20% of data stored on flash and the rest will remain on huge hard disks (cheap 10+TB hard disks will soon be broadly available for example).”

Will Containerization Eat Configuration Management?

Over at QNIB, Christian Kniep writes that his latest presentation examines intersection of Docker, Containerization, and Configuration Management. “In my humble opinion, Configuration Management might become a niche. As hard as it sounds.”

Data and Goliath: Why Startups Own the Future of Big Data

So, if I had to put this talk in a nutshell, Yes, I am very bullish on how Docker (containers) and virtualization are going to change the face of HPC. If you want to understand why, check out what my friends Christian Kniep and Josh Simons have been up to on those fronts.

Slidecast: QNIBTerminal Plus InfiniBand – Containerized MPI Workloads

In this slidecast, Christian Kniep presents: QNIBTerminal Plus InfiniBand – Containerized MPI Workloads. “QNIB Solutions (early on called ‘QNIB Inc’) derives from the first project Christian did during his B.Sc. report, a InfiniBand monitoring suite. For the sake of the report is was named ‘OpenIBPM: Open Source InfiniBand Performance Monitoring’. Afterwards Christian renamed it to match his last name (Kniep): ‘QNIB: Qualified Networking with InfiniBand’. Since then QNIB becomes a pet project’s theme.”