Sign up for our newsletter and get the latest big data news and analysis.

Outlook on Hot Technologies

Shahin Khan from OrionX gave this talk at the Stanford HPC Conference. “We will review OrionX’s predictions for 2018, the technologies that are changing the world (Iot, Blockchain, Quantum Computing, AI …) and how HPC will be the engine that drives it.”

Living Heart Project: Using HPC in the Cloud to Save Lives

Burak Yenier and Francisco Sahli gave this talk at the Stanford HPC Conference. “Cardiac arrhythmia can be a potentially lethal side effect of medications. Before a new drug reaches the market, pharmaceutical companies need to check for the risk of inducing arrhythmias. Currently, this process takes years and involves costly animal and human studies. In this project, the Living Matter Laboratory of Stanford University developed a new software tool enabling drug developers to quickly assess the viability of a new compound. During this session we will look at how High Performance Computing in the Cloud is being used to prevent severe side effects and save lives.”

SpaRC: Scalable Sequence Clustering using Apache Spark

Zhong Wang from the Genome Institute at LBNL gave this talk at the Stanford HPC Conference. “Whole genome shotgun based next generation transcriptomics and metagenomics studies often generate 100 to 1000 gigabytes (GB) sequence data derived from tens of thousands of different genes or microbial species. Here we describe an Apache Spark-based scalable sequence clustering application, SparkReadClust (SpaRC) that partitions reads based on their molecule of origin to enable downstream assembly optimization.”

Video: HPC Computing Trends

Chris Willard from Intersect360 Research gave this talk at the Stanford HPC Conference. “Intersect360 Research returns with an annual deep dive into the trends, technologies and usage models that will be propelling the HPC community through 2018 and beyond. Emerging areas of focus and opportunities to expand will be explored along with insightful observations needed to support measurably positive decision making within your operations.”

State of Linux Containers

Christian Kniep from Docker Inc. gave this talk at the Stanford HPC Conference. “This talk will recap the history of and what constitutes Linux Containers, before laying out how the technology is employed by various engines and what problems these engines have to solve. Afterward, Christian will elaborate on why the advent of standards for images and runtimes moved the discussion from building and distributing containers to orchestrating containerized applications at scale.”

Highest Peformance and Scalability for HPC and AI

Scot Schultz from Mellanox gave this talk at the Stanford HPC Conference. “Today, many agree that the next wave of disruptive technology blurring the lines between the digital, physical and even the biological, will be the fourth industrial revolution of AI. The fusion of state-of-the-art computational capabilities, extensive automation and extreme connectivity is already affecting nearly every aspect of society, driving global economics and extending into every aspect of our daily life.”

Designing HPC, Deep Learning, and Cloud Middleware for Exascale Systems

DK Panda from Ohio State University gave this talk at the Stanford HPC Conference. “This talk will focus on challenges in designing HPC, Deep Learning, and HPC Cloud middleware for Exascale systems with millions of processors and accelerators. For the HPC domain, we will discuss the challenges in designing runtime environments for MPI+X (PGAS-OpenSHMEM/UPC/CAF/UPC++, OpenMP and Cuda) programming models by taking into account support for multi-core systems (KNL and OpenPower), high networks, GPGPUs (including GPUDirect RDMA) and energy awareness.”

WekaIO: Making Machine Learning Compute-Bound Again

We are going to present WekaIO, the lowest latency, highest throughput file system solution that scales to 100s of PB in a single namespace supporting the most challenging deep learning projects that run today. We will present real life benchmarks comparing WekaIO performance to a local SSD file system, showing that we are the only coherent shared storage that is even faster than the current caching solutions, while allowing customers to linearly scale performance by adding more GPU servers.”

Video: The Sierra Supercomputer – Science and Technology on a Mission

Adam Bertsch from LLNL gave this talk at the Stanford HPC Conference. “Our next flagship HPC system at LLNL will be called Sierra. A collaboration between multiple government and industry partners, Sierra and its sister system Summit at ORNL, will pave the way towards Exascale computing architectures and predictive capability.”

Stanford HPC Conference Posts Preliminary Agenda

The Stanford HPC Conference has posted it Preliminary Agenda. The two-day event takes place Feb. 20-21 at Stanford University in California. “Join the Stanford High Performance Computing Center, HPC Advisory Council, its members and experts from all over the world for two days of invited and contributed talks and immersive tutorials on topics of great societal impact and responsibility! February’s open forum brings industry luminaries and leading subject matter experts together to examine emerging and major domains and share in-depth insights on AI, Data Sciences, HPC, Machine Learning and more.”