Esther Baldwin is an AI Solutions Architect at Intel.
In this Conversations in the Cloud podcast, Esther Baldwin from Intel describes how the convergence of HPC and AI is driving innovation.
On the topic of HPC & AI converged clusters, there’s a perception that if you want to do AI, you must stand up a separate cluster, which Esther notes is not true. Existing HPC customers can do AI on their existing infrastructure with solutions like HPC & AI converged clusters. However, running three workloads – HPC, AI, analytics – together can be tough, with the main problem being that they all have their own software stack and libraries that are optimized for specific applications. With a shared infrastructure, it can be challenging to run these all at the same time. The queuing system creates difficulties and even the underlying file system is incompatible.
This is where the Intel Select Solutions for AI & HPC come in. Intel Select Solutions help people leverage experience with a pre-configured path to get a faster time to value. Intel Select Solutions for HPC & AI Clusters offers users a quick start for those in the HPC environment wanting to run AI workloads. There are two options for Intel Select Solutions for HPC & AI Clusters – an open source version with Magpie and Slurm and a commercially available version with Univa Grid Engine.
Intel offers a family of Intel Select Solutions for HPC and AI. Building on the foundation of Intel Select Solutions for Simulation & Modeling, customers can also utilize solutions for simulation & visualization and genomics analytics, in addition to AI solutions like BigDL on Apache Spark and AI Inferencing.
Esther notes that the HPC & AI convergence is already a trend, with AI becoming part of a wide variety of workloads. This solution will enable new HPC and AI use cases, in addition to seeing lower total cost of operations, better cluster management, and stronger workload performance.
Explore the Intel Select Solutions for Simulation & Modeling, and other performance optimized configurations at www.intel.com/selectsolutions.
Sign up for our insideHPC Newsletter
