IBM’s Plan to bring Machine Learning Capabilities to Data Scientists Everywhere

Print Friendly, PDF & Email

Hillary Hunter is an IBM Fellow.

Over at the IBM Blog, IBM Fellow Hillary Hunter writes that the company anticipates that the world’s volume of digital data will exceed 44 zettabytes, an astounding number. As enterprises begin to realize the vast, untapped potential of data, they need to find a way to exploit it. Enter AI.

IBM has worked to build the industry’s most complete data science platform. Integrated with NVIDIA GPUs and software designed specifically for AI and the most data-intensive workloads, IBM has infused AI into offerings that clients can access regardless of their deployment model. Today, we take the next step in that journey in announcing the next evolution of our collaboration with NVIDIA. We plan to leverage their new data science toolkit, RAPIDS, across our portfolio so that our clients can enhance the performance of machine learning and data analytics.

Plans to promote GPU-accelerated machine learning include:

  • IBM POWER9 with PowerAI: to leverage RAPIDS to expand the options available to data scientists with new open source machine learning and analytics libraries. Accelerated workloads have been proven to get a direct benefit from the exclusive engineering that NVIDIA and IBM have done around POWER9, including integration of NVIDIA NVLink and NVIDIA Tesla GPUs. PowerAI is IBM’s software layer, which optimizes how today’s data science and AI workloads run on these heterogeneous computing systems. Our goal is for this improved performance trajectory for GPU-accelerated workloads on POWER9 to continue with RAPIDS.
  • IBM Watson Studio and IBM Watson Machine Learning: to take advantage of the power of NVIDIA GPUs so that data scientists and AI developers can build, deploy, and run faster models than CPU-only deployments in their AI applications in a multicloud environment with IBM Cloud Private for Data and IBM Cloud.
  • IBM Cloud: to users who choose machines equipped with GPUs so they can apply accelerated machine learning and analytics libraries in RAPIDS to their cloud applications and tap into the benefits of machine learning.

IBM and NVIDIA’s close collaboration over the years has helped leading enterprises and organizations around the world tackle some of the world’s largest problems,” said Ian Buck, vice president and general manager of Accelerated Computing at NVIDIA. “Now, with IBM taking advantage of RAPIDS open-source libraries announced today by NVIDIA, GPU accelerated machine learning is coming to data scientists, helping them analyze big data for insights faster than ever possible before. Recognizing the computing power that AI would need, IBM was an early advocate of data-centric systems. This approach led us to deliver the GPU-equipped Summit system, the world’s most powerful supercomputer, and already researchers are seeing tremendous returns. Earlier in the year, we demonstrated the potential for GPUs to accelerate machine learning when we showed how GPU-accelerated machine learning on IBM Power Systems AC922 servers set a new speed record with a 46x improvement over previous results.

Because of IBM’s commitment to bringing accelerated AI to users across the technology spectrum, be they users of on-premises, public cloud, private cloud, or hybrid cloud environments, the company is positioned to bring RAPIDS to users regardless of how they want to access them.

Hillery Hunter is an IBM Fellow and CTO of Infrastructure in the IBM Hybrid Cloud business. Prior to this role, she served as Director of Accelerated Cognitive Infrastructure in IBM Research, leading a team doing cross-stack (hardware through software) optimization of AI workloads, producing productivity breakthroughs of 40x and greater which were transferred into IBM product offerings. Her technical interests have always been interdisciplinary, spanning from silicon technology through system software, and she has served in technical and leadership roles in memory technology, Systems for AI, and other areas. She is a member of the IBM Academy of Technology.

Sign up for our insideHPC Newsletter