Qualcomm to bring power-efficient AI Inference to the Cloud

Print Friendly, PDF & Email

Today Qualcomm announced that it is bringing the Company’s artificial intelligence expertise to the cloud with the Qualcomm Cloud AI 100. Built from the ground up to meet the explosive demand for AI inference processing in the cloud, the Qualcomm Cloud AI 100 utilizes the Company’s heritage in advanced signal processing and power efficiency. With this introduction, Qualcomm Technologies facilitates distributed intelligence from the cloud to the client edge and all points in between.

Today, Qualcomm Snapdragon mobile platforms bring leading AI acceleration to over a billion client devices. Our all new Qualcomm Cloud AI 100 accelerator will significantly raise the bar for the AI inference processing relative to any combination of CPUs, GPUs, and/or FPGAs used in today’s data centers,” said Keith Kressin, senior vice president, product management, Qualcomm Technologies, Inc. “Furthermore, Qualcomm Technologies is now well positioned to support complete cloud-to-edge AI solutions all connected with high-speed and low-latency 5G connectivity.”

In addition, Qualcomm Technologies is supporting developers with a full stack of tools and frameworks for each of our cloud-to-edge AI solutions. Facilitating the development of the ecosystem in this distributed AI model will help enhance a myriad of potential experiences for the end-user, including personal assistants for natural language processing and translations, advanced image search, and personalized content and recommendations.

Slides from Qualcomm AI Day 2019


The Qualcomm Cloud AI 100 offers:

  • More than 10x performance per watt over the industry’s most advanced AI inference solutions deployed today
  • An all new, highly efficient chip specifically designed for processing AI inference workloads
  • 7nm process node bringing further performance and power advantages
  • Available support for industry leading software stacks, including PyTorch, Glow, TensorFlow, Keras, and ONNX

Microsoft’s vision of cloud-to-edge AI emphasizes the benefits of distributed intelligence,” said Venky Veeraraghavan, partner group program manager, Microsoft Azure. “Collaboration continues between Qualcomm Technologies and Microsoft in many areas.”

The Qualcomm Cloud AI 100 is expected to begin sampling to customers in 2H 2019.

Sign up for our insideHPC Newsletter