Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Intel FPGAs Power Realtime AI in the Azure cloud

At the Microsoft Build conference held this week, Microsoft announced Azure Machine Learning Hardware Accelerated Models powered by Project Brainwave integrated with the Microsoft Azure Machine Learning SDK. In this configuration, customers gain access to industry-leading artificial intelligence inferencing performance for their models using Azure’s large-scale deployments of Intel FPGA (field programmable gate array) technology.

With today’s announcement, customers can now utilize Intel’s FPGA and Intel Xeon technologies to use Microsoft’s stream of AI breakthroughs on both the cloud and the edge,” said Doug Burger, distinguished engineer, Microsoft Corp. “These new capabilities will allow the integration of AI into real-time processes to transform businesses with the power of Microsoft Azure and Microsoft AI.”

This means that data scientists and developers can use deep neural networks (DNN) for a variety of real-time workloads, including those in manufacturing, retail and healthcare, across the world’s largest accelerated cloud. Users can train a model and deploy it on Project Brainwave using the latest Intel FPGAs, either in the cloud or on the edge.

Project Brainwave is a Microsoft project which aims to unleash the future potential of AI using programmable hardware using Intel FPGAs to deliver real-time AI. The FPGA-fueled architecture is economical and power-efficient with a very high throughput that can run ResNet 50, an industry-standard DNN requiring almost 8 billion calculations, without batching.

Using the Azure Machine Learning SDK for Python, customers will be able to specialise image-recognition tasks by retraining ResNet 50-based models with their data. For real-time AI workloads, the compute intensity requires a dedicated hardware accelerator. Intel FPGAs allow Azure to configure the hardware exactly for the task to deliver peak performance.

FPGAs can be further refined or completely repurposed based on the specific requirements of the Azure workload. Azure’s architecture developed with Intel FPGA and Intel Xeon processors enable innovation with accelerated AI on the user’s terms for custom software and hardware configuration. Customers can access the Project Brainwave public preview.

We are an integral technology provider for enabling AI through our deep collaboration with Microsoft. AI has the potential for a wide range of usage scenarios from training to inference, language recognition to image analysis, and Intel has the widest portfolio of hardware, software and tools to enable this full spectrum of workloads,” said Daniel McNamara, corporate vice president and general manager of the Programmable Solutions Group at Intel Corporation.

A limited preview of Project Brainwave is available, enabling users to access Microsoft-designed Intel FPGA-based systems on-premises, acting as an Azure IOT Edge device and connecting into Azure IoT Hub.

This story appears here as part of a cross-publishing agreement with Scientific Computing World.

Sign up for our insideHPC Newsletter

Leave a Comment

*

Resource Links: