Dec. 4, 2024 — MLCommons today released AILuminate, a safety test for large language models. The v1.0 benchmark – which provides a series of safety grades for the most widely-used LLMs – is the first AI safety benchmark designed collaboratively by AI researchers and industry experts, according to MLCommons. It builds on MLCommons’ track record […]
Updated MLPerf AI Inference Benchmark Results Released
Today, MLCommons announced new results from its MLPerf Inference v4.0 benchmark suite with machine learning (ML) system performance benchmarking. To view the results for MLPerf Inference v4.0 visit the Datacenter and Edge results pages. The MLPerf Inference….
MLPerf Training and HPC Benchmark Show 49X Performance Gains in 5 Years
MLCommons said the results highlight performance gains of up to 2.8X compared to 5 months ago and 49X over the first results five years ago, “reflecting the tremendous rate of innovation in systems for machine learning,” the organizations said.
MLCommons: Latest MLPerf AI Benchmark Results Show Machine Learning Inference Advances
SAN FRANCISCO – September 8, 2022 – Today, the open engineering consortium MLCommons announced results from MLPerf Inference v2.1, which analyzes the performance of inference — the application of a trained machine learning model to new data. Inference allows for the intelligent enhancement of a vast array of applications and systems. Here are the results and […]
MLCommons Releases MLPerf Training v1.1 AI Benchmarks
San Francisco — Dec. 1, 2021 – Today, MLCommons, the open engineering consortium, released new results for MLPerf Training v1.1, the organization’s machine learning training performance benchmark suite. MLPerf Training measures the time it takes to train machine learning models to a standard quality target in a variety of tasks including image classification, object detection, […]
MLCommons Launches MLPerf Tiny AI Inference Benchmark
Today, open engineering consortium MLCommons released a new benchmark, MLPerf Tiny Inference to measure trained neural network AI inference performance for low-power devices in small form factors. MLPerf Tiny v0.5 is MLCommons’s first inference benchmark suite for embedded device machine learning, a growing field in which AI-driven sensor data analytics is performed in real-time, close […]
Nvidia Romps in Latest MLPerf AI Benchmark Results
What has become Nvidia’s regular romp through MLPerf AI benchmarks continued with today’s release of the latest performance measurements across a range of inference workloads, including computer vision, medical imaging, recommender systems, speech recognition and natural language processing. The latest benchmark round received submissions from 17 organizations and includes 1,994 performance and 862 power efficiency […]
Nvidia Dominates MLPerf AI Benchmark Competition Again
Nvidia said it has extended its lead on the MLPerf Benchmark for AI inference with the company’s A100 GPU chip introduced earlier this year. Nvidia won each of the six application tests for data center and edge computing systems in the second version of MLPerf Inference. These tests are an expansion beyond the initial two […]
Inspur NF5488A5 Breaks AI Server Performance Record in Latest MLPerf Benchmarks
San Jose, Aug. 5 – In the results released last week of MLPerf AI benchmark, Inspur NF5488A5 server set a new AI performance record in the Resnet50 training task, topping the list for single server performance. MLPerf (results here) is the most influential industry benchmarking organization in the field of AI around the world. Established […]