HPC News Bytes 20230911: NVIDIA LLM Inferencing; Honeywell and Quantinuum; TSMC in Silicon Photonics; Microsoft Copilot AI Indemnification

As we reflect on the events of 9/11/2001 (it’s still living hell no matter how long ago it happened), let’s quickly (4:52) review last week’s HPC news highlights, including: NVIDIA TensorRT-LLM for faster AI inferencing; Honeywell integrates quantum-hardened encryption keys from Quantinuum; TSMC enters the silicon photonics arena; Microsoft to defend Copilot AI customers; Hyperion Research hosts HPC User Forum

MLCommons: MLPerf Results Show AI Performance Gains

Today ML Commons announced new results from two industry-standard MLPerf benchmark suites: Training v3.0, which measures the performance of training machine learning models, and Tiny v1.1, which measures how quickly a trained neural network can process new data for extremely low-power devices in the smallest form factors. To view the results and to find additional […]

Generative AI: Databricks to Acquire MosaicML for $1.3B

San Francisco-based data and AI startup Databricks today announced a $1.3 billion deal to acquire generative AI platform MosaicML, whose large language models (MPT-7B and MPT-30B) have more than 3.3 million downloads. The goal of the acquisition: reduce the time and cost of large language model training for generative AI, the companies said. Databricks, which […]

Galileo Launches LLM Diagnostics and Explainability Platform

San Francisco — June 20, 2023 — Today, Galileo, a machine-learning (ML) data intelligence company for LLMs and computer vision, announced a suite of tools called Galileo LLM Studio — now available for waitlist signups here. As organizations of all sizes and across industries begin to consider the potential applications of generative AI, it is more important than ever […]

Comet Unveils ‘LLMOps’ Tools and Integrations for Large Language Model Workflow

New York – April 19, 2023 – Comet, maker of a platform for managing models ranging from training runs to production monitoring, today announced a new suite of tools designed to revolutionize the workflow surrounding large language models (LLMs). Comet said the tools “mark the beginning of a new market category, known as LLMOps.” With […]