Palo Alto, CA – Generative AI company SambaNova announced last week that DeepSeek-R1 671B is running today on SambaNova Cloud at 198 tokens per second (t/s), “achieving speeds and efficiency that no other platform can match,” the company said. DeepSeek-R1 has reduced AI training costs by 10X, but its widespread adoption has been hindered by […]
SambaNova Launches AI Inference Cloud Platform
September 10, 2024 by
PALO ALTO, CA — Sept. 10th, 2024 — AI chips and models company SambaNova Systems announced SambaNova Cloud AI inference service powered by its SN40L AI chip. The company said developers can log on for free via an API today — no waiting list — and create their own generative AI applications using both the […]
HPC News Bytes 20240520: Expanding Exascale Club; Nvidia ‘Paints It Green’ at ISC; Specialty AI Chip News; Student Cluster Competition
May 20, 2024 by
A happy May morning to you! In the aftermath of ISC 2024 in Hamburg, we offer this quick (6:21) run-through of recent news from the world of HPC-AI, including ….
ALCF Announces Online AI Testbed Training Workshops
March 27, 2024 by
The Argonne Leadership Computing Facility has announced a series of training workshops to introduce users to the novel AI accelerators deployed at the ALCF AI Testbed. The four individual workshops will introduce participants to the architecture and software of the SambaNova DataScale SN30, the Cerebras CS-2 system, the Graphcore Bow Pod system, and the GroqRack […]
SambaNova Says It’s First with Trillion-Parameter GenAI Model
February 28, 2024 by
Feb. 28, 2024 — AI technology company SambaNova Systems said today its Samba-1 is the first 1 trillion (1T) parameter generative AI model. “This past fall, we announced the SN40L, the smartest AI chip (rivaling Nvidia), and today we’ve integrated that chip with the first 1T parameter model for the enterprise,” said Rodrigo Liang, co-founder […]
Predictions 2024: HPC-AI, Quantum, Storage and Data Management, Optical Computing, Containers, GenAI — Where It’s All Going
January 19, 2024 by
We offer these predictions across a range of developments, trends and challenges facing the HPC-AI industry in 2024. Some take on the entrepreneurial spirit of business consultant Peter Drucker and his famous call-to-arms: “The best….
Analog Devices Deploys SambaNova for GenAI
January 11, 2024 by
January 10, 2024—Wilmington, MA and Palo Alto, CA — Semiconduct company Analog Devices, Inc. (Nasdaq: ADI) and AI platform developer SambaNova Systems announced that ADI is deploying SambaNova Suite for its global AI strategy, “making AI pervasive enterprise-wide,” ADI said. “ADI is synonymous with innovation, and we have a legacy of technology leadership in bridging […]
SambaNova: New AI Chip Runs 5 Trillion Parameter Models
September 19, 2023 by
Specialty AI chip maker SambaNova Systems today announced the SN40L processor, which the company said will power SambaNova’s full stack large language model (LLM) platform, the SambaNova Suite. Manufactured by TSMC, the SN40L can serve a 5 trillion parameter model, with 256k+ sequence length possible on a single system node, according to the company.
ALCF AI Testbed’s Graphcore System Available to Researchers
April 28, 2023 by
April 28, 2023, Lemont, IL — The Argonne Leadership Computing Facility is accepting proposals to access the facility’s 22-petaFLOPS Graphcore Bow Pod64 at the ALCF AI Testbed. Access is open to the global research community via an approved proposal submission. The newest ALCF AI Testbed platform to be made available to researchers, the Graphcore Bow […]
Proposals Open to Research Community for ALCF AI Testbed’s Cerebras and SambaNova Systems
May 2, 2022 by
Proposals are now being accepted by the Argonne Leadership Computing Facility for access to its AI Testbed, a collection of advanced artificial intelligence accelerators available for science. Researchers interested in using the AI Testbed’s Cerebras CS-2 and SambaNova DataScale systems can submit project proposals via the ALCF’s Director’s Discretionary program. Access to additional testbed resources, including Graphcore, Groq, and Habana accelerators, will be […]
