SUNNYVALE, Calif. & RIYADH, Saudi Arabia – Cerebras Systems today announced the signing of a memorandum of understanding with Aramco under which they aim to bring high performance AI inference to industries, universities, and enterprises in Saudi Arabia. Aramco plans to build, train and deploy large language models using Cerebras’ CS-3 systems. Aramco’s new high-performance […]
Cerebras Claims Fastest AI Inference
August 27, 2024 by
AI compute company Cerebras Systems today announced what it said is the fastest AI inference solution. Cerebras Inference delivers 1,800 tokens per second for Llama3.1 8B and 450 tokens per second for Llama3.1 70B, according to the company, making it 20 times faster than GPU-based solutions in hyperscale clouds.
