Cerebras

How we deploy trillion-parameter frontier models on Cerebras

Sarah Chieng explains how Cerebras splits a frontier model too large for one 44 GB WSE-3T wafer across many wafers, using the ~3T-parameter open model Kimi K3 as the example: fitting weights and request state in on-chip memory, mapping layers across chips as a pipeline, and serving many concurrent requests at 1000-2000+ tokens per second.

Blog post · AI Inference · AI Hardware · Large Language Models · Distributed Systems