Rishabh Gupta · 2026-10-28

small models are enough for agents

an agent sends every call to one big model, or sends the boring calls to small models and only the hard ones to a big model

i read a paper recently that says something i already half believed: agents don't need giant language models. small language models are the future of agentic ai argues that small models are good enough for most of what an agent actually does, and a lot cheaper to run.

i'm on the small model side of this, and i'm not neutral about it. i've been training tiny models from scratch on a macbook air, so i got to test a tiny slice of the idea myself. this post is the paper, what i saw, and where i think it gets harder than it sounds.