Interpretability

Does a weight edit teach Qwen3.5-0.8B math, or stop it looping?

A team at MIT CSAIL gave an AI agent a hard job. Make Qwen3.5-0.8B better at math, with no training and no gradient descent. The agent had a Python session over the weights and 50 forward passes on practice problems.

It changed 131,072 weights in two layers, 0.016% of the model. With thinking on, the model’s MATH-500 score rose from 7.9% to 48.1%. The write-up calls this weight-space programming.

Watching an agent do this is thrilling. The authors say plainly that it traced the model’s thinking loops. Much of the excitement online read it as an agent teaching a model math. Those are different claims, so we tested the difference.