Neurons as an Interpretable Basis

Curt Tigges, Matthew Kowal, Thomas McGrath, Owen Lewis, Nick Cammarata · Goodfire · November 10, 2026

Abstract

A companion to Neural Networks Are Already Clean

An intuitive way to interpret a neural network is to study its neurons; that is, the hidden units of its MLP layers. However, they have long appeared too complex and polysemantic for direct study. This view has led much of the field to focus on learned feature spaces over sets of neurons, which makes interpretability more challenging: we first need to transform the model before normal science can begin.

Building on a growing body of literature, our work suggests that neurons are more interpretable than previously assumed. We study the neurons of Qwen3.6-35B-A3B using sparsification methods, attribution tools, and research agents, and find three properties that make neurons interpretable units of computation: