Goodfire's 'Neural Networks Are Already Clean' Essay Has Interpretability Researchers Arguing

On October 15, Nick Cammarata, a researcher at the interpretability lab Goodfire, published a 65-minute essay titled Neural Networks Are Already Clean. His argument is that the field's central obstacle was never the size or the opacity of modern models. It was the tools aimed at them. Within hours the piece was on the front page of Hacker News and the front page of LessWrong, and researchers were arguing about what, exactly, had been demonstrated. Two days later, no one outside Goodfire had reproduced any of it.

The claim, and who is making it

Cammarata is not a newcomer arguing from outside the field. He co-authored Zoom In with Chris Olah in 2020, the Distill paper that introduced the first circuit presented as evidence of superposition, and he started OpenAI's automated interpretability project in 2023, which judged roughly 1.7 percent of neurons legible even by its most generous measure.

The essay now says both of those readings were wrong. The famous cat-and-car neuron is really a V-shape detector, activated by pointed forms and pushed negative by round ones. The circuit where a car appeared to hide among dog neurons is ordinary generalization, sorted by which way the subject faces the camera. What remains of the apparent mess is a motif he calls recursive generalization: a neuron that detected the letters "iy" grew to detect "diy," then "do it yourself," which contains no "iy" at all. On Qwen3-32B, a preliminary audit puts roughly 90 percent of neuron poles at one main job, about 7 percent at two related jobs, and 2 to 4 percent at not yet understood.

The artifact is a blog post, and it labels itself as one

The essay carries a standing header reading "A working hypothesis." One of its own confidence tiers states plainly: "Highly speculative: this might be most of what we need, and interpretability might be far more tractable, possibly in the near term, than we've assumed." There is no peer review, no held-out benchmark, and no external replication. The technical companion paper, Cammarata says on X, is still weeks away.

The 90 percent figure arrives with a footnote explaining that the share moves depending on where you set the threshold for weak activations, how deep in the network you look, and what you decide counts as one thing. It also moves across models: the essay reports about 70 percent of neurons looking like roughly one thing in the much older, much smaller GPT-2 XL. That is a threshold-sensitive estimate from one model, not a measurement of interpretability in general.

The company selling the tools is the company making the argument

Goodfire sells interpretability, and much of its pitch rests on agents that inspect models on a customer's behalf. The company has made expansive claims before that arrived without an artifact behind them: in September it co-signed a safety standard for open-weight models that shipped with no published specification, a gap we covered at the time. A thesis holding that the models were always legible and that the previous tools, not the networks, were the failure is precisely the thesis that suits a vendor of newer tools. That is not evidence against it. The newer pipeline may simply work. But it means the claim needs outside hands more than most research posts do.

Some of it is checkable in principle. Qwen3-32B is open-weight, so the neuron-level claims can be re-derived by anyone willing to run the same agentic analysis, and the rereading of Zoom In is an argument about public images and a public architecture. Other parts are not checkable yet at all: results on models up to trillions of parameters such as Kimi K3 sit in the unreleased companion paper, and the forecast that ambitious interpretability will be solved by the time it is needed most is a prediction about future automated science. The parts that matter most for alignment are the parts with no artifact attached.

The headline outran the essay within hours

By that afternoon the circulating summary was flatter than the source. The commentator known as Deedy told a large audience this was one of the most important results in AI, period, and that 90 percent of neurons in Qwen-32B have one job. The number does appear in the essay, but as an estimate on one model, hedged twice. What fell out in transit were the words roughly and poles, along with the footnote that qualified both. r/singularity compressed it further into a headline reading that interpretability might already have been solved by an OpenAI alum.

The essay claims nothing of the kind, and neither does its author, whose public framing confines itself to thinking the outlook may be far better than he feared. An audience signalling appetite is not the same as evidence, and the distance between a hedged estimate and a solved problem was crossed mostly by other people.

Where the objections actually land

The pushback is not one argument. It is several arguments aimed at different joints in the claim, and only the first of them is about whether the essay is right.

Neel Nanda, who leads interpretability at Google DeepMind, attacks the definition rather than the finding, writing that the essay defines monosemantic too loosely and that he would call a fair few of the examples polysemantic. He holds that superposition is still real for the facts a language model stores, that weak activations in large models go largely unaddressed, and that he doubts results from small vision models transfer to language models.

Leo Gao attacks the test, arguing that an explanation that cannot simulate a neuron's activations has not been demonstrated at all. Commenters on the Hacker News thread attacked the inference from describing to explaining, noting that much of mech interp amounts to dressed-up probing, and asking who audits the agentic tools that produced most of the readings. On the LessWrong linkpost, Alex Gibson's objection is about framing rather than method: the X post carried none of the essay's speculation labels, and readers who only saw the post had no way to weigh them. Julian Bradshaw, who read the essay closely and liked it, offered the most deflating account of its spread, observing that the audience had grown hungry for good news about AI.

What would settle it

Three things, none of them exotic. Replication on other model families and architectures by teams with no product to sell, with the definition of one job fixed before the analysis rather than chosen after it. A published method rather than further agentic analysis, so the pipeline itself can be audited for a bias toward legibility. And the companion paper, detailed enough that an outsider can re-run it. Interpretability has shipped results with a method attached before, including Anthropic's map of 171 emotion vectors inside Claude and the evidence that they shape behaviour (that piece). The standard is not unreachable.

As of October 17, two days after publication, none of that existed. Cammarata may be right, and even his sharpest critics concede that studying a network's own neurons is a cheap and promising direction. But the headline that travelled was not a finding. It was a hypothesis with a strong author, a company that benefits from it, and an audience that wanted to hear it.