All News
researchmathematicsai-safetyhackernews

AI math is producing ideas faster than humans can absorb them. One essay wants a much bigger profession.

A UCLA professor's guest essay on Terence Tao's blog argues AI math breakthroughs need far more human mathematicians — and admits AI helped draft the argument.

Vlad MakarovVlad Makarovreviewed and published
6 min read
AI math is producing ideas faster than humans can absorb them. One essay wants a much bigger profession.

An argument about human understanding went up last week on the blog of the world's best-known mathematician, and it was drafted with the help of an AI. Amit Sahai, a computer-science professor at UCLA, published his guest essay We're gonna need a lot more mathematicians on Terence Tao's "What's new" on September 24. The thesis is a labor argument rather than a capability argument: AI systems will produce mathematical breakthroughs, and the binding constraint becomes the supply of humans who can understand them.

What the essay actually argues

Where most commentary about AI and mathematics fights over what models can prove, Sahai takes the capability as given. "The AI systems I have worked with are already producing beautiful new ideas," he writes, and places them well beyond fast calculation or arguments a strong human researcher would already follow. The consequence he dwells on is professional and emotional rather than technical: "we are now entering a time for humility: a time when all of us are going to know what it feels like to be unable to keep up."

He opens with the memory of undergraduates who abandoned research mathematics because they could not match the pace of their fastest peers, and asks whether his own field will now make that choice at scale. His answer is a refusal. "For our community to give up the work of understanding would be a profound abdication of our responsibility to humanity," he writes. That framing matters, because it makes the essay rise or fall on an assumption about human attention rather than on any claim about what a model can do.

The proposal is a standing reserve

The concrete proposal is what he calls a "deployable intellectual reserve": "communities of mathematically sophisticated people that humanity can call upon to help understand consequential AI-enabled breakthroughs." In practice that means research groups with sustained support spending a term or a year working through a body of AI-generated ideas, a program Sahai calls possibly among the most important mathematical work of the coming years. He is explicit that this is a call for a significant expansion in the number of mathematically sophisticated human researchers worldwide, framed as a public investment rather than a departmental wish. The essay is vaguer on the mechanism. It does not say who would fund such a reserve, how its members would be chosen, or what would count as having understood a result well enough to certify anything. Sustained support for a year of reading is, in his telling, the unit of work — a shape closer to a national laboratory or a sabbatical program than to a three-year grant cycle, and one that no existing funder obviously owns.

The fusion plant

The essay's most quotable passage is a scenario, not an equation. Imagine a future AI, Sahai writes, proposing a radically new design for a one-terawatt nuclear fusion plant, built on principles "that no human had conceived of," with robots ready to manufacture it. A terawatt is an enormous flow of energy, and the very novelty that makes the design thrilling is what removes any inherited confidence from decades of operating similar machines. Approving it, he argues, would require communities who understand why the design works and what justifies confidence in its safety. That is where his most careful claim sits: "a theorem can only exist within a model," so understanding a guarantee means understanding the model, the experimental evidence for it, and the uncertainties about its accuracy.

Where the argument is tested

Sahai does not pretend that adding people to a decision improves it. He links a 2024 meta-analysis in Nature Human Behaviour of 106 experiments, which found that human-AI combinations on average performed worse than the best of humans or AI alone, and concedes he sees no reason to insist people manually repeat work a machine may do more reliably. He also states the strongest case against himself — that AI could make each person so much more effective that fewer are needed — and rebuts it with biology: depth of understanding takes time and a pace of life humans can sustain.

That concession is worth taking seriously, because it removes the easy version of the argument — that a human somewhere in the loop is inherently safer — and leaves only the harder one about comprehension. Whether the biological ceiling he invokes really binds is the load-bearing assumption in the essay, and it is asserted rather than demonstrated. If cognition scales with tooling the way it did with writing or computation, the arithmetic could run the other way.

Authority, not comprehension

The thread under the post did not settle that question. One commenter, writing as // Urb_RS, pressed a different objection: even if independent experts understand the design and agree on the numbers, that says nothing about who may authorize a decision whose residual risk lands on a town that does not accept it. Sahai's own second footnote anticipates the worry from another direction, insisting that "the relevant understanding cannot belong only to the organization proposing the technology." The two positions are not contradictory so much as adjacent, and together they mark the essay's boundary. It answers a question about comprehension; a democratic objection is a question about authority. Independent expertise, in that reading, is a necessary condition for legitimate scrutiny rather than a sufficient one: it tells you what the risks are, not who may accept them on someone else's behalf.

The argument about humans, drafted with AI

There is a detail readers noticed before they noticed the argument. The page carries an editor's note from Tao: "This blog post was initially written in a different file format and converted using AI." Sahai's closing note says the ideas are "entirely my own, but GPT 6 Astra was instrumental in helping me draft this note," and thanks his student Isaac Hair, his former student Dakshita Khurana, Tao, and his family members Anant Sahai and Gireeja Ranade. On Hacker News, the submission drew roughly 365 points and more than 460 comments within about two days. One commenter dismissed the piece as AI-assisted "slop" on that basis alone. Others argued the substance anyway, and at least one conflated the guest post with Tao himself — a small illustration of the essay's own concern about who can follow an argument closely enough to attribute it.

What this means

The practical reading is narrower than the manifesto. If models keep producing results that only a handful of people can check, the constraint on using them is not compute but a trained workforce, and almost no institution currently budgets for comprehension as a line item. September's AI-mathematics news has mostly been about production: Epoch AI's benchmark runs count what models solved, and OpenAI's new math advisory group will advise on how to release results rather than on the pace of discovery. Sahai's question sits one layer behind all of it: who, outside the lab that built the system, would be equipped to disagree?

The essay does not resolve its own hardest problem. Sahai writes that he does not want humanity to arrive at a future of unexplained consequential decisions "simply because we failed to invest in our own capacity to understand," and asks for a much larger profession to prevent it. What would move that from aspiration to institution is left open: a funder willing to pay for comprehension as a public good, and some way to tell whether the reserve, once built, actually understood anything.

Related Articles

Scroll down

to load the next article