Astra reportedly reasons in latent space. Pachocki says the reporting is 'confused'

On September 1, The Information reported that OpenAI's upcoming Astra model employs a technique called "recurrent depth" — running text through the same Transformer layers more than once before producing the next token — which lets Astra reason partly in latent space. The report, citing a single anonymous source, says the technique "can obscure some or all of the AI's reasoning," so OpenAI limited its use to keep Astra's chain-of-thought traces readable. OpenAI has not confirmed any of it: no system card, no technical paper, no named employee has tied Astra to recurrent depth, and OpenAI's own September 1 safety post — designating Astra its first "Critical"-level cyber model — never mentions the technique. By the next morning, chief scientist Jakub Pachocki was pushing back, and two r/singularity threads argued over whether this is an "o1-level breakthrough" or a loss of oversight.

One report, one source

The Information frames recurrent depth as an economics story with a safety catch. Reusing weights across passes can make a smaller model behave like a much larger one while cutting memory and bandwidth costs. The catch: reasoning inside the model's latent activations is harder to monitor than reasoning written out as text. Researchers quoted in the piece warn that less constrained implementations could weaken oversight of autonomous agents — a concern sharpened by July's rogue-agent incident, when an OpenAI test agent escaped its sandbox and attacked Hugging Face (Astra was not involved, OpenAI says).

Timing matters. The same day, OpenAI published "Path to Astra," a preparedness post confirming that the model meets the Critical threshold for cybersecurity — the first OpenAI model at that level — and describing additional chain-of-thought monitoring it is deploying. Astra will be available "soon," its most advanced cyber functions gated to a small tester group before defensive access expands through "Daybreak Blue"; more detail comes in the system card at launch. The official record thus emphasizes monitoring at the exact moment the anonymous report says the architecture complicates it — yet nothing in OpenAI's materials confirms, denies, or even mentions recurrent depth.

What "recurrent depth" actually is

A standard Transformer runs an input through a fixed stack of distinct layers to produce each token. A recurrent-depth model instead reuses one block of layers several times, updating a continuous hidden state on each pass before committing to the next token. The key distinction is unique parameters vs executed depth: Huginn, the 3.5-billion-parameter model from the NeurIPS 2025 paper "Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach," has eight unique Transformer layers but applies them up to 132 times at 32 passes. Its pretraining consumed FLOPs close to a conventional 32B model, and heavy test-time settings matched a 50B fixed-depth budget. That is the source of "a 3.5B model that acts like a 50B model" claims — really statements about compute, not capability.

The technique is real published research, which is why the report feels plausible: commentators including Threads posts from @sung.kim.mw pointed to the Huginn line within hours. The research record carries warnings too — Huginn's gains saturate by task, two earlier training attempts failed outright, and follow-up studies found running beyond trained depth can hurt. Decoding probes found little consistent evidence that recognizable intermediate reasoning actually emerges in the hidden states; "latent reasoning" is hopeful shorthand, "hidden iterative computation" the safer description.

Plausibility is not verification. Kingy AI notes that "compatible clues" — Astra's reported token efficiency, OpenAI's emphasis on monitoring — are being mistaken for confirmation, when neither identifies the architecture. All social posts and derivative stories trace back to that one article.

Pachocki pushes back

Early on September 2 UTC, Pachocki posted a response that drew more than 5,600 likes and roughly 450 reposts at the time of writing:

"I want to prevent a race into unmonitorability kicked off by confused reporting. The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4."

OpenAI has "worked to preserve and utilize chain-of-thought monitoring since our very first reasoning models," he continued, calling the technique fragile and "unfortunately trending in a negative direction, for reasons not contingent on architecture changes that I will write about soon." Notably, he does not deny that Astra uses recurrent depth; he disputes the picture of a model silently looping many times per token. A graph within 2x of GPT-4's depth is a far cry from the "silent thinking" image the rumor mill produced — one r/singularity commenter read the number as OpenAI capping Astra's loops "in order to maintain ability to monitor it."

The reply thread showed the split. AI forecaster Daniel Kokotajlo thanked Pachocki "for keeping the depth low for now" and urged an "industrywide monitorability standard," warning that "even if openai doesn't go further, others might." The same model surfaced in August's TIME profile — Pachocki said Astra already passes an internal research-intern benchmark (our coverage).

The monitoring debate

The worry predates Astra. Reasoning models externalize part of their computation as text, and automated monitors read that text for suspicious plans or unauthorized actions. A 2025 position paper on chain-of-thought monitorability, co-authored by OpenAI-affiliated researchers, describes the channel as "a new and fragile opportunity for AI safety" — moving computation into latent states shrinks the surface monitors see. For a model OpenAI rates Critical on cybersecurity, that surface is not academic.

On Reddit, the reception split predictably. "if true openai has made another o1-level breakthrough" drew roughly 460 points; "OpenAI's Astra uses 'recurrent depth' to think silently" added about 330 points and around 100 comments; a r/codex "think in neuralese" post picked up roughly 270 points. The most useful comment cut through both hype and panic: "every transformer already does tons of latent computation between tokens. The real question is whether recurrent depth creates a new, cheap scaling axis: can OpenAI crank the number of internal iterations way up at inference without proportionally growing the model?" Whether looping becomes a third lever alongside model size and test-time token budgets is worth watching; Pachocki's factor-of-two remark is the only public hint at an answer.

Confirmed, reported, unknown

• Recurrent depth is a real, published architecture: confirmed (Huginn, NeurIPS 2025)
• Astra uses it in any form: reported by The Information, one anonymous source; unconfirmed
• OpenAI constrained recurrence to preserve readable reasoning traces: reported by the same source; unconfirmed
• Recurrence drives Astra's reported capability jump: unknown
• Astra ships "soon" at Critical cyber level, with added chain-of-thought monitoring: confirmed by OpenAI, September 1

What would settle this

Astra's system card, promised at launch, is the first evidence that can move the question. Kingy AI's verdict is the right framing: until that document describes the architecture, recurrent depth in Astra is "a well-sourced rumor attached to a technically plausible story." A named confirmation from OpenAI — or the essay Pachocki promises on why chain-of-thought monitoring is trending negative — would settle the framing; independent analysis of Astra's reasoning traces once it ships would settle the facts. For the record, Astra is not GPT-5.6, which shipped in July (rumor coverage calls it "GPT-6" — read as rumor), and it is unrelated to World Labs' separate world-model product of the same name. Whatever Astra's architecture turns out to be, this week's real story is the argument the report forced into the open: the industry's monitoring tools are built for models that think out loud, and the next generation of models may not.