GPT-6 Astra was 'stealth nerfed,' Reddit says — the proof is thinner than the outrage

Reddit is convinced OpenAI quietly turned GPT-6 Astra down. A post on r/singularity, titled "After Astra's stealth nerf last night, we really need benchmarks to do a re-bench 1 week after any model release. This is ridiculous.", drew roughly 700 points and more than 150 comments within a day of its September 10 posting. No controlled test backs the accusation — no vendor changelog, no statement from OpenAI, no evaluation re-run on the same prompts.

The evidence is one demo and a stack of anecdotes

"2 days ago Astra was 1 shotting AAA game level models and now today even after reprompting on xhigh effort several times the results are completely terrible," the poster wrote, adding that "hundreds of users on X have noticed the same." The post they cite is real and popular — @wholyv, published September 10, around 12,000 likes — but it offers a side-by-side of 3D gun models Astra generated at launch versus later, from one prompt chosen by the person making the claim. That is a demo, not a benchmark.

Other commenters describe something more technical. One reported that "last night for the first time since the days of GPT-4, Astra spit out broken tokens for me over several responses. Repetitions, broken punctuation in the middle of words, wrong but semi close tokens," and guessed at botched quantization. It is not reproducible outside the reporter's own session, and it does not separate a model change from a serving problem.

The boring explanation is equally unfalsified

A prominent pushback in the thread is that the ritual predates Astra: "Every time a model is released people make this claim. Their only proof is 'vibes' and anecdotal evidence (hundreds of people on X is not evidence)." The comment argues people are most impressed on day one, then learn a model's weak spots and misremember that growing familiarity as decline.

Both stories fit the facts, which is the problem. Decode-time variance, reasoning-effort settings, context length and server load all move perceived quality without weights changing, and Astra shipped only on September 3 — our launch coverage is nine days old. That timing does not make a silent downgrade impossible; it means the drift people feel and the drift they can measure currently live in different places. The ARC-AGI-3 harness-gap analysis already showed how much surrounding configuration shapes Astra's measured output.

What would settle it

A frozen prompt set, re-run against the same endpoint at the same reasoning effort and published with raw outputs — the experiment nobody has run. Failing that, a changelog recording capability or quantization changes, or a third-party index re-benchmarked a week after release, would turn "it feels worse" into a number. The constructive half of the demand is easy to grant regardless of whether Astra was nerfed: post-launch re-benchmarks should be routine, not a protest slogan.