IBM Granite 4.2: Open Reasoning Models With Agentic Ambitions
IBM's Granite 4.2 brings native chain-of-thought reasoning and agentic RL to open 3B, 8B, and 30B models under Apache 2.0 — but benchmarks are self-reported.
Vlad Makarovreviewed and published
On August 25, IBM released Granite 4.2, its first family of open-weight models built around explicit reasoning: dense transformers in 3B, 8B, and 30B parameter sizes, led by the flagship granite-4.2-30b on Hugging Face. Every model can deliberate inside <think>...</think> tags before answering, and the two larger sizes were trained with reinforcement learning to edit code, drive terminals, and search the web inside live sandboxes. All three ship under Apache 2.0. The reasoning is genuine in the narrow sense that the models emit chains of thought — but every claim that matters is, as usual, self-reported.
What Happened
Granite 4.2 is "the reasoning-focused release of the Granite language-model family," in IBM's own words — a departure from earlier Granite generations, which were strong instruction-following assistants without an explicit thinking phase. IBM says the family was pre-trained from scratch on roughly 15 trillion tokens across a five-phase schedule, ending in a long-context phase that extends the window to 512K tokens. The 8B and 30B models then ran a multi-stage reinforcement learning curriculum: verifiable-reward RL, targeted skill boosters, three agentic stages (software engineering, terminal operation, web search) inside real sandboxed environments, and a final RLHF pass with a reasoning-length penalty. The 3B model skips the agentic block entirely. Training ran on NVIDIA GB200 NVL72 hardware hosted by CoreWeave, using NeMo-RL and NeMo-Gym.
IBM also shipped FP8, NVFP4, MXFP4, and GGUF quantizations alongside the bf16 checkpoints, plus two 470M-parameter Granite Speech 5.0 Turbo CTC models. The release trended on r/LocalLLaMA within a day (372 upvotes, 88 comments at the time of writing), though Hugging Face download counts — in the low thousands for the flagship — suggest community momentum is still catching up with the announcement. One telling detail: IBM's own Granite documentation site now carries a banner saying it is no longer being updated, pointing readers to Hugging Face and GitHub instead.
The Model
The architecture is conventional — a dense decoder-only transformer with grouped-query attention, SwiGLU feed-forward layers, and RoPE embeddings — which is not a criticism. The interesting parts are the switches IBM exposes around it. Each model supports three thinking modes (full chain-of-thought, a low-effort mode that spends a short reasoning budget on easy questions, and non-thinking), toggled through chat-template parameters rather than separate checkpoints. Tool calling is native and emitted in OpenAI function-call format, and IBM ships a custom reasoning parser for vLLM 0.20+.
- 30B dense: 64 layers, 32 attention heads, 8 KV heads, 32,768 MLP hidden size
- 128K native context; long-context extension to 512K on the 30B
- SFT on ~7.2M samples (~100B tokens), 31.6% of it agentic trajectories
- Agentic RL for 8B/30B only: SWE, terminal, and search stages; 3B gets foundational RL only
- Built on granite-4.1-30b-base per the HF model tree — even though the technical blog says the family was pre-trained from scratch, a minor metadata wrinkle that does not ease independent verification
Benchmarks
All figures below come from IBM's technical blog, which is to say they are unaudited vendor numbers awaiting third-party confirmation:
| Benchmark | 8B | 30B |
|---|---|---|
| SWE-Bench Verified | 47.67 | 57.00 |
| SWE-Bench Pro | 19.11 | 33.29 |
| Terminal-Bench 2.1 | 20.56 | 29.24 |
| AIME 2025 | 86.67 | 89.17 |
| GPQA | 64.14 | 66.41 |
| MMLU-Pro | 74.04 | 77.60 |
| RULER 128K | 71.41 | 81.38 |
The reasoning scores are respectable for the size class: an AIME 2025 mark of 89.17 puts the 30B within striking distance of much larger open models, and RULER 128K at 81.38 suggests the long-context training held up. The agentic numbers are more sobering. A SWE-Bench Verified score of 57.00 and 33.29 on the harder Pro split will not scare the frontier coding agents, and Terminal-Bench 2.1 at 29.24 shows how far tool-use reliability still has to go. Reasoning also has a price: in thinking mode the 30B can burn up to 8,192 tokens on deliberation before answering, which is exactly the latency-compute trade-off that made low-effort and non-thinking modes necessary in the first place.
Why It Matters
IBM's pitch has never been frontier performance. As Ars Technica noted, the Granite family "rarely grabs headlines" — its selling point is predictable, self-hosted deployments for enterprises. Apache 2.0 with cryptographic signatures, ISO certification, and transparency disclosures is a genuine differentiator in a market where "open" increasingly means a license that cannot be inspected. But note what is not released: the 15T-token corpus, the SFT mixtures, and the synthetic RL environments that produced the agentic behavior. The weights are open; the recipe is a blog post. It is also worth remembering that chain-of-thought is not understanding — it is a token-level mechanism that improves some tasks while adding latency and compute, a fact IBM implicitly concedes by shipping a mode that turns it off.
What's Next
The near-term test is independent evaluation. GGUF quantizations are already available for llama.cpp and Ollama users, the model serves through vLLM and SGLang, and the first third-party benchmark runs will settle whether the self-reported numbers hold. The larger question is whether enterprises actually swap hosted frontier APIs for a self-hosted 30B reasoning model — and whether IBM's consolidation of documentation on Hugging Face and GitHub signals a genuine open-first strategy or just a cheaper distribution channel. Granite 4.2 is a credible open option. Credible and compelling are different words.
