GPT-5 Medium vs Grok-3: Specs & Benchmark Comparison

GPT-5 Medium is developed by OpenAI, while Grok-3 comes from xAI. Grok-3 was released in February 2025, and GPT-5 Medium followed 6 months later in August 2025.

The two models share 2 published benchmarks. They split them evenly, 1 to 1. The widest gaps are on AIME 2025, where Grok-3 scores 93.3% against 89.0%; GPQA, where GPT-5 Medium scores 88.0% against 85.0%. Averaged across everything we track, GPT-5 Medium sits at 88.5% and Grok-3 at 85.7%.

GPT-5 Medium is the cheaper API at $1.25 per million input tokens and $10 per million output tokens, roughly 2 times cheaper than Grok-3 at $3 and $15. GPT-5 Medium takes the larger context window at 400K tokens, compared with 128K for Grok-3. Both accept text and images as input.

CharacteristicGPT-5 MediumGrok-3
CompanyOpenAIxAI
Release DateAugust 6, 2025February 16, 2025
Parameters——
MultimodalYesYes
Context (input)400K128K
Context (output)128K8K
Input Price / 1M$1.25$3.00
Output Price / 1M$10.00$15.00
Average Score88.5%85.7%
Benchmarks
AIME 202589.0%93.3%
GPQA88.0%85.0%

Visual Benchmark Comparison

GPT-5 Medium
Grok-3
AIME 20250.9 vs 0.9
0.9
0.9
GPQA0.9 vs 0.8
0.9
0.8

Verdict

GPT-5 Medium leads in 3 out of 4 comparison categories.

Overall Performance

Both models show comparable average scores: GPT-5 Medium — 0.9, Grok-3 — 0.9.

API Cost

GPT-5 Medium is 1.6x cheaper: input $1.25/1M vs $3.00/1M tokens.

Context Window

GPT-5 Medium supports a larger context: 400K vs 128K tokens.

Recency

GPT-5 Medium is newer: released 8/6/2025 vs 2/16/2025.

More About These Models

Related Comparisons

Frequently Asked Questions

Which is better for coding — GPT-5 Medium or Grok-3?
Direct comparison on the SWE-Bench benchmark is not available. We recommend reviewing other metrics on the comparison page.
Which model is cheaper — GPT-5 Medium or Grok-3?
GPT-5 Medium is cheaper for input: $1.25 per 1M tokens vs $3.00.
Which has a larger context window — GPT-5 Medium or Grok-3?
GPT-5 Medium supports a larger context: 400,000 tokens vs 128,000.

The GPT-5 Medium and Grok-3 comparison is updated for 2026. Data includes benchmark results, API pricing, context window size and other specifications. For more detailed information, visit the GPT-5 Medium or Grok-3 page. See also the complete list of AI model comparisons.