Claude 3.5 Sonnet vs Mistral Large 2: Specs & Benchmark Comparison

CharacteristicClaude 3.5 SonnetMistral Large 2
CompanyAnthropicMistral AI
Release DateJune 21, 2024July 24, 2024
Parameters123B
MultimodalYesNo
Context (input)200K128K
Context (output)200K128K
Input Price / 1M$3.00$2.00
Output Price / 1M$15.00$6.00
Average Score0.80.9
Benchmarks
MMLU0.90.8
GSM8k1.00.9
HumanEval0.90.9

Visual Benchmark Comparison

Claude 3.5 Sonnet
Mistral Large 2
MMLU0.9 vs 0.8
0.9
0.8
GSM8k1.0 vs 0.9
1.0
0.9
HumanEval0.9 vs 0.9
0.9
0.9

Verdict

Mistral Large 2 leads in 2 out of 4 comparison categories.

Overall Performance

Both models show comparable average scores: Claude 3.5 Sonnet — 0.8, Mistral Large 2 — 0.9.

API Cost

Mistral Large 2 is 2.3x cheaper: input $2.00/1M vs $3.00/1M tokens.

Context Window

Claude 3.5 Sonnet supports a larger context: 200K vs 128K tokens.

Recency

Mistral Large 2 is newer: released 7/24/2024 vs 6/21/2024.

More About These Models

Related Comparisons

Frequently Asked Questions

Which is better for coding — Claude 3.5 Sonnet or Mistral Large 2?
Direct comparison on the SWE-Bench benchmark is not available. We recommend reviewing other metrics on the comparison page.
Which model is cheaper — Claude 3.5 Sonnet or Mistral Large 2?
Mistral Large 2 is cheaper for input: $2.00 per 1M tokens vs $3.00.
Which has a larger context window — Claude 3.5 Sonnet or Mistral Large 2?
Claude 3.5 Sonnet supports a larger context: 200,000 tokens vs 128,000.

The Claude 3.5 Sonnet and Mistral Large 2 comparison is updated for 2026. Data includes benchmark results, API pricing, context window size and other specifications. For more detailed information, visit the Claude 3.5 Sonnet or Mistral Large 2 page. See also the complete list of AI model comparisons.