K2 Horizon MoVA 36B-A4B

Institute of Foundation Models

K2 Horizon MoVA 36B-A4B is the sparse mid-size member of IFM's (MBZUAI) fully open K2 Horizon family: a Mixture-of-Experts reasoning model with 36B total and about 4B active parameters per token (48 layers, 100 routed experts with 8 active plus 1 shared expert) that also uses IFM's new Mixture-of-Value Attention (MoVA), where a router selects a few value-projection experts per token. Pretrained on 22.9T tokens with a native 524,288-token (512K) context window from midtraining onward. Text in, text out, with per-request reasoning effort (high recommended) and JSON/XML tool-call formats. Released 2026-09-03 under Apache 2.0 with BF16 weights plus FP8 and GGUF builds, intermediate checkpoints, training data, code, and logs. No priced provider is cataloged yet.

Key Specifications

Parameters
36.0B
Context
-
Release Date
September 3, 2026
Average Score
43.0%

Timeline

Key dates in the model's history
Announcement
September 3, 2026
Last Update
October 31, 2026
Today
November 20, 2026

Technical Specifications

Parameters
36.0B
Training Tokens
22.9T tokens
Knowledge Cutoff
-
Family
-
Capabilities
MultimodalZeroEval

Benchmark Results

Model performance metrics across various tests and benchmarks

Reasoning

Logical reasoning and analysis
GPQA
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95; GPQA Diamond • Self-reported
80.8%

Other Tests

Specialized benchmarks
AA-LCR
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95; long-context reasoning • Self-reported
66.3%
CritPT
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95 • Self-reported
2.1%
Humanity's Last Exam
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95; without tools • Self-reported
25.2%
OmniScience
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95; OmniScience accuracy • Self-reported
18.8%
OmniScience (non-hallucination rate)
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95 • Self-reported
69.2%
SciCode
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95 • Self-reported
38.9%
Tau3 Banking
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95 • Self-reported
26.8%
Terminal-Bench 2.1
IFM K2-Horizon-MoVA-36B-A4B Hugging Face model card, final checkpoint; reasoning_effort=high, temperature=1.0, top_p=0.95 • Self-reported
58.6%

License & Metadata

License
apache_2_0
Announcement Date
September 3, 2026
Last Updated
October 31, 2026

Similar Models

All Models

Recommendations are based on similarity of characteristics: developer organization, multimodality, parameter size, and benchmark performance. Choose a model to compare or go to the full catalog to browse all available AI models.