K2 Horizon MoVA 36B-A4B
K2 Horizon MoVA 36B-A4B is the sparse mid-size member of IFM's (MBZUAI) fully open K2 Horizon family: a Mixture-of-Experts reasoning model with 36B total and about 4B active parameters per token (48 layers, 100 routed experts with 8 active plus 1 shared expert) that also uses IFM's new Mixture-of-Value Attention (MoVA), where a router selects a few value-projection experts per token. Pretrained on 22.9T tokens with a native 524,288-token (512K) context window from midtraining onward. Text in, text out, with per-request reasoning effort (high recommended) and JSON/XML tool-call formats. Released 2026-09-03 under Apache 2.0 with BF16 weights plus FP8 and GGUF builds, intermediate checkpoints, training data, code, and logs. No priced provider is cataloged yet.
Key Specifications
Timeline
Technical Specifications
Benchmark Results
Model performance metrics across various tests and benchmarks
Reasoning
Other Tests
License & Metadata
Similar Models
All ModelsK2 Horizon 32B
Institute of Foundation Models
K2 Horizon 375B-A23B
Institute of Foundation Models
Phi 4
Microsoft
GPT OSS 20B High
OpenAI
Llama 3.1 Nemotron 70B Instruct
NVIDIA
LongCat-Flash-Lite
Meituan
GLM-4.7-Flash
Zhipu AI
Nemotron 3.5 Lightning (30B A3B)
NVIDIA
Recommendations are based on similarity of characteristics: developer organization, multimodality, parameter size, and benchmark performance. Choose a model to compare or go to the full catalog to browse all available AI models.