Prismix
r/LocalLLaMA · · 1 min read

Upstage 'Solar open2' release. performance on par with DeepSeek V4 Flash.

#model-release #version-bump #reasoning #benchmark

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Like Read original ↗
Upstage 'Solar open2' release. performance on par with DeepSeek V4 Flash.
Benchmark Solar Open 2 250B-A15B Solar Open 100B 102B-A12B Command A+ 218B-A25B Mistral Medium 3.5 128B dense, high MiMo-V2.5 310B-A15B DeepSeek-V4-Flash 284B-A13B, max
Know. & Reasoning
MMLU-Pro 86.2 80.4 79.0 81.2 84.6 85.9
GPQA-Diamond 86.3 66.2 75.6 77.5 83.0 88.9
HLE (w/o tools) 28.8 11.5 11.4 12.8 24.3 32.3
LiveCodeBench (v6) 92.4 56.5 86.1 84.9 89.1 92.3
ArtifactsBench 55.9 43.4 42.8 49.8 59.3 61.0
HMMT2602 93.9 68.9 73.5 62.9 61.4 94.7
AIME2026 95.7 87.7 96.0 89.0 92.3 97.0
IF / Long
Multi-Challenge 61.0 40.5 45.8 49.8 39.0 62.0
IFBench 80.0 57.7 73.9 69.0 67.1 80.3
AA-LCR 62.3 36.0 46.0 61.0 62.7 63.7
Agent
SWE-Bench Verified 70.4 15.4 14.4 69.6 73.0 73.8
Terminal Bench Hard 28.3 2.3 25.0 33.3 41.7 34.1
APEX-Agents 16.6 2.4 1.6 6.1 13.4 13.2
MCP-Atlas 58.2 34.4 27.2 30.7 63.9 58.2
τ³ (banking) 19.6 7.4 5.8 5.8 8.7 22.3
GDPval-AA v2 (ELO) 1128 – 712 929 1145 1187
submitted by /u/Lucidstyle
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA