r/LocalLLaMA · · 1 min read

Motif-Technologies/Motif-3 official realese

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Motif-Technologies/Motif-3 official realese

Motif-Technologies is one of the tech company participated South Korea's AI Foundation Model project.(독파모)

Upstage(Solar Series), LG AI Research(EXAONE Series), and SKT(A.X Series) are the competitors.

Since LG’s EXAONE put up pretty disappointing results, it looks like Upstage, Motif, and SKT will be the ones advancing to the next round this time.

If you reverse-calculate the AAII score from the table, it comes out to 47.364, which slightly edges out Qwen 3.7 Max.

With Upstage’s Solar Pro 4 expected to land in the mid 40s(250B -15B), based purely on the benchmarks, motif seems to be taking the lead in Round 2.

Benchmark Motif 3314B-A13B MiniMax-3428B-A23B GLM-5.1744B-A40B Kimi-K2.61T-A32B Qwen-3.7max DS-v4-Pro1.6T-A49B
Agentic
GDPVal v2 38.7 44.4 37.8 34.4 39.0 40.2
τ²-Bench Telecom 94.7 88.9 97.7 95.9 94.7 96.2
τ³-Banking 35.3 15.3 13.6 23.3 12.0 30.1
ITBench* 51.5 40.3 31.2 42.5 38.3
Coding
SWE-Bench Verified 76.2 75.0 76.4 76.2 80.4 77.4
Terminal-Bench 2.1 74.9 65.2 61.8 65.9 75.0 64.0
SciCode 40.6 45.4 43.8 53.5 53.5 50.0
Reasoning & Knowledge
IMOAnswerBench 83.2 83.8 81.8 90.0 89.8
Apex-Shortlist 75.5 71.1 77.4 44.5 85.8
GPQA Diamond 83.4 92.9 86.8 91.1 92.4 88.8
HLE 37.0 39.0 30.1 37.5 41.4 37.5
CritPt 6.6 3.7 4.6 8.0 11.4 12.9
OmniScience — Accuracy 30.1 16.7 23.7 32.6 31.0 42.9
OmniScience — Non-Hallucination 71.6 81.6 70.1 59.5 74 5.9
Long Context & Instruction Following
AA-LCR 72.3 80.3 68.0 76.7 75.0 70.0
IFBench 78.2 82.9 76.3 76.0 79.1 76.5
submitted by /u/Lucidstyle
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA