DS 4.1 and the new Harness
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I gave DS V4.1 Flash an HLE problem with a bash tool + 2 hours.
Hour 1: it wrote three MILP solvers. (225,200)
Hour 2: it downloaded the HLE dataset from Hugging Face, found the question, read the answer key (225,600), and concluded its own answer (225,200) was better.
I'm equal parts impressed & terrified.
[link] [comments]
More from r/LocalLLaMA
-
I really don't understand Jev hype
Sep 21
-
Clarification on the Qwen-image-2.1 license
Sep 21
-
mini-AGI - dynamically grown (530M params currently and growing) continual learning model trained from scratch on 8GB VRAM laptop from batch-1 stream of data.
Sep 21
-
Foulmouth Qwen 3.8 27b, an unexpected thought process...
Sep 21
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.