Qwen 3.8 Next Flash is really really REALLY verbose..
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Long time user of 3.6 27b, switched over to Next Flash since it's a logical step up even from 3.8 27b. It's soooo verbose, i'm talking 13 minutes of thinking time on single turn coding requests at approximately 150 tokens per second tg and 7000 tokens per second pp. It's honestly kind of painful to use since I look back and it's still thinking, then when I go to check the output it's decent most of the time but if the task requires ANY decision making, it turns into alphabet soup where it's just buzzwords and jargon that nobody actually uses in the SWE space.
The runtime is actually shorter for me if I BYOK it to VSCode, but for pi.dev it's often takes 1 hour!
Before anyone tells me to lower the thinking level, I don't want to do that given the chance it makes the model worse. There's no solid benchmarks for how the model performs at different thinking levels yet, but looking towards 3.8 27b, it seems to affect the quality of the output quite a bit.
[link] [comments]
More from r/LocalLLaMA
-
NVIDIA shipped OpenShell, an open source sandbox that gives local and open agents real runtime limits instead of prompt rules. Over 100 firms joined the safety stack. OpenAI did not.
Sep 28
-
3090 for $1500???
Sep 28
-
modified qwen 3.8 27b modifies windows credential dumper to bypass EDR detection
Sep 28
-
Minisforum MS-S1 MAX-P495 @ €7.799,00
Sep 28
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.