My RULE of Thumb of choosing a models
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| This is mostly for setting up for expectation, since personally without LLM i could take 3 days (15 hours of active programming) to debug or implement a feature, but with Qwen 27B (even before Qwen 3.8) it take 4 hours. And yes 0.5 tok/s is human, not accounting of deletion and pausing, that's also the reason i am fine leaving overnight code base wide analysis or fin tech and deep research. [link] [comments] |
More from r/LocalLLaMA
-
yandex/AliceAI-Foundation-80B-A3B-Base: Russian-developed competitor to Qwen 35B and DeepSeek V4 Flash
Sep 21
-
Huawei shelves global AI chip rollout as China's own demand outstrips supply — AMD and Nvidia no longer have to worry.
Sep 21
-
A better coder for the small-GPU/small-RAM crowd!
Sep 21
-
How it feels watching prices go up
Sep 21
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.