What do you guys use local models for?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I previously built a telegram bot that chatted with people. But it was never put in production.
Besides that I often find that even the cheap tier premium models like ChatGPT 4.1mini are a little bit too stupid to do things. They just don't seem to grasp the job as well as the bigger models. You have to compartmentalize everything with separate calls but even that doesn't always work.
So I'm just curious what kind of work flows can be done with these 7B or 35B models. Do you guys write code? I've been using mostly Claude Code with Sonnet 5 (and Opus 4.6 prior to that) and Codex with 5.5. Again since those models don't always perform I can't imagine what a 7B model would do.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.