#24260 merged Llama.cpp Arch Cohere-Moe Support Added
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I have been wanting to try these North Mini Code models so I guess now is as good a time as any.
I have some bs slop I'm working on (various homelab tools and such for personal only use) so I'd like to test coding with it and see how it goes vs qwen 3.6 27b Q8 using 3 5060ti 16gb it is pretty cramped. The mini code q8 comes in at almost 3gb smaller.
Has anyone used these models ?
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.