Add arch support for cohere2-MoE by michaelw9999 · Pull Request #24260 · ggml-org/llama.cpp

It's time to recompile your llama.cpp and download new model:

https://huggingface.co/CohereLabs/North-Mini-Code-1.0

https://huggingface.co/unsloth/North-Mini-Code-1.0-GGUF

Model Summary

North Mini Code is an open weights research release of a 30B-A3B parameter model optimized for code generation, agentic software engineering, and terminal tasks.

Developed by: Cohere and Cohere Labs

• Point of Contact: Cohere Labs
• License: Apache 2.0
• Model: North Mini Code
• Model Size: 30B total; 3B active
• Context length: 256K & 64K max output