Gemma 4 MTP with LlamaCPP
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I am running Gemma 4 31B for a project using LlamaCPP. There is no integrated main model + MTP drafter GGUF. And from what I can tell, LlamaCPP was updated to not accept a separate MTP drafter GGUF but instead to use a combined GGUF for main+drafter. So how can I use Gemma 4 31B with MTP on LlamaCPP?
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.