Experimental "Preserve Thinking" Jinja Template for Gemma4 31B in llama.cpp
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
https://huggingface.co/stevelikesrhino/gemma-4-31B-it-nvfp4-GGUF/blob/main/gemma4-improved.jinja
Yall are more than welcome to try it out and provide feedback. In my own testing in Pi-coding-agent I no longer have the "forgot to close thinking tag" "forgot to open thinking" "closed thinking to early" problem. It's more stable for multi-turn tool calls within multiple turns of prompts.
Disclaimer this is NOT recommended by Google.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.