Gemma4 12B - Experiences?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Anyone check out the new Gemma4 12B that dropped 3 days ago? Integrated vision and audio recognition, no mmpro needed plus tool use. Q4 quant is like 8gb RAM. Crazy fast and great quality for it's size. No, it's not as good as a 27B or 31B. But it's damn close. Curious what others think.
[link] [comments]
More from r/LocalLLaMA
-
You don't need a GPU to run gemma-4-26B-A4B
Jun 7
-
5 Months Later: open-deepthink Now Has Full Knowledge Distillation Mode
Jun 7
-
I can't wait for all the x250 sample distills of Mythos and GPT-5.6
Jun 7
-
Gemma 4 31B QAT Q4 vs standard Q4 — Top1 KLD benchmark results have me confused. Someone please explain or poke holes in this.
Jun 7
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.