Gemma 4 26B/31B Q4 QAT vs Q4/Q5/Q6/Q8
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
What are your experiences with Gemma 4's QAT versions compared to their regular ones? So far I have mostly heard about regressions, but if you have a different experience or even benchmarks that are in favor of QAT, this is the thread to share them.
Please share your positive or negative experiences. I think we really need more data to verify if one is truly better than the other. Google itself has not released any data. Please also share whether you have used Unsloth's or Google's QAT.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.