Choosing an abliterated version of Gemma 4 31B and 26B-A4B
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
The only thread was 2 months ago, when the model had just dropped. Since then, more versions from different authors have appeared, and users have had time to test them.
Which version are you running now?
More importantly – which version caused you problems?
Currently I'm using both 31B and 26B-A4B from llmfan46 (26B-A4B regular – not 'ultra'), but I'm wondering – has anyone had issues with them that were fixed by switching to a different version (same quants and all other conditions identical)?
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.