r/LocalLLaMA · · 1 min read

Qwen 3.5 122B Heretic ROCmFP4 iMatrix

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Qwen 3.5 122B Heretic ROCmFP4 iMatrix

My first time doing anything like this, and I built it because I wanted it. If anyone wants the non Heretic I'll mosey that out as compute allows.

Strix Halo: 122B total · 10B active · 60.70 GiB · 28.45 tok/s · BF16 · KLD 0.100716 · PP 353.3 t/s

submitted by /u/RedParaglider
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA