r/LocalLLaMA · · 1 min read

Could someone make some ggufs for Qwen-Image-Bench?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Could someone make some ggufs for Qwen-Image-Bench?

I'd like to try it out for automating image generation quality output, I haven't had great luck with that using 27b base or gemma. If this can reliably detect 6 fingered generations and other undesirable outputs it would be a great boon.

I took a swing and quantizing it myself but was unsuccessful. Could someone with experience in that area make some quants? I'm looking to fit it in 24gb vram.

submitted by /u/GotHereLateNameTaken
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA