How much VRAM needed for Qwen 3.6 27B Q8 with 262K context?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
trying to figure out my next GPU purchase. currently running IQ4XS and Q4 KV with 262K context and want to upgrade and run uncompressed KV and the model at Q8.
anyone know how much VRAM is needed? would 48GB be enough?
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.