r/LocalLLaMA · · 1 min read

Qwen 3.6 27B is solid up to 262K context. How high have you guys gone above that using Rope/Yarn scaling?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Stack:

  • i7 12700K | RTX 3090 TI | 96GB RAM
  • Qwen 3.6 27B Q3/Q5 KXL UD

I've been pushing Qwen 3.6 27B above 200K ctx all week, and it handles it like a champ. I'm impressed. Today I hit the ceiling at 262K and it's still functioning well and coherent. I'm planning on trying out Yarn to see if I can push it higher.

How high have you guys pushed it and how has the quality held up?

NOTE: If you're wondering why the context is so high, it's mcp tool and memory/summary bloat (40-50K) on session start, which we're actively working on resolving using an mcp broker server, among a couple of other optimizations.

MODEL SWAPPING: Since a couple of people have asked: I start out with Q5 kv 8/8 until 115K, then I drop to kv 4/4 until 200k, then drop to Q3 kv 4/4 until 262K. Works every time and solid speeds on my RTX 3090 TI.

submitted by /u/GrungeWerX
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA