128GB vs 256gb of ram
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Imagine you have 128gb of VRAM. what accompanying ram capacity you would choose (DDR4 8channel)?
For example Deepseek v4 flash in q8 takes around 170GB + 12GB Dflash + ~10GB per 1m context so it’s under 200gb. so 128 + 128 should be good
But for something like MiMo v2.5/Stepfun-3.7/ other 200-300B models things getting more complicated if you want to run higher quants. Also VRAM/RAM weights split ratio heavily affects performance.
What your take on it? You would choose 128 or 256? (considering it some ass cheap used slow sticks so it won’t cost you a leg)
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.