70-class VRAM stagnation
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| been thinking about how the desktop 70-class has sat at 12GB for two generations now, 4070, 4070 super, 5070, all 12GB. the 1070 gave you 8GB back in 2016 and it felt generous for the price. ten years later the jump is... 4GB. and the thing is these chips arent even weak. the cores keep improving, theyre just boxed in by memory. a 70-class card with 24GB would be a genuinely capable local model machine for cheap. which is maybe the point. nvidia makes far more selling VRAM-heavy cards for AI than they'd make letting a $550 gaming card run models people currently need pricier hardware for. cant prove intent obviously, but the incentive lines up a little too neatly. memory shortages are a real factor too, just feels like more than that [link] [comments] |
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.