AI server under 5k?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I have a framework desktop 128GB and a 3080 12GB running qwen 7b
I want to move to a proper server rack + switch but not sure how to move from desktop PC to server rack.
Any advice on what GPU/Server to get under 5k? Or at that price just stick to workstation?
[link] [comments]
More from r/LocalLLaMA
-
Tencent Hy 30B/7B/1.8B
May 21
-
110 tok/s with 12GB VRAM on Qwen3.6 35B A3B and ik_llama.cpp
May 21
-
'Am I OpenAI compatible' - a tool and documentation for unified api signatures in open source AI.
May 21
-
AMD Powers Next-Generation Agent Computers with New Ryzen AI Halo Developer Platform and Ryzen AI Max PRO 400 Series Processors
May 21
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.