What do I need to get Kimi 3 locally reliably, full context, 20 concurrent req?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
GPU and mainboard/cpu suggestions? Must be a single machine, not linked. Willing to run it Nvfp4
Edit: Oh deng. People are so salty when asking questions here. I will be talking to vendors but need some base info to activate the BS meter (yes, we’ve been burned before). Thanks for the help anyways guys, and I will be doing my own research, but sometimes “random redditors” help more than you realize :)
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.