r/LocalLLaMA · · 1 min read

Viable ways to run K3 locally

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

just curious how would people run it cheap if they really want kimi k3.

  1. dgx spark / strix halo clusters

  2. optane persistent memory platform + some gpus

  3. mac studio clusters

  4. orange pi 6 clusters

  5. ssd streaming + gpus

  6. multiple ddr3 + connectx 5 rdma clients

  7. two dgx stations

  8. power 10 systems?

  9. other

submitted by /u/ylchao
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA