My home data center
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| System 1: Threadripper 3960x 24c 4x 3090 ti 128gb ddr4 System 2: Xeon 8352 36c 4x 5070 ti 128gb ddr4 System 3: Intel 14700k 24c 64gb ddr5 5090 System 4: Ryzen 5950x 16c 64gb ddr4 2x 5070 ti The first system uses two PSUs to handle the almost 2000w full load of the 3090s. Was nervous about this but it has been running stable for about a month. The Intel is an engineering sample that cost $100. I mainly use it to run an embedding model. I use them for various ml experiments, projects and some agentic coding. Right now the 3090s are training a tts lora with data distilled from a larger model. The 5070s run qwen 27b for coding, nemotron streaming stt and moss tts for an interactive agent I am building. These recent qwen models are good enough for coding. Sometimes I leave them all night working on a repo. Mainly boilerplate improvements but its incredible to get real work down with no token cost. Aside from from the obvious costs of this hardware. Love this community ❤️ [link] [comments] |
More from r/LocalLLaMA
-
It's funny how everything changes, yet somehow stays the same.
May 31
-
Dell confirms XPS laptop with NVIDIA N1X at Computex ( basically a DGX Spark GB10 for consumers with Windows )
May 31
-
All DGX Station GB300 OEM systems side-by-side in one image (roughly actual size)
May 31
-
Benchmarked inference engines for M1 Max 64gb-results & analysis
May 31
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.