r/LocalLLaMA · · 1 min read

Behold! Probably the most ghetto local AI server:

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Behold! Probably the most ghetto local AI server:

AKA: Jank Incarnate

After months of pain, I finally got a working setup.

There's a bunch of quirks about running a multi-Tesla setup. I was planning to write something about my experience after I get it running.

Currently, the fans are plugged into the wall, speed is controlled with a knob. I still gotta wire up a PWM controller for them.

EDIT: Specs:

  • Intel Xeon CPU E5-2680 v4 @ 2.40GHz
  • Asrocka x99 Extreme motherboard
  • Cursed 16GB DDR4 of some laptop SODIMM in an adapter
  • 3x Nvidia Tesla V100, 32GB - total 96GB of VRAM
submitted by /u/MackThax
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA