r/LocalLLaMA · · 1 min read

Looking for efficient "eGPU" setup

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Hi,

I've been running 4 GPUs atop a dell workstation using PCIe risers, as just a single could even fit in the case due to its ridiculously massive cooling solution. I'm looking for proper external housing for the GPUs.

Current setup uses 2x16, 1x8 and 1*x1 slot. It works just fine, the bandwidth is not a real issue here. Yet I'm looking for something like having all 4 GPUs at x4 using a passive occulink splitter such as https://fr.aliexpress.com/item/1005009662218005.html . My workstations support X4X4X4X4 bifurcation (not X8X8 though). The issue lies with the case.

What I'd want is a tower case to sit next to the workstation, with a single power inlet, 4 occulink inputs or anything similar, and connectors, including power delivery, for 4 GPUs each 3 slots wide.

I'm open to using a backplane with a PCIe switch as long as it's not over $1k. I'd rather have it powered by a 1-1,5kW ATX PSU I already own but it could be built-in.

If the case can accommodate more GPUs, eventually be rackable (4-5U), and embedding a switch connected with a single 16x link to the host that would be the ideal setup.

Did you ever see such hardware popping up in your research ?

submitted by /u/chiwawa_42
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA