r/LocalLLaMA · · 1 min read

Buying AI accelerators/GPUs in China...

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Bit of a long-shot this, but happens I'll be in China next week. Just wondering if there are any Chinese graphics cards/AI accelerators I should be trying to buy when I'm there? :-).

I would be looking for something that let me run inference big models (so, lots of (V?)RAM), but not necessarily at cutting edge speeds. Supported by something like vLLM or Llama.cpp. Doesn't need to be Plug'n'Play or idiot-proof, I can stand a bit of fiddling to get things working.

I'd rather buy a couple of Huawei cards than enrich Jensen Huang any more than necessary...

submitted by /u/Clank75
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA