r/LocalLLaMA · · 1 min read

Eff U, Arc / B70 Customers. We got ours! -Your Sugar Baby, Intel

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Since we're due a "Should I buy a B70" post, no. Just no.

Am I hoping someone who doesn't read this will buy mine on eBay in the next few days? Hell, yes.

Here's the deal... A B70 is a decent buy if you want 32GB of VRAM over nearly all other considerations. They run reasonably well with Vulkan or SYCL until you need... 33GB of VRAM or, God forbid, more.

This company that is suddenly the Jesus of American chip production, stock valuation, and the second coming of capitalistic virtue itself... and which relatively recently had "genuine" data center GPU offerings, cannot produce a GPU with enough support to run two in parallel under any software framework. Period.

32GB VRAM = Decent value. >32GB VRAM = pipeline parallelism at CPU inference speeds, else trash the investment and start anew with a different vendor's GPU. On a better day I might say it's been this way for three months, but that'd ignore the B70 not being the first of the Arc series, nor would it properly account for Intel being asleep at the wheel for all the AI race thus far.

Having been bitten, I can't wait for their fabs to start pumping out multi-generation-old Nvidia and Apple chips (and with no further supply of LPDDR or HBM memory to finish out the packages). The forthcoming ineptitude will be decadently rich.

Crap, forgot to throw in an em-dash. Wasted effort. Disregard all previous rant.

submitted by /u/Dependent_Ad948
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA