World's First(?) Underwhelming AMD Ryzen AI Halo Cluster
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| LTT Labs recently received the Linux version of the AMD Ryzen AI Halo for testing, but it turns out that AMD had intended to send the Windows version. Through this stroke of misfortunate, we were fortunate enough to have two Ryzen AI Halos for a short period of time and the temptation to cluster them was too great, surely we'll get more performance through the magic of having two of them. We've followed AMD's AI Playbook for clustering with RPC, learning some things but also raising more questions. We don't have any concrete conclusions, but we're sharing results to hopefully save some time for others or spark discussion! We were sent this AMD Ryzen AI Halo by AMD for testing, but there was no sponsorship or review by AMD in our earlier testing, or this article. We're very interested to learn if there are any thoughts or conclusions that can be drawn from our exploration, or ways to improve it in the future! [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.