Built a system with four P100 GPUs.
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | I have built a system with four P100s, and ultimately, I plan to house six of them in a standard case. I have only four right now, but I tested it beforehand to prepare for having six later on. The token speed is around 50 t/s, and the PP is approximately 530–550 during actual use. It should be complete once two more P100s arrive soon. I'm curious to see how much the token speed and PP will increase. [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.