Step 3.7 Flash Config + Early Data on 2x RTX 6000's
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Setup Step 3.7 Flash on two Blackwell RTX Pro 6000's and got it running and recorded the configs and settings as well as early data and readings like tokens per second on general inference. Running extended bench tests now just wanted to get this to folks early. It's past midnight here so will follow up with more tomorrow. Thanks.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.