r/LocalLLaMA · · 1 min read

LACT PR to let NVIDIA gpus go lower than stock VBIOS limit (so below 400W for 5090, or below 250W for 6000 PRO MaxQ)

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

LACT PR to let NVIDIA gpus go lower than stock VBIOS limit (so below 400W for 5090, or below 250W for 6000 PRO MaxQ)

Hallo guys, hoping you're doing fine.

This PR let for users that use LACT, go lower than the stock VBIOS limit on their cards, and such being more power efficient.

This let you go down to 30W, or lower if the VBIOS on your card goes lower than that. On a RTX 6000 PRO the min it did go was 75W, so there's probably a firmware/hardware limit somewhere.

For context, we have this min values for some cards on their stock VBIOS:

  • RTX 5090: 400W
  • RTX 6000 PRO MaxQ: 250W
  • RTX 6000 PRO Server Edition: 400W
  • RTX 6000 PRO Workstation Edition: 150W

This modification let you go lower, for example 300W on the 5090 and barely lose performance on text generation.

Also, if you have shunt modded cards (on my case, RTX 6000 PRO), this let you go lower and control the card better.

Let me know how it works for you guys!

PS: NVIDIA if you find this please don't kill me.

submitted by /u/panchovix
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA