Single RTX 3090 (MSI TRio) giving trouble on inference.
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Hi, I'm having weird issues with my 3090 on inferencerence via lmstudio , it just:
- unloads the model/ model crashes + nvidia driver resets
- freezes the pc
- gives blue/black screen and the computer restarts
- or straight up restarts everything.
I tried running it regularly, undervolted with afterburner, limited with nvidia-msi -pl (thought the issue was some power spike going beyond my PSU). It reduced the crashes, and their level, but still happens.
During benchmarking, I see no issues (even tried benchmarking with a 22gb model loaded), goes well.
Tried checking the voltage during inference, but havent seen even spikes above 180w.
The issue happens sometimes even after i spent a while talking, or after just idling and asking something, it just hangs when analyzing the prompt...
The card also does some noise when infering with the text being displayed.
Is this an LMStudio issue? my thermal pads died? or how can I fix this?
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.