r/LocalLLaMA · · 1 min read

Single RTX 3090 (MSI TRio) giving trouble on inference.

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Hi, I'm having weird issues with my 3090 on inferencerence via lmstudio , it just:

  • unloads the model/ model crashes + nvidia driver resets
  • freezes the pc
  • gives blue/black screen and the computer restarts
  • or straight up restarts everything.

I tried running it regularly, undervolted with afterburner, limited with nvidia-msi -pl (thought the issue was some power spike going beyond my PSU). It reduced the crashes, and their level, but still happens.

During benchmarking, I see no issues (even tried benchmarking with a 22gb model loaded), goes well.

Tried checking the voltage during inference, but havent seen even spikes above 180w.

The issue happens sometimes even after i spent a while talking, or after just idling and asking something, it just hangs when analyzing the prompt...

The card also does some noise when infering with the text being displayed.

Is this an LMStudio issue? my thermal pads died? or how can I fix this?

submitted by /u/ReasonablePossum_
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA