r/LocalLLaMA · · 1 min read

Setup for always on assistant

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I have a dual 3090 rig that I use as coding assistant and while it works, it draws a lot of electricity.

Now I want to add another rig that I can keep on all the time, or maybe a vps if that is suitable. This rig should run an assistant model that should be fairly intelligent but doesn't have to be so coding focused. It should basically be like a chat gpt replacement. I'm not sure if something like openclaw/hermes would be suitable for this.

Since it will be one all the time, power usage should be low. What kind of rig and model would you select for such an assistant?

submitted by /u/Blues520
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA