r/LocalLLaMA · · 1 min read

What would 2x RTX 3060 12GB get me?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

TLDR: I’m considering buying 2 RTX 3060 12GB as opposed to single 24GB card to gain experience and need to know what can be realistically accomplished with this setup.

Sorry in advance, I know you guys are probably tired of these kinds of post but I wanted to shoot my shot at asking.

Last year I bought an RX 5700 XT 8GB for gaming and when I tried local ai models, for the life of me I couldn’t get it to work. So all my inference was CPU only. I have 32GB RAM and I’m looking to upgrade that at some point. So the rest of the hardware, I know I gotta take care of (RAM, PSU, etc).

What I’m trying to accomplish is, first of all, agentic coding (I know I shouldn’t get my hopes up there and it will definitely not become my daily driver at this scale, but if centering a div can be accomplished in less than 5 minutes, maybe that’s a win). The second goal is to gain experience with workflows, putting models with heavy chains that could be applicable to small business tasks… and I mention wanting 2 cards instead of one for the experience of running multiple GPUs.

So with this in mind, what models can this VRAM power actually accomplish in your experience?

Thanks guys.

submitted by /u/ObjectiveActuator8
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA