r/LocalLLaMA · · 1 min read

From 6gb to 32gb

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Well I ordered a 3090 today. I plan on pairing it with a 3060 I have for 32gb combined VRAM.

Up until now I’ve just been using a 6GB card on my laptop. I’ve been using Gwen 3.5 4B so far. Where should I start? Gwen 3.6 27B?

I’m interested in coding applications, mainly to teach myself more about coding so I can understand it a little better. I’ll be using Ubuntu and Llama.cpp, neither of which I’ve set up before so that will be a great learning experience. This is mostly a “I’ve saved up and am excited to finally have a more capable card” post, but also looking for good models to try it out with.

submitted by /u/UniqueIdentifier00
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA