r/LocalLLaMA · · 1 min read

I just got my first GPU that can actually run an LLM (Laptop 5090 24 GB) what do I play with first?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I figure I can run 30b or even 72b models on it, but this is my first time running my own local LLM. I want to play with prompt engineering and see the most complex things I can get it to do. Any hot tips? I know it all moves fast and this sub is wired in

I have 32GB ram also

edit: omg this sub is so helpful lol, thank you everyone

submitted by /u/ThomasAger
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA