I just got my first GPU that can actually run an LLM (Laptop 5090 24 GB) what do I play with first?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I figure I can run 30b or even 72b models on it, but this is my first time running my own local LLM. I want to play with prompt engineering and see the most complex things I can get it to do. Any hot tips? I know it all moves fast and this sub is wired in
I have 32GB ram also
edit: omg this sub is so helpful lol, thank you everyone
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.