Is my CPU and RAM too weak/ lees for local LLMs? Both are going 100% for simple test prompts. GPU is not getting used fully. In theory quen3.5:9b should fit and run on RTX3050 8 GB comfortably.
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | I am very new to this local llm world. Just started to exploring from past 3days. Share any troubleshooting tips. [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.