RAG for developer docs so local llm can code using latest library?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I was wondering if it would make local llm better at coding if it has access to the latest documentation available through a RAG. I'm specifically interested in python. But then this might lead ingesting and embedding a very large number of documents. Or I could just focus on the specific docs that are of interest to me to narrow it down further. Third option to make it look everything up online but I assume that would be least efficient?
What is the best way to ensure it uses the latest APIs of a given library?
[link] [comments]
More from r/LocalLLaMA
-
How local AI improved your live?
May 25
-
I built a computer use sandbox framework for codex on headless linux. GPU passthrough, computer use, and sudo access for codex all work. It's the perfect dev sandbox to allow full auto work while minimizing the "rm -rf /" risk
May 25
-
MiMo-V2.5-coder
May 25
-
Next year we're getting 0.5T model from Grok
May 25
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.