r/LocalLLaMA · · 1 min read

RAG for developer docs so local llm can code using latest library?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I was wondering if it would make local llm better at coding if it has access to the latest documentation available through a RAG. I'm specifically interested in python. But then this might lead ingesting and embedding a very large number of documents. Or I could just focus on the specific docs that are of interest to me to narrow it down further. Third option to make it look everything up online but I assume that would be least efficient?

What is the best way to ensure it uses the latest APIs of a given library?

submitted by /u/BitGreen1270
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA