I would like to have a strong local ollama with tooling alike GitHub’s Copilot that works through terminal..
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I’ve already been experimenting with some larger models on my Apple M3 Ultra 96GB (can fit multiples up to around 65 GB total) and I’ve noticed it’s just stupid
Using OpenCode to connect too a local ollama proxy I can access the models, add custom instructions, etc. This gives me an alike experience to copilot through terminal but even using decent models I have to walk it through every little command in the prompts to even get it to list the file directory and can’t even get it to summarize a small hello world project I built specifically to test it with written in python.
Anyone can point me in a better direction or advice would be great!
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.