r/LocalLLaMA · · 1 min read

Harbor v0.4.19 - vllm/sglang/llama.cpp launch codex/claude/pi/opencode

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Harbor v0.4.19 - vllm/sglang/llama.cpp launch codex/claude/pi/opencode

I'm usually not posting about Harbor releases out of the respect for the community here, but I think v0.4.19 might save a lot of people some time.

Harbor can now launch your local agentic coding tools with local inference backends. For example, to run pi + vllm:

# model downloaded and configured harbor up vllm # Harbor knows that vllm is running and will use it harbor launch pi 

Additionally, launch can proxy requests through built-in optimising LLM gateway which automatically injects and resolves tools, such as web search, so you can add web search to an agent by just appending --web to the command and Harbor will pre-wire everything:

harbor launch --web --model qwen3.5:4b --backend ik_llamacpp mi -p 'Find recent releases of agentic tools and write a two sentence overview' 

You can find many more details in the wiki here:

https://github.com/av/harbor/wiki/3.-Harbor-CLI-Reference#harbor-launch-launch-options---service-servicetool-args

Thank you!

submitted by /u/Everlier
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA