How do you guys setup search with your AI models?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Been selfhosting my models for a while and I'd really like to integrate Gemma 4 12B as a simple voice assistant with search capabilities.
I've tried using openwebui but the search is kind of broken with DDG and I really don't want to use API keys from Brave or Google etc.
So what do you actually use? How do you set it up and wire it to your model?
I'm currently using llamacpp container with docker compose on fedora Linux.
[link] [comments]
More from r/LocalLLaMA
-
Been running Qwen3.6-27B through a 3-critic harness. The harness matters more than I thought
Jun 30
-
I Hate Dario Amodei, and everything he stands for.
Jun 29
-
Introducing LongCat-2.0 - , a large-scale MoE language model with 1.6 trillion total parameters and ~48 billion activated per token. This was the stealth model that was on Openrouter under the name 'owl-alpha'.
Jun 29
-
Krea-2-Turbo Image Model - Easy to be fully uncensored, but it can also EDIT Images!
Jun 29
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.