I built Kivarro, an open-source Rust/Tauri local LLM inference workbench. Looking for r/LocalLLaMA testers.

Hey r/LocalLLaMA, I’m the creator of Kivarro.

It’s an open-source local model inference workbench built with Rust/Tauri, focused on running GGUF models locally with llama.cpp, profile switching, model registry, runtime controls, local API status, logs, benchmarks, and a command-center style UI.

I built it because most local inference tools either hide too much runtime control or feel rough when switching profiles/models. Kivarro is still early, so I’m releasing it as v0.1 alpha and looking for real feedback from people who run local models daily.

What works:
- GGUF model registry
- llama.cpp engine start/stop/restart
- prompt profiles like Balanced, JSON extraction, code review, long context
- runtime tuning controls
- local API status
- logs, benchmarks, hardware/memory readouts
- Windows build right now

Known limitations:
- It is early alpha
- macOS/Linux packaging still needs more real-world testing
- Some models/settings may need tuning depending on RAM/VRAM

Repo: https://github.com/AKMessi/kivarro

Demo video is attached.

I’d appreciate brutal feedback: what feels missing, what settings are wrong, what would make this actually useful for your local workflow?