I made a simple tool to manage llamacpp instances (Metallama)

*Disclaimer*: This post showcase a personnal project. (Free Open Source). Hopefully im not bothering by posting this.

I was tired of juggling terminals, manual GGUF downloads and changing inference parameters,
so I made a web UI tool for helping doing all that.

Here is some cool features (in my opinion):

• Search and download GGUFs from hugging face api
• Configure, spawn and monitor llamacpp servers
• Manage model weights library from the UI
• Ollama compatible proxy gateway (/ollama)
• Monitor RAM / VRAM usage of the host
• Plug remote llamacpp server under the ollama proxy (/models)
• Estimate total memory footprint of an instance (WIP)

Its pretty simple to use. Stack is Python FastAPI + vanilla HTML/CSS/JS. No build.

Here is the repo: https://github.com/roackim/metallama
Would be cool to have some feedback or feature ideas.

Licensed under Apache 2.0

*Disclaimer*: This project has been largely vibe coded, especially the web UI, as I am not a webdev. (Logo made by hands though !)

Cheers !