llama.cpp now supports model management (downloading etc) via API

#23976 got merged a couple hours ago, which means llama.cpp can now not only load/unload models on demand from a directory, but also download them on demand. No UI yet, but that's coming pretty soon.

This means you can now deploy llama.cpp, expose the API, and manage the complete lifecycle using it and nothing else.