Llama Studio v0.2.0

I have made an update to my llama-server WebUI based on some awesome feedback and interaction with the community.

1) JSON model config replaced by per-model shell scripts. Run from CLI, paste from unsloth, email to your buddy or post to reddit: Using real shell scripts to store config is superior in every way. And if you don't care about the shell and just want clicky WebUI - All good, the full functionality of the WebUI remains perfectly as it has always been.

2) Splitting across GPU. Done! If tensor-split is detected, you now get to choose which GPUs to split to, and it is retained in the shell script / config for future runs.

3) Session store and autoload on start. Once you have your setup all nice and tuned, store it with the handy dandy button at the top of the page and optionally autoload your models on next startup. Great for headless servers like my own frankenserver frank.local.

And if you are not familiar with the project, it is a simple webserver that manages llama-server instances through a WebUI. Free and open source, hacking encouraged!

https://github.com/m94301/llama-studio