llama-launcher Release
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | Hello everyone, I've been working on a point and click GUI to make tinkering with llama-server flags much quicker and easier, I thought I'd share for anyone else who might be interested. It's also great for anyone new to llama.cpp that is looking to get into it and doesn't want to deal with the terminal yet. My aim was to make it quite simple and bare-bones so that's why it might look a little bland, didn't really see the point of making it look decent with a nice colour scheme or anything for something so simple. I'll be adding more and more flags/options to it as I come across them, I only added the ones I find myself using regularly for now. Please let me know what you guys think and any improvements you have in mind! [link] [comments] |
More from r/LocalLLaMA
-
I bundled a fully local LLM inside my Unity game. No internet, no cloud, no API key. The conversation is the gameplay.
Jun 8
-
Xiaomi just claimed 1,000+ tps on a 1T model using a standard 8-GPU server
Jun 8
-
Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax
Jun 8
-
OpenEnv is now owned by HF, Torch, Prime Intellect, Unsloth, Modal, Mercor, and more! Use it for training agents.
Jun 8
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.