[RELEASE] Supra-Router-51M - a tiny prompt routing model/orchestrator
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| Hey r/LocalLLaMA ! SupraLabs is back with a new model. Supra-Router-51M. Basically, this is a model which is made for routing requests to smaller or bigger models - based on the user prompt/request. This is so cool, because it has only 51M parameters and so it can be used in low-latency environments. Here are some samples: Link to the HF Hub model: https://huggingface.co/SupraLabs/Supra-Router-51M With this model, we also shipped a dataset (which we trained our model on!): https://huggingface.co/datasets/SupraLabs/Prompt-Routing-Dataset Have fun! Feel free to give us feedback! ❤️ 🤗 [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.