r/LocalLLaMA · · 1 min read

[RELEASE] Supra-Router-51M - a tiny prompt routing model/orchestrator

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

[RELEASE] Supra-Router-51M - a tiny prompt routing model/orchestrator

Hey r/LocalLLaMA !

SupraLabs is back with a new model. Supra-Router-51M.

Basically, this is a model which is made for routing requests to smaller or bigger models - based on the user prompt/request. This is so cool, because it has only 51M parameters and so it can be used in low-latency environments.

Here are some samples:

Samples

Link to the HF Hub model: https://huggingface.co/SupraLabs/Supra-Router-51M

With this model, we also shipped a dataset (which we trained our model on!): https://huggingface.co/datasets/SupraLabs/Prompt-Routing-Dataset

Have fun! Feel free to give us feedback! ❤️ 🤗

submitted by /u/LH-Tech_AI
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA