r/LocalLLaMA · · 1 min read

[NEW MODEL] Supra-Title-0.3B Just released!

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

[NEW MODEL] Supra-Title-0.3B Just released!

Supra Title is live! 🦅

We just released Supra Title (experimental), a purpose-built 350M model for generating chat conversation titles, built on LFM2.5-350M.

https://huggingface.co/SupraLabs/Supra-Title-350M-exp-GGUF

https://huggingface.co/SupraLabs

Most platforms use large general-purpose models to title conversations. Supra Title does only that, and does it fast, in GGUF format, on any hardware.

No system prompt needed. Just send the user message and get a title back.

Examples:

User message Title
bruh my wifi keeps disconnecting every 10 minutes 😭 WiFi Issues
what's the easiest way to make fluffy pancakes? Fluffy Pancakes
can someone explain taxes to me like i'm five Understanding Taxes
I am so dumb brooo Understanding The Person Who Thinks It's Dumb

Quick start:

llama serve -hf SupraLabs/Supra-Title-350M-exp-GGUF:Q6_K 

Available from Q2 (177 MB) to BF16 (711 MB). Q8_0 or Q6_K recommended.

This is an experimental release. We are expanding the SFT dataset and exploring preference optimization before a full release.

Feedback welcome!

submitted by /u/Dangerous_Try3619
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA