[BIG DATASET RELEASE] - SupraLabs/reasoning-corpus-4K-5M-v1 - Train your tiny SLMs to think!

https://preview.redd.it/b7ybs7nqx5fh1.png?width=3440&format=png&auto=webp&s=e6aaaa15cbe59debaae1ebb7fcd708167e86dc35

Hey r/LocalLLaMA !

We are back and we have something really amazing today.

Our big 5M samples Reasoning Corpus dataset.

This dataset features 5 million rows of:

- repo_id --> where it's from
- tok_len --> how many tokens it is in total
- user --> the user promot
- thought_trace --> the exact chain-of-thought of the model
- assistant --> the final AI models' answer
- ChatML --> the user, thought_trace and assistant in ChatML format

All samples are within a 5k sequence length to make it fit perfectly for SFT/finetuning a tiny model.

Link to the dataset on Hugging Face 🤗:
https://huggingface.co/datasets/SupraLabs/reasoning-corpus-4K-5M-v1

Link to the SupraLabs Hugging Face org 🤗:
https://huggingface.co/SupraLabs

Also, if you want to support our work, give us a follow on Hugging Face, share and review our work, and give us as much feedback as you want ❤️🔥🤗 Already more 250 people are trusting in us and our work!

We hope, this dataset is useful for you all and we'd love to see your creations upon this.

This dataset has already >1k downloads and over 80 likes - be the next one to use it 🔥🎉