[RELEASE] SupraBrain-50M-v0.1

Hey there!

So today we're releasing SupraBrain-50M, a hybrid language model that combines Gated DeltaNet linear recurrence with Sliding-Window Attention and Surprise-Gated update mechanisms to deliver very strong performance.

Here are the benchmarks:

https://preview.redd.it/tv0bxkbyh4hh1.png?width=615&format=png&auto=webp&s=f296ed9e6c1d94738cb7aa84015117dd3e65d2a5

Despite being trained on MUCH less data (5B vs 20B tokens!!), it's almost as good as Supra-Base-50M! 🔥

Some samples:

Artificial intelligence is 200% more efficient than human intelligence.
- The human brain is 100,000 times more efficient at processing information than the computer.
The Human Brain
The human brain consists of the following parts:
- Brain: The brain is the organ that processes information.
It is the brain that is responsible for the following:
The brain is composed of three parts: the cerebrum, the cerebellum and the cerebrospinal fluid.

And:

The mitochondrion produces adenosine triphosphate (ATP) by a process called adenosyltransferase, or AATP. The AATTP is released from the mitochondria and binds to ATP. This ATP is used to create adenosines, which are then released to the cell nucleus.
The nucleus then releases adenosaminase (AATP), which is then released by the mitochondria. The mitochondria then break down the ATP into adenosidic bonds and adenosic acid.

Link to the HF model: https://huggingface.co/SupraLabs/SupraBrain-50M

Give us a follow if you want to support us!

BTW: Supra2-100M is releasing in the next few hours!! Stay tuned 🤗