Maarten Grootendorst · · 3 min read

The Story Behind the "RAG Pack"

Mirrored from Maarten Grootendorst for archival readability. Support the source by reading on the original site.

It’s been a while since I published a visual guide, but that was for good reasons!

I’m excited to announce that I have been working together with some of the best educators in the field to create a course:

Reinforcement Learning for Large Language Models

TIP: If you make it to the end of the post, you can find a little gift there ;)

This has been (and still is!) an incredible experience, and I wanted to share it with you all 🤩

But that’s not all… Since we had so much fun working together (and if the course is successful), we want to do this more often.

Which is why I’m happy to introduce the RAG Pack!

The “RAG Pack”

The story, as Luis likes to tell it, is that one of had the idea to make a course, which the rest of us thought was an incredible idea to start working together.

I don’t remember if I actually said “WOOHOO!” but I’m sure if have heard Josh said “BAM!”.

This idea of a course slowly started to evolve into a collaboration that might just outgrow this first time working together.

We wanted to signify our collaboration with something more than just a one-time collaboration…

We decided to make it official and named ourselves the “RAG Pack”!

It is an ongoing discussion what came first, the “Rat Pack” or the “RAG Pack”. It is obviously us, but some might disagree…

Who Are the “RAG Pack”?

The five of us are AI educators that have been around for a while now helping you learn these complex subjects.

Let me introduce you to everyone:

We are doing this with our full attention and expertise, and want this to succeed. That said… we also have way too much working together and learning from each other’s work.

This is quite evident by the crazy images we all share of each other:

Quite impressive how Josh is holding on!

Now, it might sound as if the “RAG Pack” is here to stay and if I’m being honest, I would love nothing more. However, we have to be realistic here and first check with the community if this is something that is viable.

We poured our respective expertise and knowledge into this course to see if what we think is something special, will be a shared opinion amongst you all.

If the course ends up being a success, we would love for the “RAG Pack” to continue creating insightful content!

Course: RL for LLMs

Our first act as the “RAG Pack” is the course we spend the last few months working on:

Reinforcement Learning for Large Language Models

If you know any of our work, then you can expect:

  • A HUGE amount of visuals detailing the inner workings of common principles in Reinforcement Learning

  • An intuition-first philosophy — we care about you understanding the material rather than memorizing formulas

  • Learning from multiple perspectives (code, visuals, formulas, and more!)

  • A tight-knit community of like-minded people

  • A group of teachers with a strong tendency to give back to the wonderful community

  • But most importantly, a fun time learning!

The course will consists of five modules and end with a QA where we will all come together and answer any questions you might have:

You made it!

To those that made it to the end, congratulations! You deserve a gift:

🔥TIP: You can get 50% off by using the code FINETUNE50

And of course, we did not forget about you students:

Subscribe now

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Maarten Grootendorst