I trained a TINY Reasoning Language Model from scratch with RL | Chapter 4, SLM Training

In RL, we will input a prompt to a model, get it to generate a response, and then inform it whether it was correct or incorrect. The model collects tons and tons of experiences like this, and learns from this feedback about how to respond to prompts correctly... meaning which responses tend to give it the highest scores. In this video, we do all that but for freeform language generation tasks - question answering, fact generation, knowledge graph triplets. Follow me on Twitter: https://x.com/neural_avb To join our Patreon, visit: https://www.patreon.com/NeuralBreakdownwithAVB Members get acc