I Trained Qwen 4B With RL to Catch Qwen 27B

Can RL Make a 4B Model Compete with 27B? My Open RL Environment Experiments (GRPO, LoRA, DGX) In this video I test whether open-source RL environments can make a small model perform closer to a much larger one by training Qwen 3.5 4B (with a LoRA) against Kaggle-style “small data” RL tasks on two DGX Sparks and comparing to Qwen 27B on a held-out exam. I explain what RL environments are (sandbox, tools, checker), why you need a strict checker to avoid reward hacking, and how GRPO works and only learns from tasks the model sometimes gets right. After weak gains from random tasks, I filter for