Build A Reasoning Model From Scratch 5: Inference Scaling 2 (Logprob Scoring, Self-Refinement)
This second video on inference-time scaling, introduces different scoring functions to break ties in majority voting and also introduces self-refinement.
- Reasoning playlist: https://www.youtube.com/watch?v=Kh9mqTzjuEQ&list=PLfrHAQCRxtUs
- Reasoning Book: https://amzn.to/4aAKiFY
- Reasoning GitHub repo: https://github.com/rasbt/reasoning-from-scratch
- LLMs from Scratch book: https://amzn.to/4fqvn0D
- LLMs from Scratch repo: https://github.com/rasbt/LLMs-from-scratch
- LLMs from Scratch playlist: https://www.youtube.com/watch?v=yAcWnfsZhzo&list=PLTKMiZHVd_2IIEsoJrWACkIxLRdfMlw11&index=1
0