Skip to main content
Articles tagged with machine-learning-theory | Vitor Sousa
Vitor Sousa
Writing
Projects
Foundations
Start Here
Bits
⌘K
Writing
Projects
Foundations
Start Here
Bits
Toggle theme
Suggested searches
transformers
evaluation
reinforcement learning
contextual bandits
Articles tagged machine-learning-theory
Back to blog
→
Jan 11
Reinforcement Learning Foundations for LLM Alignment
Part 1
Master the RL fundamentals powering modern LLM training: from MDPs and policy gradients through value functions and actor-critic methods. The mathematical foundations you need before diving into PPO, GRPO, and beyond.
~35 min
Nov 15
Contextual Bandit Theory: Regret Bounds and Exploration
Part 2
Understand the theory behind contextual bandits: regret bounds, the exploration-exploitation tradeoff, reward models, and why certain algorithms work. Math that directly informs practice.
~18 min