Articles tagged with deep-learning | Vitor Sousa

Vitor Sousa

Articles tagged deep-learning

Back to blog
PPO for Language Models: The RLHF Workhorse Part 2 Deep dive into Proximal Policy Optimization—the algorithm behind most LLM alignment. Understand trust regions, the clipped objective, GAE, and why PPO's four-model architecture creates problems at scale. ~28 min
Reinforcement Learning Foundations for LLM Alignment Part 1 Master the RL fundamentals powering modern LLM training: from MDPs and policy gradients through value functions and actor-critic methods. The mathematical foundations you need before diving into PPO, GRPO, and beyond. ~35 min
Neural Contextual Bandits for High-Dimensional Data Part 4 When linear models fail, neural networks step in. Learn when to use neural bandits, how to quantify uncertainty with bootstrap ensembles, and handle high-dimensional action spaces with embeddings and two-stage selection. ~22 min