Skip to main content
Articles tagged with contextual-bandits | Vitor Sousa
Vitor Sousa
Writing
Projects
Foundations
Start Here
Bits
⌘K
Writing
Projects
Foundations
Start Here
Bits
Toggle theme
Suggested searches
transformers
evaluation
reinforcement learning
contextual bandits
Articles tagged contextual-bandits
Back to blog
→
Nov 21
Deploying Contextual Bandits: Production Guide and Offline Evaluation
Part 5
Systems design, offline evaluation, and monitoring strategies for running contextual bandits safely in production.
24 min
Nov 19
Neural Contextual Bandits for High-Dimensional Data
Part 4
When linear models fail, neural networks step in. Learn when to use neural bandits, how to quantify uncertainty with bootstrap ensembles, and handle high-dimensional action spaces with embeddings and two-stage selection.
~22 min
Nov 17
Implementing Contextual Bandits: Complete Algorithm Guide
Part 3
Complete Python implementations of ε-greedy, UCB, LinUCB, and Thompson Sampling. Learn which algorithm to use for your problem with default hyperparameters and practical tuning guidance.
~25 min
Nov 15
Contextual Bandit Theory: Regret Bounds and Exploration
Part 2
Understand the theory behind contextual bandits: regret bounds, the exploration-exploitation tradeoff, reward models, and why certain algorithms work. Math that directly informs practice.
~18 min
Nov 13
When to Use Contextual Bandits: The Decision Framework
Part 1
Stop running month-long A/B tests that leave value on the table. Learn when contextual bandits are the right choice for adaptive, personalized optimization—and when to stick with simpler alternatives.
~20 min