
Reinforcement Learning for LLMs: What the RL Loop Looks Like
If you have worked through policy gradients and deep RL, the language-model post-training landscape looks like a different discipline. RLHF. PPO. DPO.…
Read tutorialLearn how actions become consequences, rewards shape behavior, and agents improve through interaction—from Q-learning and exploration to policy optimization, self-play, robotics, and modern AI.
Turn rewards into intelligent behavior
An agent acts, the environment responds, and experience changes what the agent does next. LearnRLFast turns that cycle into a path through rewards, value, exploration, policies, and modern reinforcement-learning methods. Learn how repeated experience becomes better behavior.
Experience behind the lessons

Joe Chang brings more than 20 years of software engineering experience across startups, research, international banking and FinTech, entrepreneurship, and production systems. A physics graduate of New York University, he has taught more than 1,000 students across machine learning, deep learning, computer vision, reinforcement learning, and large language models. He has also worked with universities and government programs on AI engineering education.
Learning paths
Move from the agent-environment loop into value methods, policy methods, exploration, evaluation, and modern RL algorithms.
See reinforcement learning as a loop of choices and consequences: observations, actions, rewards, returns, policies, and what an agent can know.
Go learning pathTurn experience into expectations about the future with values, Q-values, advantage, Bellman updates, models, planning, and policy improvement.
Go learning pathSee how agents learn by trying: explore, collect experience, assign credit across time, and improve when the environment is unknown.
Go learning pathMove from tables to learned policies with function approximation, policy gradients, actor-critic methods, PPO, preference learning, and deep RL.
Go learning pathFind out whether an agent is actually learning: design environments, choose metrics, diagnose failure, compare baselines, and test generalization.
Go learning pathDiscover what changes when agents share the world: cooperate, compete, communicate, model opponents, assign credit, and improve through self-play.
Go learning pathPush policy learning further with stable updates, entropy, advantage estimation, continuous actions, TRPO, SAC, TD3, and modern actor-critic methods.
Go learning pathFeatured tutorials
These tutorials build the mental models that make later equations and algorithms easier to reason about.

If you have worked through policy gradients and deep RL, the language-model post-training landscape looks like a different discipline. RLHF. PPO. DPO.…
Read tutorial
Most people start reinforcement learning the wrong way. They install a deep RL library, copy a DQN or PPO example, watch the agent fail—or worse, behave…
Read tutorial
That single distinction separates reinforcement learning from every other branch of machine learning—and it explains why these systems learn the way they…
Read tutorialLatest
Fresh lessons on policies, values, exploration, temporal credit, optimization, and practical RL experiments.

Your agent keeps taking an action you already know is wrong. You add a shield. Now you cannot tell whether it is helping or quietly starving the learner.
Read tutorial
A shield that rejects unsafe actions every run can still support no safety claim at all.
Read tutorial
If you've worked through policy gradients, you've felt the problem: one lucky episode can make a mediocre action look brilliant, and the next update swings…
Read tutorial
Set the discount factor to 1 in a continuing task and the return sum diverges. There is nothing finite left for a Bellman equation to solve for. Average…
Read tutorial
Your agent has no finish line. No terminal state ends the run, no episode boundary resets the world, and no natural horizon cuts the future off. You reach…
Read tutorial
Frequency counting answers with a single number and no error bar. It cannot tell you how much evidence you actually have, and it has no place to put what…
Read tutorialLearn how experience becomes better decisions. The Reinforcement Learning Starter Pack takes you from agents, rewards, policies, and value through Bellman reasoning, exploration, temporal-difference learning, Q-learning, practical experiments, deep RL, policy gradients, and reinforcement learning for LLMs—building a guided path from the basic decision loop to modern intelligent systems.
You’ll receive the bundle by email. You can unsubscribe anytime.