Blog

Projects

Tools I have built for research.

Research Manager ↗ Oct 2026 A shared research memory for you and your AI agents: claims, experiments and evidence as Markdown, with an MCP server for agents. ToolsAI agents

Tutorials

Slides from tutorials I have given.

How Wrong Can Your Critic Be? Offline RL via the Evaluation Gap Jul 2026 Rethinking distribution shift in offline RL through the policy evaluation gap. Slides from my ICML 2026 talk. Reinforcement learningOffline RL Flow Matching Policy Feb 2026 Flow matching and diffusion from probability paths to score matching, and how to train flow-based RL policies. Reinforcement learningGenerative models Offline Reinforcement Learning Nov 2025 Why distribution shift makes offline RL hard, the main families of methods (ReBRAC, DICE, IQL), and practical advice. Reinforcement learningOffline RL