TRL v1.0: Post-Training Library Built to Move with the Field

Back to Articles TRL v1.0: Post-Training Library Built to Move with the Field Published March 31, 2026 Update on GitHub Upvote 2 Quentin Gallouédec qgallouedec Follow Steven Liu stevhliu Follow Pedro Cuenca pcuenq Follow Sergio Paniego sergiopaniego Follow We’re releasing TRL v1.0, and it marks a real shift in what TRL is. What started as a research codebase has become a dependable library people build on, with clearer expectations around stability. This isn't just a version bump. It reflects the reality that TRL now powers production systems, and embraces that responsibility. TRL now implements more than 75 post-training methods. But coverage isn’t the goal by itself. What matters is making these methods easy to try, compare, and actually use in practice. The design of the library wasn’t decided upfront. It is the result of years of iteration — the first commit goes back more than six years — and it has been shaped by everything the field threw at it: new algorithms, new models, shifting paradigms. Over time, this pressure forced the codebase toward a very specific design. Parts of it might look unusual at first, but like in many evolutionary codebases, they exist for a reason. TRL is built for a field that doesn’t sit still. So the question is not how to design the perfect abstraction. It is how to make stable software in a domain that keeps invalidating its own assumptions. This is what we tried to solve in TRL v1.0, and this post explains how. 1. A moving target: post-...