![[2602.14526] TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations](https://arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png){kind=logo}
[2602.14526] TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations
Summary
The paper presents TWISTED-RL, a novel framework for robotic knot-tying that enhances performance without human demonstrations by utilizing hierarchical agents and multi-step reinforcement learning.
Why It Matters
Robotic knot-tying is a significant challenge in robotics, impacting applications in various fields such as rescue operations and automated manufacturing. TWISTED-RL's advancements could lead to more efficient and versatile robotic systems capable of handling complex tasks autonomously.
Key Takeaways
- TWISTED-RL improves upon previous knot-tying frameworks by using hierarchical agents.
- The framework employs multi-step reinforcement learning for better generalization.
- Experimental results show improved success rates for complex knots like Figure-8 and Overhand.
- TWISTED-RL reduces planning time significantly compared to earlier methods.
- This research sets a new benchmark in demonstration-free robotic knot-tying.
Computer Science > Robotics arXiv:2602.14526 (cs) [Submitted on 16 Feb 2026] Title:TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations Authors:Guy Freund, Tom Jurgenson, Matan Sudry, Erez Karpas View a PDF of the paper titled TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations, by Guy Freund and 3 other authors View PDF HTML (experimental) Abstract:Robotic knot-tying represents a fundamental challenge in robotics due to the complex interactions between deformable objects and strict topological constraints. We present TWISTED-RL, a framework that improves upon the previous state-of-the-art in demonstration-free knot-tying (TWISTED), which smartly decomposed a single knot-tying problem into manageable subproblems, each addressed by a specialized agent. Our approach replaces TWISTED's single-step inverse model that was learned via supervised learning with a multi-step Reinforcement Learning policy conditioned on abstract topological actions rather than goal states. This change allows more delicate topological state transitions while avoiding costly and ineffective data collection protocols, thus enabling better generalization across diverse knot configurations. Experimental results demonstrate that TWISTED-RL manages to solve previously unattainable knots of higher complexity, including commonly used knots such as the Figure-8 and the Overhand. Furthermore, the increase in success rates and drop in planning time ...
