[2603.01047] Evaluating GFlowNet from partial episodes for stable and flexible policy-based training

Computer Science > Machine Learning arXiv:2603.01047 (cs) [Submitted on 1 Mar 2026] Title:Evaluating GFlowNet from partial episodes for stable and flexible policy-based training Authors:Puhua Niu, Shili Wu, Xiaoning Qian View a PDF of the paper titled Evaluating GFlowNet from partial episodes for stable and flexible policy-based training, by Puhua Niu and 2 other authors View PDF HTML (experimental) Abstract:Generative Flow Networks (GFlowNets) were developed to learn policies for efficiently sampling combinatorial candidates by interpreting their generative processes as trajectories in directed acyclic graphs. In the value-based training workflow, the objective is to enforce the balance over partial episodes between the flows of the learned policy and the estimated flows of the desired policy, implicitly encouraging policy divergence minimization. The policy-based strategy alternates between estimating the policy divergence and updating the policy, but reliable estimation of the divergence under directed acyclic graphs remains a major challenge. This work bridges the two perspectives by showing that flow balance also yields a principled policy evaluator that measures the divergence, and an evaluation balance objective over partial episodes is proposed for learning the evaluator. As demonstrated on both synthetic and real-world tasks, evaluation balance not only strengthens the reliability of policy-based training but also broadens its flexibility by seamlessly supporting ...