[2603.03973] Dual-Solver: A Generalized ODE Solver for Diffusion Models with Dual Prediction

Computer Science > Machine Learning arXiv:2603.03973 (cs) [Submitted on 4 Mar 2026] Title:Dual-Solver: A Generalized ODE Solver for Diffusion Models with Dual Prediction Authors:Soochul Park, Yeon Ju Lee View a PDF of the paper titled Dual-Solver: A Generalized ODE Solver for Diffusion Models with Dual Prediction, by Soochul Park and Yeon Ju Lee View PDF HTML (experimental) Abstract:Diffusion models achieve state-of-the-art image quality. However, sampling is costly at inference time because it requires a large number of function evaluations (NFEs). To reduce NFEs, classical ODE numerical methods have been adopted. Yet, the choice of prediction type and integration domain leads to different sampling behaviors. To address these issues, we introduce Dual-Solver, which generalizes multistep samplers through learnable parameters that continuously (i) interpolate among prediction types, (ii) select the integration domain, and (iii) adjust the residual terms. It retains the standard predictor-corrector structure while preserving second-order local accuracy. These parameters are learned via a classification-based objective using a frozen pretrained classifier (e.g., MobileNet or CLIP). For ImageNet class-conditional generation (DiT, GM-DiT) and text-to-image generation (SANA, PixArt-$\alpha$), Dual-Solver improves FID and CLIP scores in the low-NFE regime ($3 \le$ NFE $\le 9$) across backbones. Comments: Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition ...