[2604.03297] XAttnRes: Cross-Stage Attention Residuals for Medical Image Segmentation

Computer Science > Computer Vision and Pattern Recognition arXiv:2604.03297 (cs) [Submitted on 28 Mar 2026] Title:XAttnRes: Cross-Stage Attention Residuals for Medical Image Segmentation Authors:Xinyu Liu, Qing Xu, Zhen Chen View a PDF of the paper titled XAttnRes: Cross-Stage Attention Residuals for Medical Image Segmentation, by Xinyu Liu and 2 other authors View PDF HTML (experimental) Abstract:In the field of Large Language Models (LLMs), Attention Residuals have recently demonstrated that learned, selective aggregation over all preceding layer outputs can outperform fixed residual connections. We propose Cross-Stage Attention Residuals (XAttnRes), a mechanism that maintains a global feature history pool accumulating both encoder and decoder stage outputs. Through lightweight pseudo-query attention, each stage selectively aggregates from all preceding representations. To bridge the gap between the same-dimensional Transformer layers in LLMs and the multi-scale encoder-decoder stages in segmentation networks, XAttnRes introduces spatial alignment and channel projection steps that handle cross-resolution features with negligible overhead. When added to existing segmentation networks, XAttnRes consistently improves performance across four datasets and three imaging modalities. We further observe that XAttnRes alone, even without skip connections, achieves performance on par with the baseline, suggesting that learned aggregation can recover the inter-stage information flow...