[2604.04726] A Muon-Accelerated Algorithm for Low Separation Rank Tensor Generalized Linear Models

Statistics > Machine Learning arXiv:2604.04726 (stat) [Submitted on 6 Apr 2026] Title:A Muon-Accelerated Algorithm for Low Separation Rank Tensor Generalized Linear Models Authors:Xiao Liang, Shuang Li View a PDF of the paper titled A Muon-Accelerated Algorithm for Low Separation Rank Tensor Generalized Linear Models, by Xiao Liang and Shuang Li View PDF HTML (experimental) Abstract:Tensor-valued data arise naturally in multidimensional signal and imaging problems, such as biomedical imaging. When incorporated into generalized linear models (GLMs), naive vectorization can destroy their multi-way structure and lead to high-dimensional, ill-posed estimation. To address this challenge, Low Separation Rank (LSR) decompositions reduce model complexity by imposing low-rank multilinear structure on the coefficient tensor. A representative approach for estimating LSR-based tensor GLMs (LSR-TGLMs) is the Low Separation Rank Tensor Regression (LSRTR) algorithm, which adopts block coordinate descent and enforces orthogonality of the factor matrices through repeated QR-based projections. However, the repeated projection steps can be computationally demanding and slow convergence. Motivated by the need for scalable estimation and classification from such data, we propose LSRTR-M, which incorporates Muon (MomentUm Orthogonalized by Newton-Schulz) updates into the LSRTR framework. Specifically, LSRTR-M preserves the original block coordinate scheme while replacing the projection-based fa...