[2603.02275] A Comparative Study of UMAP and Other Dimensionality Reduction Methods

Computer Science > Machine Learning arXiv:2603.02275 (cs) [Submitted on 1 Mar 2026] Title:A Comparative Study of UMAP and Other Dimensionality Reduction Methods Authors:Guanzhe Zhang, Shanshan Ding, Zhezhen Jin View a PDF of the paper titled A Comparative Study of UMAP and Other Dimensionality Reduction Methods, by Guanzhe Zhang and 2 other authors View PDF HTML (experimental) Abstract:Uniform Manifold Approximation and Projection (UMAP) is a widely used manifold learning technique for dimensionality reduction. This paper studies UMAP, supervised UMAP, and several competing dimensionality reduction methods, including Principal Component Analysis (PCA), Kernel PCA, Sliced Inverse Regression (SIR), Kernel SIR, and t-distributed Stochastic Neighbor Embedding, through a comprehensive comparative analysis. Although UMAP has attracted substantial attention for preserving local and global structures, its supervised extensions, particularly for regression settings, remain rather underexplored. We provide a systematic evaluation of supervised UMAP for both regression and classification using simulated and real datasets, with performance assessed via predictive accuracy on low-dimensional embeddings. Our results show that supervised UMAP performs well for classification but exhibits limitations in effectively incorporating response information for regression, highlighting an important direction for future development. Comments: Subjects: Machine Learning (cs.LG); Applications (stat....