[2604.04963] Learning Nonlinear Regime Transitions via Semi-Parametric State-Space Models

Statistics > Machine Learning arXiv:2604.04963 (stat) [Submitted on 3 Apr 2026] Title:Learning Nonlinear Regime Transitions via Semi-Parametric State-Space Models Authors:Prakul Sunil Hiremath View a PDF of the paper titled Learning Nonlinear Regime Transitions via Semi-Parametric State-Space Models, by Prakul Sunil Hiremath View PDF HTML (experimental) Abstract:We develop a semi-parametric state-space model for time-series data with latent regime transitions. Classical Markov-switching models use fixed parametric transition functions, such as logistic or probit links, which restrict flexibility when transitions depend on nonlinear and context-dependent effects. We replace this assumption with learned functions $f_0, f_1 \in \calH$, where $\calH$ is either a reproducing kernel Hilbert space or a spline approximation space, and define transition probabilities as $p_{jk,t} = \sigmoid(f(\bx_{t-1}))$. The transition functions are estimated jointly with emission parameters using a generalized Expectation-Maximization algorithm. The E-step uses the standard forward-backward recursion, while the M-step reduces to a penalized regression problem with weights from smoothed occupation measures. We establish identifiability conditions and provide a consistency argument for the resulting estimators. Experiments on synthetic data show improved recovery of nonlinear transition dynamics compared to parametric baselines. An empirical study on financial time series demonstrates improved reg...