[2602.15820] Stabilizing Test-Time Adaptation of High-Dimensional Simulation Surrogates via D-Optimal Statistics

[2602.15820] Stabilizing Test-Time Adaptation of High-Dimensional Simulation Surrogates via D-Optimal Statistics

arXiv - Machine Learning 3 min read Article

Summary

This article presents a framework for Test-Time Adaptation (TTA) of high-dimensional simulation surrogates using D-optimal statistics, addressing performance degradation due to distribution shifts during deployment.

Why It Matters

As machine learning surrogates become integral in engineering simulations, their reliability under varying conditions is crucial. This research introduces a novel TTA approach that enhances stability and performance in high-dimensional settings, potentially transforming practices in simulation and design optimization.

Key Takeaways

  • Proposes a TTA framework that uses D-optimal statistics for better adaptation.
  • Addresses performance issues in high-dimensional simulation surrogates.
  • Demonstrates up to 7% improvement in out-of-distribution performance.
  • Validates the method on established benchmarks like SIMSHIFT and EngiBench.
  • Highlights the importance of stable adaptation in engineering applications.

Computer Science > Machine Learning arXiv:2602.15820 (cs) [Submitted on 17 Feb 2026] Title:Stabilizing Test-Time Adaptation of High-Dimensional Simulation Surrogates via D-Optimal Statistics Authors:Anna Zimmel, Paul Setinek, Gianluca Galletti, Johannes Brandstetter, Werner Zellinger View a PDF of the paper titled Stabilizing Test-Time Adaptation of High-Dimensional Simulation Surrogates via D-Optimal Statistics, by Anna Zimmel and 4 other authors View PDF Abstract:Machine learning surrogates are increasingly used in engineering to accelerate costly simulations, yet distribution shifts between training and deployment often cause severe performance degradation (e.g., unseen geometries or configurations). Test-Time Adaptation (TTA) can mitigate such shifts, but existing methods are largely developed for lower-dimensional classification with structured outputs and visually aligned input-output relationships, making them unstable for the high-dimensional, unstructured and regression problems common in simulation. We address this challenge by proposing a TTA framework based on storing maximally informative (D-optimal) statistics, which jointly enables stable adaptation and principled parameter selection at test time. When applied to pretrained simulation surrogates, our method yields up to 7% out-of-distribution improvements at negligible computational cost. To the best of our knowledge, this is the first systematic demonstration of effective TTA for high-dimensional simulation...

Related Articles

Machine Learning

[P] PCA before truncation makes non-Matryoshka embeddings compressible: results on BGE-M3 [P]

Most embedding models are not Matryoshka-trained, so naive dimension truncation tends to destroy them. I tested a simple alternative: fit...

Reddit - Machine Learning · 1 min ·
Machine Learning

Looking for Feedback & Improvement Ideas[P]

Hey everyone, I recently built a machine learning project and would really appreciate some honest feedback from this community. LINK- htt...

Reddit - Machine Learning · 1 min ·
Machine Learning

Why Anthropic’s new model has cybersecurity experts rattled

submitted by /u/ThereWas [link] [comments]

Reddit - Artificial Intelligence · 1 min ·
Machine Learning

AI Systems Performance Engineering by Chris Fregly - is it worth it? [D]

I found this book "AI Systems Performance Engineering" by Chris Fregly [1]. There is another book "Machine Learning Systems" by harvard [...

Reddit - Machine Learning · 1 min ·
More in Machine Learning: This Week Guide Trending

No comments

No comments yet. Be the first to comment!

Stay updated with AI News

Get the latest news, tools, and insights delivered to your inbox.

Daily or weekly digest • Unsubscribe anytime