[2603.25047] The Order Is The Message

Computer Science > Machine Learning arXiv:2603.25047 (cs) [Submitted on 24 Mar 2026] Title:The Order Is The Message Authors:Jordan LeDoux View a PDF of the paper titled The Order Is The Message, by Jordan LeDoux View PDF HTML (experimental) Abstract:In a controlled experiment on modular arithmetic ($p = 9973$), varying only example ordering while holding all else constant, two fixed-ordering strategies achieve 99.5\% test accuracy by epochs 487 and 659 respectively from a training set comprising 0.3\% of the input space, well below established sample complexity lower bounds for this task under IID ordering. The IID baseline achieves 0.30\% after 5{,}000 epochs from identical data. An adversarially structured ordering suppresses learning entirely. The generalizing model reliably constructs a Fourier representation whose fundamental frequency is the Fourier dual of the ordering structure, encoding information present in no individual training example, with the same fundamental emerging across all seeds tested regardless of initialization or training set composition. We discuss implications for training efficiency, the reinterpretation of grokking, and the safety risks of a channel that evades all content-level auditing. Comments: Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML) Cite as: arXiv:2603.25047 [cs.LG]   (or arXiv:2603.25047v1 [cs.LG] for this version)   https://doi.org/10.48550/arXiv.2603.25047 Focus to learn more arXiv-issued DOI via DataCite (pendin...