{"id":"arxiv/2604.00543","url":"https://arxiv.org/abs/2604.00543","tags":["math.DS","cs.LG"],"score":0,"title":"Activation Saturation and Floquet Spectrum Collapse in Neural ODEs","domain":"math.DS","source":"arxiv","authors":["Nikolaos M. Matzakos"],"reviews":0,"subject":"math.DS","summary":"We prove that activation saturation imposes a structural dynamical limitation on autonomous Neural ODEs $\\dot{h}=f_θ(h)$ with saturating activations ($\\tanh$, sigmoid, etc.): if $q$ hidden layers of the MLP $f_θ$ satisfy $|σ'|\\leδ$ on a region~$U$, the input Jacobian is attenuated as $\\norm{Df_θ(x)}\\le C(U)$ (for activations with $\\sup_{x}|σ'(x)|\\le 1$, e.g.\\ $\\tanh$ and sigmoid, this reduces to $C_Wδ^q$), forcing every Floquet (Lyapunov) exponen along any $T$-periodic orbit $γ\\subset U$ into the interval $[-C(U),\\;C(U)]$. This is a collapse of the Floquet spectrum: as saturation deepens…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-01","reactions":{}}