{"id":"arxiv/2607.03347","url":"https://arxiv.org/abs/2607.03347","tags":["cs.LG","math.ST"],"score":0,"title":"The Multiscale Single-Index Model: A Stylized Model for Hierarchical Feature Learning","domain":"cs.LG","source":"arxiv","authors":["Joan Bruna"],"reviews":0,"subject":"cs.LG","summary":"We consider the Multiscale Single-Index Model (MSIM), first introduced in \\cite{oymak2021learning}, as a stylized model for hierarchical learning with \\emph{scale separation}. Each layer extracts a shared single-index feature at one physical scale and passes it to the next, thus defining a tractable setting in which to study how deep architectures learn multiscale representations. Under non-degeneracy and delocalization assumptions on the link function and planted features respectively, for fixed depth $K$ and local scale $d$, the first Wiener chaos of the target behaves as a perturbed…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-03","reactions":{}}