{"id":"arxiv/2603.09589","url":"https://arxiv.org/abs/2603.09589","tags":["cs.LG","math.NA"],"score":0,"title":"Memorization capacity of deep ReLU neural networks characterized by width and depth","domain":"cs.LG","source":"arxiv","authors":["Xin Yang","Yunfei Yang"],"reviews":0,"subject":"cs.LG","summary":"This paper studies the memorization capacity of deep neural networks with ReLU activation. Specifically, we investigate the minimal size of such networks to memorize any $N$ data points in the unit ball with pairwise separation distance $δ$ and discrete labels. Most prior studies characterize the memorization capacity by the number of parameters or neurons. We generalize these results by constructing neural networks, whose width $W$ and depth $L$ satisfy $W^2L^2= \\mathcal{O}(N\\log(δ^{-1}))$, that can memorize any $N$ data samples. We also prove that any such networks should also satisfy the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-10","reactions":{}}