{"id":"arxiv/2608.25743","url":"https://arxiv.org/abs/2608.25743","tags":["math.ST"],"score":0,"title":"Learning of deep neural network regression estimates using gradient descent with pruning","domain":"math.ST","source":"arxiv","authors":["Michael Kohler","Vincent Molinero Römer","Adam Krzyżak"],"reviews":0,"subject":"math.ST","summary":"Estimation of a regression function from independent and identically distributed data is considered. The $L_2$ error with integration with respect to the design variable is used as the error criterion. An initially randomly pruned fully connected deep neural network with logistic squasher as activation function is fitted to the data via gradient descent, using a data-dependent choice of non-constant stepsizes during gradient descent. It is shown that this network achieves (up to a logarithmic factor) the optimal minimax rate of convergence in case that the regression function is…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-08-26","reactions":{}}