{"id":"arxiv/2609.03170","url":"https://arxiv.org/abs/2609.03170","tags":["math.OC"],"score":0,"title":"Gradient-Free Optimization for Matrix functions","domain":"math.OC","source":"arxiv","authors":["Sawyer Allen","Cash Cherry","Aidan Eck","Stephen Becker","Daniel McKenzie"],"reviews":0,"subject":"math.OC","summary":"We consider the task of optimizing smooth, possibly non-convex functions of a matrix variable given access only to directional derivatives rather than full gradients. This setting arises when fine-tuning large neural networks on consumer-grade hardware: the network's weights are matrices, memory constraints rule out backward-mode automatic differentiation, but directional derivatives remain available through forward mode. We frame gradient estimation in this setting as a structured recovery problem, in the spirit of signal processing. From this perspective we provide three contributions.…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-09-02","reactions":{}}