{"id":"arxiv/2604.23017","url":"https://arxiv.org/abs/2604.23017","tags":["cs.LG","math.CV","math.NA"],"score":0,"title":"Complex Stochastic Gradient Descent and Directional Bias in Reproducing Kernel Hilbert Spaces","domain":"cs.LG","source":"arxiv","authors":["Natanael Alpay","Emeric Battaglia"],"reviews":0,"subject":"cs.LG","summary":"Stochastic Gradient Descent (SGD) is a known stochastic iterative method popular for large-scale convex optimization problems due to its simple implementation and scalability. Some objectives, such as those found in complex-valued neural networks, benefit from updates like in SGD and Gradient Descent (GD) with a newly defined ``gradient'' that allows for complex parameters. This complex variant of the SGD/GD methods has already been proposed, but convergence guarantees without analyticity constraints have not yet been provided. We propose a variant of SGD (complex SGD) that allows for…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-24","reactions":{}}