{"id":"arxiv/2604.09263","url":"https://arxiv.org/abs/2604.09263","tags":["math.OC","cs.LG","math.NA"],"score":0,"title":"Natural Riemannian gradient for learning functional tensor networks","domain":"math.OC","source":"arxiv","authors":["Nikolas Klug","Michael Ulbrich","André Uschmajew","Marius Willner"],"reviews":0,"subject":"math.OC","summary":"We consider machine learning tasks with low-rank functional tree tensor networks (TTN) as the learning model. While in the case of least-squares regression, low-rank functional TTNs can be efficiently optimized using alternating optimization, this is not directly possible in other problems, such as multinomial logistic regression. We propose a natural Riemannian gradient descent type approach applicable to arbitrary losses which is based on the natural gradient by Amari. In particular, the search direction obtained by the natural gradient is independent of the choice of basis of the…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-10","reactions":{}}