{"id":"arxiv/2603.21091","url":"https://arxiv.org/abs/2603.21091","tags":["stat.ML","cs.LG","math.PR"],"score":0,"title":"Stochastic approximation in non-markovian environments revisited","domain":"stat.ML","source":"arxiv","authors":["Vivek Shripad Borkar"],"reviews":0,"subject":"stat.ML","summary":"Based on some recent work of the author on stochastic approximation in non-markovian environments, the situation when the driving random process is non-ergodic in addition to being non-markovian is considered. Using this, we propose an analytic framework for understanding transformer based learning, specifically, the `attention' mechanism, and continual learning, both of which depend on the entire past in principle.","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-03-22","reactions":{}}