{"id":"arxiv/2601.07876","url":"https://arxiv.org/abs/2601.07876","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"NOVAK: Unified adaptive optimizer for deep neural networks","domain":"cs.LG","source":"arxiv","authors":["Sergii Kavun"],"reviews":0,"subject":"cs.LG","summary":"This work introduces NOVAK, a modular gradient-based optimization algorithm that integrates adaptive moment estimation, rectified learning-rate scheduling, decoupled weight regularization, multiple variants of Nesterov momentum, and lookahead synchronization into a unified, performance-oriented framework. NOVAK adopts a dual-mode architecture consisting of a streamlined fast path designed for production. The optimizer employs custom CUDA kernels that deliver substantial speedups (3-5 for critical operations) while preserving numerical stability under standard stochastic-optimization…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-11","reactions":{}}