{"id":"arxiv/2608.24592","url":"https://arxiv.org/abs/2608.24592","tags":["math.OC","stat.ME","stat.ML"],"score":0,"title":"Optimal Allocation of Embedding Dimensions under Finite-Sample Constraints","domain":"math.OC","source":"arxiv","authors":["Vasileios E. Papageorgiou"],"reviews":0,"subject":"math.OC","summary":"The embedding dimension of categorical predictors is usually selected through heuristic tuning, although it directly affects model complexity, approximation quality, and finite-sample generalization. This paper formulates embedding dimension selection as a constrained allocation problem. The main contribution is to show that embedding capacity can be allocated across heterogeneous categorical predictors according to an explicit approximation-estimation tradeoff. We characterize approximation error through the singular-value tail of the latent category representation, while estimation error…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-08-25","reactions":{}}