{"id":"arxiv/2603.05727","url":"https://arxiv.org/abs/2603.05727","tags":["cs.CL","math.NA"],"score":0,"title":"Structured Multidimensional Representation Learning for Large Language Models","domain":"cs.CL","source":"arxiv","authors":["Alaa El Ichi","Khalide Jbilou","Mohamed El Guide","Franck Dufrenois"],"reviews":0,"subject":"cs.CL","summary":"Transformer architectures achieve state-of-the-art performance across a wide range of pattern recognition and natural language processing tasks, but their scaling is accompanied by substantial parameter growth and redundancy in the embedding dimension. In this work, we introduce a structured spectral factorization of the embedding space based on the L-product for third-order tensors. By reshaping token representations into spectral tensor slices and performing attention and feed-forward operations in the transform domain, we obtain a Tensor Transformer architecture that decomposes the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-05","reactions":{}}