{"id":"arxiv/2606.11673","url":"https://arxiv.org/abs/2606.11673","tags":["quant-ph","cs.LG"],"score":0,"title":"Higher-Order Token Interactions via Quantum Attention","domain":"quant-ph","source":"arxiv","authors":["Jian Xu","Chao Li","Delu Zeng","John Paisley","Qibin Zhao"],"reviews":0,"subject":"quant-ph","summary":"Standard dot-product self-attention computes, in a single layer, only pairwise (order-2) interactions between tokens; representing a generic order-$k$ interaction is known to require either super-quadratic resources in one layer or composition across depth. We introduce \\textbf{Quantum Higher-Order Attention (QHA)}, a shallow, hardware-realizable quantum attention head that, via data re-uploading and an all-to-all non-Clifford entangler, synthesizes order-$k$ token interactions inside the circuit and exposes them through a local single-qubit read-out. We prove (i) an expressivity separation:…","category":"research","comments":0,"disputed":false,"division":"physics","mentions":0,"discussed":0,"published":"2026-06-10","reactions":{}}