{"id":"arxiv/2611.15250","url":"https://arxiv.org/abs/2611.15250","tags":["quant-ph","cs.AI","cs.LG"],"score":0,"title":"Multi-head Quantum Neural Networks: Replacing Transformer Blocks with NISQ Modules inside a 30-Billion-Parameter LLM","domain":"quant-ph","source":"arxiv","authors":["Maforikan Amoussou","Borja Aizpurua","Sukhbinder Singh","Román Orús","Hans-Arno Jacobsen"],"reviews":0,"subject":"quant-ph","summary":"We introduce the multi-head quantum neural network (QNN), a quantum module compatible with noisy intermediate-scale quantum (NISQ) devices that can replace transformer blocks inside pre-trained large language models (LLMs) with little loss in accuracy and with far fewer parameters than the blocks it replaces. Encoding a model's $D$ hidden neurons into a qubit register is the obstacle: amplitude encoding scales poorly in circuit depth and angle encoding in qubit count, so neither is practical at production-scale width. We instead partition the hidden space into $k$ disjoint heads,…","category":"research","comments":0,"disputed":false,"division":"physics","mentions":0,"discussed":0,"published":"2026-11-11","reactions":{}}