{"id":"arxiv/2602.00161","url":"https://arxiv.org/abs/2602.00161","tags":["cs.LG","cs.AI","cs.CL","quant-ph"],"score":0,"title":"LLM Compression by Block Removal with Constrained Binary Optimization","domain":"cs.LG","source":"arxiv","authors":["David Jansen","Roman Rausch","Ali Hashemi","David Montero","Román Orús"],"reviews":0,"subject":"cs.LG","summary":"In this paper, we formulate the compression of large language models (LLMs) by optimally deleting transformer blocks (``block removal'') as a constrained binary optimization (CBO) problem that can be mapped to a physical system (Ising glass), whose energies are a strong proxy for downstream model performance. This formulation enables an efficient ranking of a large number of candidate block-removal configurations yielding many high-quality, non-trivial solutions beyond those only removing consecutive regions. Our method performs strongly in the deep compression regime, such as for 50%…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-01-29","reactions":{}}