{"id":"arxiv/2604.02882","url":"https://arxiv.org/abs/2604.02882","tags":["math.OC"],"score":0,"title":"Importance Sampling Optimization with Laplace Principle","domain":"math.OC","source":"arxiv","authors":["Radu-Alexandru Dragomir","François Portier","Victor Priser"],"reviews":0,"subject":"math.OC","summary":"Grid search and random search are widely used techniques for hyperparameter tuning in machine learning, especially when gradient information is unavailable. In these methods, a finite set of candidate configurations is evaluated, and the best-performing one is selected. We propose a simple and computationally inexpensive refinement of this paradigm: instead of selecting a single best point, we form a weighted average of the evaluated configurations, where the weights are chosen using an importance sampling scheme inspired by the Laplace principle. This scheme can be implemented as a…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-04-03","reactions":{}}