Risk reversal for least squares estimators under nested convex constraints
In constrained stochastic optimization, one expects that restricting the feasible set, provided it still contains the true parameter, should not increase the statistical risk of the corresponding projection estimator. We show that this intuition can fail, even in basic settings. We investigate this phenomenon in the Gaussian sequence model. Given a compact, convex set $Θ\subseteq \mathbb{R}^d$, one observes \[ Y = θ^\star + σZ, \qquad Z \sim N(0, I_d), \] and seeks to estimate an unknown $θ^\star \in Θ$. Here, the maximum likelihood estimator over $Θ$ coincides with the least squares…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2601.16041
curl -X POST /api/v1/records/arxiv/2601.16041/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2601.16041/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'