{"id":"arxiv/2602.13104","url":"https://arxiv.org/abs/2602.13104","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Random Forests as Statistical Procedures: Design, Variance, and Dependence","domain":"stat.ML","source":"arxiv","authors":["Nathaniel S. O'Connell"],"reviews":0,"subject":"stat.ML","summary":"We develop a finite-sample, design-based theory for random forests in which each tree is a randomized conditional predictor acting on fixed covariates and the forest is their Monte Carlo average. An exact variance identity separates Monte Carlo error from a covariance floor that persists under infinite aggregation. The floor arises through two mechanisms: observation reuse, where the same training outcomes receive weight across multiple trees, and partition alignment, where independently generated trees discover similar conditional prediction rules. We prove the floor is strictly positive…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-02-13","reactions":{}}