Minimax adaptive dimension reduction for regression

Quentin Paris (1)

1 IRMAR - Institut de Recherche Mathématique de Rennes

In this paper, we address the problem of regression estimation in the context of a p-dimensional predictor when p is large. We propose a general model in which the regression function is a composite function. Our model consists in a nonlinear extension of the usual sufficient dimension reduction setting. The strategy followed for estimating the regression function is based on the estimation of a new parameter, called the reduced dimension. We adopt a minimax point of view and provide both lower and upper bounds for the optimal rates of convergence for the estimation of the regression function in the context of our model. We prove that our estimate adapts, in the minimax sense, to the unknown value d of the reduced dimension and achieves fast rates of convergence when d is small.

Mots clés: Regression estimation; dimension reduction; minimax rates of convergence; empirical risk minimization; metric entropy

Domaines: Statistiques [math.ST]; Théorie [stat.TH]

Quentin Paris. Minimax adaptive dimension reduction for regression. Journal of Multivariate Analysis, 2014, 128, pp.186-202. ⟨10.1016/j.jmva.2014.03.008⟩. ⟨hal-00768911v2⟩