Adaptive covariance matrix estimation through block thresholding
The Annals of Statistics · 2012 · Volume 40 · Issue 4
Abstract
Estimation of large covariance matrices has drawn considerable recent attention, and the theoretical focus so far has mainly been on developing a minimax theory over a fixed parameter space. In this paper, we consider adaptive covariance matrix estimation where the goal is to construct a single procedure which is minimax rate optimal simultaneously over each parameter space in a large collection. A fully data-driven block thresholding estimator is proposed. The estimator is constructed by carefully dividing the sample covariance matrix into blocks and then simultaneously estimating the entries in a block by thresholding. The estimator is shown to be optimally rate adaptive over a wide range of bandable covariance matrices. A simulation study is carried out and shows that the block thresholding estimator performs well numerically. Some of the technical tools developed in this paper can also be of independent interest.
Keywords
62F12, 62G09, 62H12, adaptive estimation, block thresholding, Covariance matrix, Frobenius norm, minimax estimation, Optimal rate of convergence, spectral norm
Enable JavaScript for citation tools and additional paper interactions.