False discovery and its control in low rank estimation

Armeen Taeb, Parikshit Shah, Venkat Chandrasekaran

Journal of the Royal Statistical Society: Series B (Statistical Methodology) · 2020 · Volume 82 · Issue 4

Abstract

Models specified by low rank matrices are ubiquitous in contemporary applications. In many of these problem domains, the row–column space structure of a low rank matrix carries information about some underlying phenomenon, and it is of interest in inferential settings to evaluate the extent to which the row–column spaces of an estimated low rank matrix signify discoveries about the phenomenon. However, in contrast with variable selection, we lack a formal framework to assess true or false discoveries in low rank estimation; in particular, the key source of difficulty is that the standard notion of a discovery is a discrete notion that is ill suited to the smooth structure underlying low rank matrices. We address this challenge via ageometricreformulation of the concept of a discovery, which then enables a natural definition in the low rank case. We describe and analyse a generalization of the stability selection method of Meinshausen and Bühlmann to control for false discoveries in low rank estimation, and we demonstrate its utility compared with previous approaches via numerical experiments.

Keywords

Algebraic geometry, Determinantal varieties, Model selection, Regularization, Stability selection, Testing

Enable JavaScript for citation tools and additional paper interactions.