Optimal rates of convergence for covariance matrix estimation

T. Tony Cai, Cun Hui Zhang, Harrison H. Zhou

Research output: Contribution to journalArticle

174 Citations (Scopus)

Abstract

Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet been developed. In this paper we establish the optimal rates of convergence for estimating the covariance matrix under both the operator norm and Frobenius norm. It is shown that optimal procedures under the two norms are different and consequently matrix estimation under the operator norm is fundamentally different from vector estimation. The minimax upper bound is obtained by constructing a special class of tapering estimators and by studying their risk properties. A key step in obtaining the optimal rate of convergence is the derivation of the minimax lower bound. The technical analysis requires new ideas that are quite different from those used in the more conventional function/sequence estimation problems.

Original languageEnglish (US)
Pages (from-to)2118-2144
Number of pages27
JournalAnnals of Statistics
Volume38
Issue number4
DOIs
StatePublished - Aug 1 2010

Fingerprint

Covariance Matrix Estimation
Optimal Rate of Convergence
Minimax
Covariance matrix
Operator Norm
Multivariate Statistical Analysis
Technical Analysis
Tapering
Frobenius norm
Lower bound
Upper bound
Estimator
Norm
Methodology
Covariance matrix estimation
Rate of convergence

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Keywords

  • Covariance matrix
  • Frobenius norm
  • Minimax lower bound
  • Operator norm
  • Optimal rate of convergence
  • Tapering

Cite this

Cai, T. Tony ; Zhang, Cun Hui ; Zhou, Harrison H. / Optimal rates of convergence for covariance matrix estimation. In: Annals of Statistics. 2010 ; Vol. 38, No. 4. pp. 2118-2144.
@article{d0ca30f4af144fc6b04b19e49d482e2e,
title = "Optimal rates of convergence for covariance matrix estimation",
abstract = "Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet been developed. In this paper we establish the optimal rates of convergence for estimating the covariance matrix under both the operator norm and Frobenius norm. It is shown that optimal procedures under the two norms are different and consequently matrix estimation under the operator norm is fundamentally different from vector estimation. The minimax upper bound is obtained by constructing a special class of tapering estimators and by studying their risk properties. A key step in obtaining the optimal rate of convergence is the derivation of the minimax lower bound. The technical analysis requires new ideas that are quite different from those used in the more conventional function/sequence estimation problems.",
keywords = "Covariance matrix, Frobenius norm, Minimax lower bound, Operator norm, Optimal rate of convergence, Tapering",
author = "Cai, {T. Tony} and Zhang, {Cun Hui} and Zhou, {Harrison H.}",
year = "2010",
month = "8",
day = "1",
doi = "10.1214/09-AOS752",
language = "English (US)",
volume = "38",
pages = "2118--2144",
journal = "Annals of Statistics",
issn = "0090-5364",
publisher = "Institute of Mathematical Statistics",
number = "4",

}

Optimal rates of convergence for covariance matrix estimation. / Cai, T. Tony; Zhang, Cun Hui; Zhou, Harrison H.

In: Annals of Statistics, Vol. 38, No. 4, 01.08.2010, p. 2118-2144.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Optimal rates of convergence for covariance matrix estimation

AU - Cai, T. Tony

AU - Zhang, Cun Hui

AU - Zhou, Harrison H.

PY - 2010/8/1

Y1 - 2010/8/1

N2 - Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet been developed. In this paper we establish the optimal rates of convergence for estimating the covariance matrix under both the operator norm and Frobenius norm. It is shown that optimal procedures under the two norms are different and consequently matrix estimation under the operator norm is fundamentally different from vector estimation. The minimax upper bound is obtained by constructing a special class of tapering estimators and by studying their risk properties. A key step in obtaining the optimal rate of convergence is the derivation of the minimax lower bound. The technical analysis requires new ideas that are quite different from those used in the more conventional function/sequence estimation problems.

AB - Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet been developed. In this paper we establish the optimal rates of convergence for estimating the covariance matrix under both the operator norm and Frobenius norm. It is shown that optimal procedures under the two norms are different and consequently matrix estimation under the operator norm is fundamentally different from vector estimation. The minimax upper bound is obtained by constructing a special class of tapering estimators and by studying their risk properties. A key step in obtaining the optimal rate of convergence is the derivation of the minimax lower bound. The technical analysis requires new ideas that are quite different from those used in the more conventional function/sequence estimation problems.

KW - Covariance matrix

KW - Frobenius norm

KW - Minimax lower bound

KW - Operator norm

KW - Optimal rate of convergence

KW - Tapering

UR - http://www.scopus.com/inward/record.url?scp=77955132618&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77955132618&partnerID=8YFLogxK

U2 - 10.1214/09-AOS752

DO - 10.1214/09-AOS752

M3 - Article

AN - SCOPUS:77955132618

VL - 38

SP - 2118

EP - 2144

JO - Annals of Statistics

JF - Annals of Statistics

SN - 0090-5364

IS - 4

ER -