Skip to main content
placeholder image

Linear shrinkage estimation of covariance matrices using low-complexity cross-validation

Journal Article


Download full-text (Open Access)

Abstract


  • Shrinkage can effectively improve the condition number and accuracy of covariance matrix estimation, especially for low-sample-support applications with the number of training samples smaller than the dimensionality. This paper investigates parameter choice for linear shrinkage estimators. We propose data-driven, leave-one-out cross-validation (LOOCV) methods for automatically choosing the shrinkage coefficients, aiming to minimize the Frobenius norm of the estimation error. A quadratic loss is used as the prediction error for LOOCV. The resulting solutions can be found analytically or by solving optimization problems of small sizes and thus have low complexities. Our proposed methods are compared with various existing techniques. We show that the LOOCV method achieves near-oracle performance for shrinkage designs using sample covariance matrix (SCM) and several typical shrinkage targets. Furthermore, the LOOCV method provides low-complexity solutions for estimators that use general shrinkage targets, multiple targets, and/or ordinary least squares (OLS)-based covariance matrix estimation. We also show applications of our proposed techniques to several different problems in array signal processing.

Publication Date


  • 2018

Citation


  • J. Tong, R. Hu, J. Xi, Z. Xiao, Q. Guo & Y. Yu, "Linear shrinkage estimation of covariance matrices using low-complexity cross-validation," Signal Processing, vol. 148, pp. 223-233, 2018.

Scopus Eid


  • 2-s2.0-85042490398

Ro Full-text Url


  • http://ro.uow.edu.au/cgi/viewcontent.cgi?article=2165&context=eispapers1

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/1163

Number Of Pages


  • 10

Start Page


  • 223

End Page


  • 233

Volume


  • 148

Place Of Publication


  • Netherlands

Abstract


  • Shrinkage can effectively improve the condition number and accuracy of covariance matrix estimation, especially for low-sample-support applications with the number of training samples smaller than the dimensionality. This paper investigates parameter choice for linear shrinkage estimators. We propose data-driven, leave-one-out cross-validation (LOOCV) methods for automatically choosing the shrinkage coefficients, aiming to minimize the Frobenius norm of the estimation error. A quadratic loss is used as the prediction error for LOOCV. The resulting solutions can be found analytically or by solving optimization problems of small sizes and thus have low complexities. Our proposed methods are compared with various existing techniques. We show that the LOOCV method achieves near-oracle performance for shrinkage designs using sample covariance matrix (SCM) and several typical shrinkage targets. Furthermore, the LOOCV method provides low-complexity solutions for estimators that use general shrinkage targets, multiple targets, and/or ordinary least squares (OLS)-based covariance matrix estimation. We also show applications of our proposed techniques to several different problems in array signal processing.

Publication Date


  • 2018

Citation


  • J. Tong, R. Hu, J. Xi, Z. Xiao, Q. Guo & Y. Yu, "Linear shrinkage estimation of covariance matrices using low-complexity cross-validation," Signal Processing, vol. 148, pp. 223-233, 2018.

Scopus Eid


  • 2-s2.0-85042490398

Ro Full-text Url


  • http://ro.uow.edu.au/cgi/viewcontent.cgi?article=2165&context=eispapers1

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/1163

Number Of Pages


  • 10

Start Page


  • 223

End Page


  • 233

Volume


  • 148

Place Of Publication


  • Netherlands