Skip to main content
placeholder image

Shrinkage of covariance matrices for linear signal estimation using cross-validation

Journal Article


Abstract


  • Linear estimation of signals is often based on covariance matrices estimated from training, which can perform poorly if the training data are limited and the estimated covariance matrices are ill-conditioned. Shrinking the covariance matrix toward a scaled identity matrix can improve the robustness against the model uncertainty provided the shrinkage factor is appropriately chosen. This paper introduces several cross-validation schemes for choosing the shrinkage factors in applications where the covariance matrices are replaced with sample covariance matrices or constructed from least squares estimates of the linear model parameters. For cases where the training and out-of-training data are identically distributed, we derive leave-one-out cross-validation (LOOCV) schemes that repeatedly split the training data with respect to time to determine the optimal shrinkage factors for either model fitting or signal estimation. For cases where they are distributed differently, we develop alternative LOOCV schemes that repeatedly split the out-of-training observations with respect to space. We derive computationally efficient implementations of those schemes and provide examples to demonstrate their performance.

Publication Date


  • 2016

Citation


  • J. Tong, P. J. Schreier, Q. Guo, S. Tong, J. Xi & Y. Yu, "Shrinkage of covariance matrices for linear signal estimation using cross-validation," IEEE Transactions on Signal Processing, vol. 64, (11) pp. 2965-2975, 2016.

Scopus Eid


  • 2-s2.0-84968817593

Has Global Citation Frequency


Number Of Pages


  • 10

Start Page


  • 2965

End Page


  • 2975

Volume


  • 64

Issue


  • 11

Place Of Publication


  • United States

Abstract


  • Linear estimation of signals is often based on covariance matrices estimated from training, which can perform poorly if the training data are limited and the estimated covariance matrices are ill-conditioned. Shrinking the covariance matrix toward a scaled identity matrix can improve the robustness against the model uncertainty provided the shrinkage factor is appropriately chosen. This paper introduces several cross-validation schemes for choosing the shrinkage factors in applications where the covariance matrices are replaced with sample covariance matrices or constructed from least squares estimates of the linear model parameters. For cases where the training and out-of-training data are identically distributed, we derive leave-one-out cross-validation (LOOCV) schemes that repeatedly split the training data with respect to time to determine the optimal shrinkage factors for either model fitting or signal estimation. For cases where they are distributed differently, we develop alternative LOOCV schemes that repeatedly split the out-of-training observations with respect to space. We derive computationally efficient implementations of those schemes and provide examples to demonstrate their performance.

Publication Date


  • 2016

Citation


  • J. Tong, P. J. Schreier, Q. Guo, S. Tong, J. Xi & Y. Yu, "Shrinkage of covariance matrices for linear signal estimation using cross-validation," IEEE Transactions on Signal Processing, vol. 64, (11) pp. 2965-2975, 2016.

Scopus Eid


  • 2-s2.0-84968817593

Has Global Citation Frequency


Number Of Pages


  • 10

Start Page


  • 2965

End Page


  • 2975

Volume


  • 64

Issue


  • 11

Place Of Publication


  • United States