Conference Proceedings

Find the dimension that counts: Fast dimension estimation and Krylov PCA

S Ubaru, AK Seghouane, Y Saad

SIAM International Conference on Data Mining, SDM 2019 | SIAM | Published : 2019

Abstract

Copyright © 2019 by SIAM. High dimensional data and systems with many degrees of freedom are often characterized by covariance matrices. In this paper, we consider the problem of simultaneously estimating the dimension of the principal (dominant) subspace of these covariance matrices and obtaining an approximation to the subspace. This problem arises in the popular principal component analysis (PCA), and in many applications of machine learning, data analysis, signal and image processing, and others. We first present a novel method for estimating the dimension of the principal subspace. We then show how this method can be coupled with a Krylov subspace method to simultaneously estimate the d..

View full abstract

University of Melbourne Researchers