A Fast Dimension Reduction Algorithm with Applications on Face Recognition and Text Classification

Date of Submission: 
December 19, 2003
Report Number: 
03-050
Report PDF: 
Abstract: 
In undersampled problems where the number of samples is smaller than the dimension of data space, it is difficult to apply Linear Discriminant Analysis (LDA) due to the singularity of scatter matrices caused by high dimensionality. We propose a fast dimension reduction method based on a simple modification of Principal Component Analysis (PCA) and the orthogonal decomposition. The proposed algorithm is an efficient way to perform LDA for undersampled problems. Our experimental results in face recognition and text classification demonstrate the effectiveness of our proposed method.