Browse > Article

An Ensemble Classifier using Two Dimensional LDA  

Park, Cheong-Hee (Chungnam National University Dept. of Computer Science and Engineering)
Publication Information
Abstract
Linear Discriminant Analysis (LDA) has been successfully applied for dimension reduction in face recognition. However, LDA requires the transformation of a face image to a one-dimensional vector and this process can cause the correlation information among neighboring pixels to be disregarded. On the other hand, 2D-LDA uses 2D images directly without a transformation process and it has been shown to be superior to the traditional LDA. Nevertheless, there are some problems in 2D-LDA. First, it is difficult to determine the optimal number of feature vectors in a reduced dimensional space. Second, the size of rectangular windows used in 2D-LDA makes strong impacts on classification accuracies but there is no reliable way to determine an optimal window size. In this paper, we propose a new algorithm to overcome those problems in 2D-LDA. We adopt an ensemble approach which combines several classifiers obtained by utilizing various window sizes. And a practical method to determine the number of feature vectors is also presented. Experimental results demonstrate that the proposed method can overcome the difficulties with choosing an optimal window size and the number of feature vectors.
Keywords
Dimension reduction; Ensemble classifier; Face recognition; Two-dimensional LDA;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Y. Freund and R. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of computer and system sciences, Vol.55, No.1, pp. 119-139, 1997.   DOI   ScienceOn
2 D. Hu, G. Feng, and Z. Zho, "Two-dimensional locality preserving projections (2dLPP) with its application to palmprint recognition," Pattern recognition, Vol.40, pp.339-342, 2007.   DOI   ScienceOn
3 P. Tan, M. Steinbach, and V. Kumar, Introduction to data mining, Addison Wesley, Boston, MA, 2006.
4 T. Dietterich, "Ensemble methods in machine learning," In the proceedings of the first international workshop on multiple classifier systems, 2000.
5 P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces v.s. Fisherfaces: Recognition using class specific linear projection," IEEE transactions on pattern analysis and machine learning, Vol.19, No.7, pp.711-720, 1997.   DOI   ScienceOn
6 http://www.uk.research.att.com/facedatabase.html.
7 J. Yang, J. Y. D. Zhang, and B. Niu, "Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics," IEEE transactions on pattern analysis and machine intelligence, Vol.29, No.4, pp.650-664, 2007.   DOI
8 C. Kim and C. Choi, "Image covariance-based subspace method for face recognition," Pattern recognition, Vol.40, pp.1592-1604, 2007.   DOI   ScienceOn
9 http://cvc.yale.edu/projects/yalefaces/yalefaces.html.
10 J. Yang, D. Zhang, F. Grangi, and J. Yang, "Two-dimensional PCA: a new approach to appearance-based face representation and recognition," IEEE transactions on pattern analysis and machine intelligence, Vol.26, No.1, pp. 131-137, 2004.   DOI   ScienceOn
11 P. Howland and H. Park, A comprehensive survey of text mining, chapter: Cluster-preserving dimension reduction methods for effident classification of text data, pp. Springer-Verlag, 2003.
12 H. Yu and J. Yang, "A direct LDA algorithm for high-dimensional data- with application to face recognition," Pattern recognition, Vol.34, pp.2067-2070, 2001.   DOI   ScienceOn
13 J. Yang and J.-Y. Yang, "Why can LDA be performed in PCA transformed space?," Pattern recognition, Vol.36, pp. 563-566, 2003.   DOI   ScienceOn