Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지

An Ensemble Classifier using Two Dimensional LDA

  • Park, Cheong-Hee (Chungnam National University Dept. of Computer Science and Engineering)
  • Received : 2009.05.26
  • Accepted : 2010.03.31
  • Published : 2010.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Linear Discriminant Analysis (LDA) has been successfully applied for dimension reduction in face recognition. However, LDA requires the transformation of a face image to a one-dimensional vector and this process can cause the correlation information among neighboring pixels to be disregarded. On the other hand, 2D-LDA uses 2D images directly without a transformation process and it has been shown to be superior to the traditional LDA. Nevertheless, there are some problems in 2D-LDA. First, it is difficult to determine the optimal number of feature vectors in a reduced dimensional space. Second, the size of rectangular windows used in 2D-LDA makes strong impacts on classification accuracies but there is no reliable way to determine an optimal window size. In this paper, we propose a new algorithm to overcome those problems in 2D-LDA. We adopt an ensemble approach which combines several classifiers obtained by utilizing various window sizes. And a practical method to determine the number of feature vectors is also presented. Experimental results demonstrate that the proposed method can overcome the difficulties with choosing an optimal window size and the number of feature vectors.

Keywords

References

  1. P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces v.s. Fisherfaces: Recognition using class specific linear projection," IEEE transactions on pattern analysis and machine learning, Vol.19, No.7, pp.711-720, 1997. https://doi.org/10.1109/34.598228
  2. P. Howland and H. Park, A comprehensive survey of text mining, chapter: Cluster-preserving dimension reduction methods for effident classification of text data, pp. Springer-Verlag, 2003.
  3. H. Yu and J. Yang, "A direct LDA algorithm for high-dimensional data- with application to face recognition," Pattern recognition, Vol.34, pp.2067-2070, 2001. https://doi.org/10.1016/S0031-3203(00)00162-X
  4. J. Yang and J.-Y. Yang, "Why can LDA be performed in PCA transformed space?," Pattern recognition, Vol.36, pp. 563-566, 2003. https://doi.org/10.1016/S0031-3203(02)00048-1
  5. J. Yang, D. Zhang, F. Grangi, and J. Yang, "Two-dimensional PCA: a new approach to appearance-based face representation and recognition," IEEE transactions on pattern analysis and machine intelligence, Vol.26, No.1, pp. 131-137, 2004. https://doi.org/10.1109/TPAMI.2004.1261097
  6. C. Kim and C. Choi, "Image covariance-based subspace method for face recognition," Pattern recognition, Vol.40, pp.1592-1604, 2007. https://doi.org/10.1016/j.patcog.2006.09.010
  7. http://cvc.yale.edu/projects/yalefaces/yalefaces.html.
  8. http://www.uk.research.att.com/facedatabase.html.
  9. J. Yang, J. Y. D. Zhang, and B. Niu, "Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics," IEEE transactions on pattern analysis and machine intelligence, Vol.29, No.4, pp.650-664, 2007. https://doi.org/10.1109/TPAMI.2007.1008
  10. D. Hu, G. Feng, and Z. Zho, "Two-dimensional locality preserving projections (2dLPP) with its application to palmprint recognition," Pattern recognition, Vol.40, pp.339-342, 2007. https://doi.org/10.1016/j.patcog.2006.06.022
  11. P. Tan, M. Steinbach, and V. Kumar, Introduction to data mining, Addison Wesley, Boston, MA, 2006.
  12. T. Dietterich, "Ensemble methods in machine learning," In the proceedings of the first international workshop on multiple classifier systems, 2000.
  13. Y. Freund and R. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of computer and system sciences, Vol.55, No.1, pp. 119-139, 1997. https://doi.org/10.1006/jcss.1997.1504