Browse > Article
http://dx.doi.org/10.7840/kics.2013.38C.2.208

Transformation Technique for Null Space-Based Linear Discriminant Analysis with Lagrange Method  

Hou, Yuxi (한국과학기술원 전기 및 전자공학과 통계학적 신호처리 연구실)
Min, Hwang-Ki (한국과학기술원 전기 및 전자공학과 통계학적 신호처리 연구실)
Song, Iickho (한국과학기술원 전기 및 전자공학과 통계학적 신호처리 연구실)
Choi, Myeong Soo (목포대학교 정보산업연구소)
Park, Sun (목포대학교 정보산업연구소)
Lee, Seong Ro (목포대학교 정보전자공학과)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.38C, no.2, 2013 , pp. 208-212 More about this Journal
Abstract
Due to the singularity of the within-class scatter, linear discriminant analysis (LDA) becomes ill-posed for small sample size (SSS) problems. An extension of LDA, the null space-based LDA (NLDA) provides good discriminant performances for SSS problems. In this paper, by applying the Lagrange technique, the procedure of transforming the problem of finding the feature extractor of NLDA into a linear equation problem is derived.
Keywords
feature extraction; Lagrange method; null space-based linear discriminant analysis;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed., John Wiley and Sons, 2001.
2 P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Patt. Anal., Mach. Intell., vol. 19, no. 7, pp. 711-720, July 1997.   DOI   ScienceOn
3 H. Yu and J. Yang, "A direct LDA algorithm for high-dimensional data - with application to face recognition," Patt. Recogn., vol. 34, no. 10, pp. 2067-2070, Oct. 2001.   DOI   ScienceOn
4 L.-F. Chen, H.-Y. Mark Liao, M.-T. Ko, J.-C. Lin, and G.-J. Yu, "A new LDA-based face recognition system which can solve the small sample size problem," Patt. Recogn., vol. 33, no. 10, pp. 1713-1726, Oct. 2000.   DOI   ScienceOn
5 D.-U. Cho, U.-D. Chang, Y.-G. Kim, Y.-J. Song, J.-H. Ahn, and B.-H. Kim, "2D direct LDA algorithm for face recognition," J. Korean Inform., Comm. Soc., vol. 30, no. 12C, pp. 1162-1166, Dec. 2005.   과학기술학회마을
6 J. Ye and T. Xiong, "Computational and theoretical analysis of null space and orthogonal linear discriminant analysis," J. Mach. Learn. Res., vol. 7, no. 7, pp. 1183-1204, July 2006.
7 D. Cai, X. He, and J. Han, "SRDA: An efficient algorithm for largescale discriminant analysis," IEEE Trans. Knowl., Data Eng., vol. 20, no. 1, pp. 1-12, Jan. 2008.   DOI   ScienceOn
8 D. Chu and G. S. Thye, "A new and fast implementation for null space based linear discriminant analysis," Patt. Recogn., vol. 43, no. 4, pp. 1373-1379, Apr. 2010.   DOI   ScienceOn
9 R. Huang, Q. Liu, H. Lu, and S. Ma, "Solving the small sample size problem of LDA," Proc. Int. Conf. Patt. Recogn., pp. 29-32, Quebec, Canada, Aug. 2002.
10 R. Rifkin and A. Klautau, "In defense of one-vs-all classification," J. Mach. Learn.Res., vol. 5, no. 1, pp. 101-141, Jan. 2004.
11 G. W. Stewart, Matrix Algorithms Volume I: Basic Decompositions, Society for Industrial and Applied Mathematics, 1998.