Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2002.9B.6.735

Improving Learning Performance of Support Vector Machine using the Kernel Relaxation and the Dynamic Momentum  

Kim, Eun-Mi (전남대학교 대학원 컴퓨터공학과)
Lee, Bae-Ho (전남대학교 전자컴퓨터정보통신공학부, 정보통신연구소)
Abstract
This paper proposes learning performance improvement of support vector machine using the kernel relaxation and the dynamic momentum. The dynamic momentum is reflected to different momentum according to current state. While static momentum is equally influenced on the whole, the proposed dynamic momentum algorithm can control to the convergence rate and performance according to the change of the dynamic momentum by training. The proposed algorithm has been applied to the kernel relaxation as the new sequential learning method of support vector machine presented recently. The proposed algorithm has been applied to the SONAR data which is used to the standard classification problems for evaluating neural network. The simulation results of proposed algorithm have better the convergence rate and performance than those using kernel relaxation and static momentum, respectively.
Keywords
Support Vector Machine; Kernel Relaxation; Dynamic Momentum;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 B. Boser, I. Guyon, and V. K Vapnik, 'A training algorithm for optimal margin classifiers,' Fifth Annual Workshop on Computational Learning Theory, San Mateo, CA : Morgan Kaufmann, pp.144-152, 1992   DOI
2 J C. Platt, 'Fast training of support vector machines using sequential minimal optimization,' Advances in Kernel Methods-Support Vector Learning, B. Scholkopf, C. Burges, A. Smola, editors, MIT-Press, pp.185-208, 1998
3 R. O. Duda, P. E. Hart, D. G. Stork, Pattern Classification, Second Edition by John Wiley and Sons, Inc, 2001
4 류재홍, 정종철, '커널 이완절차에 의한 커널 공간의 저밀도 표현 학습', 한국퍼지 및 지능시스템학회, 2001년도 추계 학술대회 학술발표논문집, 제11권 제2호, pp.60-64, Dec., 2001   과학기술학회마을
5 T. T Friess, N. Cristianini, C. Campbell, 'The KernelAdatron Algorithm: a Fast and Simple Learning Procedure for Support Vector Machines,' in Shavlik, J, ed., Machine Learning: Proceedings of the 15th Int. Conf., Morgan Kaufmann Publishers, San Francisco, CA 1998
6 D. G. Luenberger, Linear and Nonlinear Programming, 2nd Ed., Addison-Wesley Publishing Company Inc, 1984
7 S. Haykin, Neural Networks, A Comprehensive Foundation Second Edition by Prentice-Hall, Inc, 1999
8 조용현, '모멘트를 이용한 Support Vector Machines의 학습 성능개선', 정보처리학회논문지, 제7권 제5호, pp.1446-1455, May, 2000   과학기술학회마을
9 Y. Li, et al. , 'The relaxed online maximum margin algorithm,' In Advances in NIPS 13, 1999
10 이성환 편저, 패턴인식의 원리 II, 홍릉과한출판사, 1994
11 김상운 편저, 패턴인식의 입문, 홍릉과학출판사, 1997
12 O. L. Mangasarian andD. R. Musicant, 'Active Set Support Vector Machine Classification,' Neural Information Processing Systems 2000(NIPS 2000), T. K. Lee, T. G. Dietterich and V. Tresp, editors, MIT Press, pp.577-583, 2001
13 E. Osuna, R. Freund, and F. Girosi. 'Training support vector machines: an application to face detection,' CVPR'97, 1997   DOI