Browse > Article
http://dx.doi.org/10.9708/jksci.2015.20.1.021

Supervised Rank Normalization with Training Sample Selection  

Heo, Gyeongyong (Dept. of Electronic Engineering, Dong-eui University)
Choi, Hun (Dept. of Electronic Engineering, Dong-eui University)
Youn, Joo-Sang (Dept. of Multimedia Engineering, Dong-eui University)
Abstract
Feature normalization as a pre-processing step has been widely used to reduce the effect of different scale in each feature dimension and error rate in classification. Most of the existing normalization methods, however, do not use the class labels of data points and, as a result, do not guarantee the optimality of normalization in classification aspect. A supervised rank normalization method, combination of rank normalization and supervised learning technique, was proposed and demonstrated better result than others. In this paper, another technique, training sample selection, is introduced in supervised feature normalization to reduce classification error more. Training sample selection is a common technique for increasing classification accuracy by removing noisy samples and can be applied in supervised normalization method. Two sample selection measures based on the classes of neighboring samples and the distance to neighboring samples were proposed and both of them showed better results than previous supervised rank normalization method.
Keywords
Feature normalization; Rank Normalization; Supervised learning; Training sample selection;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Eunseog Youn and Myong K. Jeong, "Class dependent feature scaling method using naive Bayes classifier for text datamining," Pattern Recognition Letters, Vol. 30, No. 5, pp. 477-485, Apr. 2009.   DOI   ScienceOn
2 Soojong Lee and Gyeongyong Heo, "Supervised Rank Normalization for Support Vector Machines," Journal of The Korea Society of Computer and Information, Vol. 18, No. 11, pp. 31-38, Nov. 2013.   과학기술학회마을   DOI   ScienceOn
3 Gyeongyong Heo, Choong-Shik Park, and Chang-Woo Lee, "Training Sample and Feature Selection Methods for Pseudo Sample Neural Networks," Journal of The Korea Society of Computer and Information, Vol. 18, No. 4, pp. 19-26, Apr. 2013.   과학기술학회마을   DOI   ScienceOn
4 Vladimir Vapnik, Statistical Learning Theory, John Wiley & Sons, New York, 1998.
5 Ashis Pradhan, "Support Vector Machine - A Survey," International Journal of Emerging Technology and Advanced Engineering, Vol. 2, No. 8, pp. 82-85, Aug. 2012.
6 Yvan Saeys, Inaki Inza and Pedro Larranaga, "A review of feature selection techniques in bioinformatics," Bioinformatics, Vol. 23, No. 19, pp. 2507-2517, Aug. 2007.   DOI   ScienceOn
7 Keinosuke Fukunaga, Introduction to Statistical Pattern Recognition, 2nd edition, SanDiego, AcademicPress, 1990
8 Andreas Stolcke, Sachin Kajarekar, and Luciana Ferrer, "Nonparametric Feature Normalization for SVM-based Speaker Verification," Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas NV, pp. 1577-1580, March 2008.