Browse > Article

Construction of Multiple Classifier Systems based on a Classifiers Pool  

Kang, Hee-Joong (Dept. of Computer Engineering, Hansung University)
Publication Information
Journal of KIISE:Software and Applications / v.29, no.8, 2002 , pp. 595-603 More about this Journal
Abstract
Only a few studies have been conducted on how to select multiple classifiers from the pool of available classifiers for showing the good classification performance. Thus, the selection problem if classifiers on how to select or how many to select still remains an important research issue. In this paper, provided that the number of selected classifiers is constrained in advance, a variety of selection criteria are proposed and applied to tile construction of multiple classifier systems, and then these selection criteria will be evaluated by the performance of the constructed multiple classifier systems. All the possible sets of classifiers are trammed by the selection criteria, and some of these sets are selected as the candidates of multiple classifier systems. The multiple classifier system candidates were evaluated by the experiments recognizing unconstrained handwritten numerals obtained both from Concordia university and UCI machine learning repository. Among the selection criteria, particularly the multiple classifier system candidates by the information-theoretic selection criteria based on conditional entropy showed more promising results than those by the other selection criteria.
Keywords
a pool of classifiers; multiple classifier system; information theory; measare of closeness; conditional entropy; dependency; Bayesian method;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Xu, L., Krzyzak, A., and Suen, C. Y., 'Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition,' IEEE Trans. on Systems, Man, and Cybernetics, 22(3):418-435, 1992   DOI   ScienceOn
2 Kittler, J., Hatef, M., Duin, R. P. W., and Matas, J., 'On Combining Classifiers,' IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3):226-239, 1998   DOI   ScienceOn
3 Woods, K., Kegelmeyer Jr., W. P., and Bowyer, K., 'Combinition of Multiple Classifiers Using Local Accuracy Estimates,' IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):405-410, 1997   DOI   ScienceOn
4 Impedovo, S. and Salzo, A., 'Evaluation of Combination Methods,' In Proceedings of the 5th International Conference on Document Analysis and Recognition, pp. 394-397, 1999
5 Lewis, P. M., 'Approximating Probability Distributions to Reduce Storage Requirement,' Information and Control, 2:214-225, Sep. 1959   DOI
6 Gallager, R. G., Information Theory and Reliable Communication, John Wiley and Sons, Inc., 1968
7 Kim, J., Seo, K., and Chung, K., 'A Systematic Approach to Classifier Selection on Combining Multiple Classifiers for Handwritten Digit Recognition,' In Proceedings of the 4th International Conference on Document Analysis and Recognition, vol. 2, pp. 459-462, 1997   DOI
8 Suen, C. Y., Nadal, C., Legault, R., Mai, T. A., and Lam, L., 'Computer Recognition of Unconstrained Handwritten Numerals,' In Proceedings of IEEE, pp. 1162-1180, 1992   DOI   ScienceOn
9 Blake, C. and Merz, C., UCI repository of machine learning databases, 1998
10 강희중, 이성환, '무제약 필기 숫자를 인식하기 위한 다수 인식기를 결합하는 의존관계 기반의 프레임워크,' 정보과학회논문지 : 소프트웨어 및 응용, 제27권, 제8호, pp. 855-863, 2000   과학기술학회마을
11 Oh, I.-S. and Suen, C. Y., 'Distance features for neural network-based recognition of handwritten characters,' International Journal on Document Analysis and Recognition, 1(2):73-88, 1998   DOI
12 Wang, D. C. C. and Wong, A. K. C., 'Classification of Discrete Data with Feature Space Transform,' IEEE Transactions on Automatic Control, AC-24(3):434-437, 1979   DOI
13 Matsui, T., Tsutsumida, T., and Srihari, S. N., 'Combination of Stroke/Background Structure and Contour-direction Features in Handprinted Alphanumeric Recognition,' In Proceedings of the 4th Int. Workshop on Frontiers in Handwriting Recognition, pp. 87-96, 1994
14 강희중, '베이스 에러율의 상위 경계 최소화에 기반한 고차 곱 근사 방법과 숫자 인식기 결합에의 적용,' 정보과학회논문지 : 소프트웨어 및 응용, 제28권, 제9호, pp. 681-687, 2001   과학기술학회마을