Browse > Article
http://dx.doi.org/10.5370/KIEE.2016.65.9.1541

Comparative Analysis of Learning Methods of Fuzzy Clustering-based Neural Network Pattern Classifier  

Kim, Eun-Hu (Dept. of Electrical Engineering, The University of Suwon)
Oh, Sung-Kwun (Dept. of Electrical Engineering, The University of Suwon)
Kim, Hyun-Ki (Dept. of Electrical Engineering, The University of Suwon)
Publication Information
The Transactions of The Korean Institute of Electrical Engineers / v.65, no.9, 2016 , pp. 1541-1550 More about this Journal
Abstract
In this paper, we introduce a novel learning methodology of fuzzy clustering-based neural network pattern classifier. Fuzzy clustering-based neural network pattern classifier depicts the patterns of given classes using fuzzy rules and categorizes the patterns on unseen data through fuzzy rules. Least squares estimator(LSE) or weighted least squares estimator(WLSE) is typically used in order to estimate the coefficients of polynomial function, but this study proposes a novel coefficient estimate method which includes advantages of the existing methods. The premise part of fuzzy rule depicts input space as "If" clause of fuzzy rule through fuzzy c-means(FCM) clustering, while the consequent part of fuzzy rule denotes output space through polynomial function such as linear, quadratic and their coefficients are estimated by the proposed local least squares estimator(LLSE)-based learning. In order to evaluate the performance of the proposed pattern classifier, the variety of machine learning data sets are exploited in experiments and through the comparative analysis of performance, it provides that the proposed LLSE-based learning method is preferable when compared with the other learning methods conventionally used in previous literature.
Keywords
Fuzzy C-Means clustering; Weighted least squares estimator; Least squares estimator; Local least squares estimator;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R. R. Salakhutdinov and G. E. Hinton, "A better way to pretrain deep Boltzmann machines", Advances in Neural Information Processing 25, MIT Press, Cambridge, MA, pp. 1-9 2012.
2 Y. LeCun, Y. Bengio, and G. E. Hinton, "Deep learning", Nature, Vol. 521, pp. 436-444, 2015.   DOI
3 D. Broomhead, and D. Lowe, "Multivariable functional interpolation and adaptive networks", Complex Systems, Vol. 2, pp. 321-355, 1988.
4 F. Schwenker, H. A. Kestler, and G. Palm, "Three learning phases for radial-basis-function networks", Neural Networks, Vol. 14, pp. 439-458, 2001.   DOI
5 S.-K. Oh, W.-D. Kim, W. Pedrycz, and S.-C. Joo, "Design of K-means Clustering-based Polynomial Radial Basis Function Neural Networks(pRBF NNs) Realized with the Aid of Particle Swarm Optimization and Differential Evolution", Neurocomputing, Vol. 78, No. 1, pp. 121-132, 2012.   DOI
6 S.-K. Oh, W. Pedrycz, and H.-S. Park, "Multi-FNN Identification Based on HCM Clustering and Evolutionary Fuzzy Granulation", Simulation Modelling Practice and Theory, Vol. 11, No. 7-8, pp. 627-642, 2003.   DOI
7 S.-K. Oh, W. Pedrycz, and H.-S. Park, "Implicit rulebased Fuzzy-Neural Networks Using The Identification Algorithm of GA Hybrid Scheme Based on Information Granulation", Advanced Engineering Informatics, Vol. 16, No. 4. pp. 247-263, 2002.   DOI
8 S.-B. Roh, S.-K. Oh, and W. Pedrycz, "Design of Fuzzy Radial Basis Function-based Polynomial Neural Networks", Fuzzy Sets and Systems, Vol. 185, No. 1, pp. 15-37, 2011.   DOI
9 S.-K. Oh, W.-D. Kim, W. Pedrycz, and B.-J. Park, "Polynomial-based Radial Basis Function Neural Networks (P-RBFNNs) Realized with the Aid of Particle Swarm Optimization," Fuzzy Sets and Systems, vol. 163, No. 1, pp. 54-77, January 2011.   DOI
10 J.-S. R. Jang, C.-T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence, Prentic-Hall, Inc, New Jersey, 1997.
11 S. P. Lloyd, "Least squares quantization in PCM," IEEE Transactions on Information Theory, Vol. 28, pp. 129-137, 1982.   DOI
12 J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
13 J. C. Bezdek, and E. Robert, and F. William, "FCM: The Fuzzy C-Means Clustering Algorithm", Computers & Geosciences Vol. 10 No. 2-3, pp 191-203, 1984.   DOI
14 J.-N. Choi, S.-K. Oh, and W. Pedrycz, "Identification of Fuzzy Relation Models Using Hierarchical Fair Competitionbased Parallel Genetic Algorithms and Information Granulation", Applied Mathematical Modelling, Vol. 33, No. 6, pp. 2791-2807, 2009.   DOI
15 S.-K. Oh, W.-D. Kim, and W. Pedrycz, "Design of Radial Basis Function Neural Network Classifier Realized with the Aid of Data Preprocessing Techniques: Design and Analysis", International Journal of General Systems, Vol. 45, No. 4, pp. 434-454, 2016.   DOI
16 S.-K. Oh, and W.-D. Kim, W. Pedrycz, and K.-S. Seo, "Fuzzy Radial Basis Function Neural Networks with Information Granulation and Its Parallel Genetic Optimization," Fuzzy Sets and Systems, Vol. 237, pp. 96-117, 2014.   DOI
17 S.-B. Roh, S.-K. Oh, and W. Pedrycz, "A Fuzzy Ensemble of Parallel Polynomial Neural Networks with Information Granules Formed by Fuzzy Clustering", Knowledge-Based Systems, Vol. 23, No. 3, pp. 121-132, 2012.
18 M. A. Tahir, A. Bouridane, and F. Kurugollu, "Simultaneous Feature Selection and Feature Weighting Using Hybrid Tabu Search/K-Nearest Neighbor Classifier," Pattern Recognition Letters, Vol. 28, No. 4, pp. 438-446, March 2007.   DOI