Browse > Article
http://dx.doi.org/10.9708/jksci.2014.19.7.001

A New Clustering Method for Minimum Classification Error  

Heo, Gyeong-Yong (Dept. of Electronic Engineering, Dong-Eui University)
Kim, Seong-Hoon (School of Computer Information, Kyungpook National University)
Publication Information
Journal of the Korea Society of Computer and Information / v.19, no.7, 2014 , pp. 1-8 More about this Journal
Abstract
Clustering is one of the most popular unsupervised learning methods, which is widely used to form clusters with homogeneous data. Clustering was used to extract contexts corresponding to clusters and a classification method was applied to each context or cluster individually. However, it is difficult to say that the unsupervised clustering is the best context forming method from the view of classification. In this paper, a new clustering method considering classification was proposed. The proposed method tries to minimize classification error in each cluster when a classification method is applied to each context locally. For this purpose, the proposed method adds constraints forcing two data points belong to the same class to have small distances, and two data points belong to different classes to have large distances in each cluster like in linear discriminant analysis. The usefulness of the proposed method is confirmed by experimental results.
Keywords
Clustering; Supervised clustering; Context; Classification;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. M. Martinez and A. C. Kak, "PCA versus LDA, " IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23 No. 2, pp. 228-233, Feb. 2001.   DOI   ScienceOn
2 L. A. Zadeh, "Fuzzy sets, " Information and Control, Vol. 8, No. 3, pp. 338-353, June 1965.   DOI
3 Rui Xu and Donald Wunsch II, "Survey of Clustering Algorithms, " IEEE Transactions on Neural Networks, Vol. 16, No. 3, pp. 645-678, May 2005.   DOI   ScienceOn
4 J. C. Dunn, "A fuzzy relative of the ISODATA process and its use in detecting compact well separated clusters, " Journal of Cybernetics, Vol. 3, No. 3, pp. 32-57, Apr. 1974.
5 J. C. Bezdek, "Pattern Recognition with Fuzzy Objective Function Algorithms, " Plenum, New York, 1981.
6 G. Heo, P. Gader and H. Frigui, "A Noise Robust Variant of Context Extraction for Local Fusion, " Proceedings of 2010 IEEE International Conference on Fuzzy Systems, pp. 1-6, 2010.
7 A. M. Bensaid, "Partially supervised clustering for image segmentation, " Pattern Recognition, Vol. 29, No. 5, pp. 859-871, May 1996.   DOI   ScienceOn
8 Gomes, Ryan, Andreas Krause, and Pietro Perona. "Discriminative clustering by regularized information maximization, " Advances in Neural Information Processing Systems, Vol. 23 pp. 775-783, 2010.
9 K. Zhang, I. W. Tsang and J. T. Kwok, "Maximum Margin Clustering Made Practical, " IEEE Transactions on Neural Networks, Vol. 20, No. 4, pp. 583-596, Apr. 2009.   DOI   ScienceOn
10 D. E. Gustafson and W. C. Keller, "Fuzzy clustering with a fuzzy covariance matrix, " Proceedings of the 1978 IEEE Conference on Decision and Control, pp. 761-766, 1979.
11 R. Babuska, P. J. van der Veen and U. Kaymak, "Improved Covariance Estimation for Gustafson-Kessel Clustering, " Proceedings of the 2002 IEEE International Conference on Fuzzy Systems, pp. 1081-1085, 2002.
12 B. Feil and J. Abonyi, "Geodesic Distance Based Fuzzy Clustering, " Advances in Soft Computing, Vol. 39, pp. 50-59, 2007.   DOI
13 E. H. Ruspini, "A new approach to clustering, " Information and Control, Vol. 15, No. 1, pp. 22-32, July 1969.   DOI