Browse > Article

Automatic Clustering on Trained Self-organizing Feature Maps via Graph Cuts  

Park, An-Jin (숭실대학교 미디어학부)
Jung, Kee-Chul (숭실대학교 미디어학부)
Abstract
The Self-organizing Feature Map(SOFM) that is one of unsupervised neural networks is a very powerful tool for data clustering and visualization in high-dimensional data sets. Although the SOFM has been applied in many engineering problems, it needs to cluster similar weights into one class on the trained SOFM as a post-processing, which is manually performed in many cases. The traditional clustering algorithms, such as t-means, on the trained SOFM however do not yield satisfactory results, especially when clusters have arbitrary shapes. This paper proposes automatic clustering on trained SOFM, which can deal with arbitrary cluster shapes and be globally optimized by graph cuts. When using the graph cuts, the graph must have two additional vertices, called terminals, and weights between the terminals and vertices of the graph are generally set based on data manually obtained by users. The Proposed method automatically sets the weights based on mode-seeking on a distance matrix. Experimental results demonstrated the effectiveness of the proposed method in texture segmentation. In the experimental results, the proposed method improved precision rates compared with previous traditional clustering algorithm, as the method can deal with arbitrary cluster shapes based on the graph-theoretic clustering.
Keywords
SOFM; Graph Cuts; Clustering; Texture Segmentation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Wu and W. S. Chow, "Clustering of the Self-organizing Map using a Clustering Validity Index based on Inter-cluster and Intra-cluster Density," Pattern Recognition, Vol.37, pp. 175-188, 2004   DOI   ScienceOn
2 J. Lampinen and E. Oja, "Clustering Properties of Hierarchical Self-Organizing Maps," Journal of Mathematical Imaging and Vision, Vol.2, pp. 261-272, 1992   DOI
3 Y. Li, J. Sun, C-K Tang, and H-Y Shum, "Lazy Snapping," ACM Transactions on Graphics, Vol. 23, Issue 3, pp. 303-308, Aug. 2004   DOI   ScienceOn
4 D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.24, No.5, pp. 603-619, 2002   DOI   ScienceOn
5 K. I. Kim, K. Jung, S. H. Park, and H. J. Kim, "Support Vector Machines for Texture Classification," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.24, No.11, pp. 1542-1550, 2002   DOI   ScienceOn
6 P. Brodatz, "Textures: A Photographic Album for Artists and Designers," Dover, New York, 1966
7 http://www.cis.upenn.edu/~jshi/software/
8 MIT Vision and Modeling Group, 1998
9 L. Ford and D. Fulkerson, "Flows in Networks," Princeton University Press, 1962
10 F. Moutarde and A. Ultsch, "U*F Clustering: A New Performant 'Clustering-Mining' Method based on Segmentation of Self-organizing Maps," Proceedings of Workshop on Self-Organizing Maps, pp. 25-32, 2005
11 Y. Boykov and G. Funka-Lea, "Graph Cuts and Efficient N-D Image Segmentation," International Journal of Computer Vision, Vol.70, No.2, pp. 109- 131, 2006   DOI   ScienceOn
12 T. Kohonen, "Self-Organizing Maps," Springer, Berlin, 2001
13 J. Vesanto, J. Himberg, E. Alhoniemi, and J. Parhankangas, "Self-organizing Map in Matlab: the SOM Toolbox," Proceedings of the Matlab DSP Conference, pp. 35-40, 1999
14 Y. Sun, B. Li, B. Yuan, Z. Miao, and C. Wan, "Better Foreground Segmentation for Static Cameras via New Energy Form and Dynamic Graph- Cut," Proceedings of International Conference on Pattern Recognition, Vol.4, pp. 49-52, 2006
15 J. Chen and A. Kundu, "Unsupervised Texture Segmentation using Multichannel Decomposition and Hidden Markov Models," IEEE Transactions on Image Processing, Vol.4, No.5, pp. 603-619, 1995   DOI   ScienceOn
16 Machine Vision Group, Oulu University, http:// www.ee.oulu.fi/research/image/texture/texture.php?page=matlab
17 http://www.adastral.ucl.ac.uk/~vladkolm/software. html
18 D. Opolon and F. Moutarde, "Fast Semi-automatic Segmentation Algorithm for Self-Organizing Maps," Proceedings of European Symposium on Artificial Neural Networks, pp. 507-512, 2004
19 T. Ojala, M. Pietikäinen, and T. Mäenpaa, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.24, No.7, 2002
20 D. M. Greig, B. T. Porteous, and A. H. Seheult, "Exact Maximum a Posteriori Estimation for Binary Images," Journal of the Royal Statistical Society, Series B, Vol.51, No.2, pp. 271-279, 1989
21 A. Vellido, P. J. G. Lisboa, and K. Meehan, "Segmentation of the On-line Shopping Market using Neural Networks," Expert Systems with Applications, Vol.17, pp. 303-314, 1999   DOI   ScienceOn
22 M. Y. Kiang, "Extending the Kohonen Self-Organizing Map Networks for Clustering Analysis," Computational Statistics & Data Analysis, Vol.38, pp. 161-180, 2001   DOI   ScienceOn
23 F. Murtagh, "Interpreting the Kohonen Self-Organizing Feature Map using Contiguity-constrained Clustering," Pattern Recognition Letters, Vol.16, pp. 399-408, 1995   DOI   ScienceOn
24 J. Shi and J. Malik, "Normalized Cuts and Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, No.8, 2000
25 T. Kohonen, "The Self-Organizing Map," Proceedings of IEEE, Vol.78, pp. 1464-1480, 1990   DOI   ScienceOn
26 J. Vesanto and E. Alhoniemi, "Clustering of the Self-Organizing Maps," IEEE Transactions on Neural Networks, Vol.11, No.3, pp. 586-600, 2000   DOI   ScienceOn
27 S. Yan, S. S. R. Abidi, and P. H. Artes, "Analyzing Sub-Classifications of Glaucoma via SOM based Clustering of Optic Nerve Images," Proceedings of International Congress of the European Federation for Medical Information, pp. 483-488, 2005