Browse > Article
http://dx.doi.org/10.5391/JKIIS.2003.13.2.200

Separations and Feature Extractions for Image Signals Using Independent Component Analysis Based on Neural Networks of Efficient Learning Rule  

Cho, Yong-Hyun (대구가톨릭대학교 컴퓨터정보통신공학부)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.13, no.2, 2003 , pp. 200-208 More about this Journal
Abstract
This paper proposes a separation and feature extraction of image signals using the independent component analysis(ICA) based on neural networks of efficient learning rule. The proposed learning rule is a hybrid fixed-point(FP) algorithm based on secant method and momentum. Secant method is applied to improve the performance by simplifying the 1st-order derivative computation for optimizing the objective function, which is to minimize the mutual informations of the independent components. The momentum is applied for high-speed convergence by restraining the oscillation in the process of converging to the optimal solution. The proposed algorithm has been applied to the composite images generated by random mixing matrix from the 10 images of $512\times512$-pixel. The simulation results show that the proposed algorithm has better performances of the separation speed and rate than those using the FP algorithm based on Newton and secant method. The proposed algorithm has been also applied to extract the features using a 3 set of 10,000 image patches from the 10 fingerprints of $256\times256$-pixel and the front and the rear paper money of $480\times225$-pixel, respectively, The simulation results show that the proposed algorithm has also better extraction speed than those using the another methods. Especially, the 160 basis vectors(features) of $16\times16$-pixel show the local features which have the characteristics of spatial frequency and oriented edges in the images.
Keywords
Independent Component Analysis; Newton Method; Secant Method; Momentum; Separation and Feature Extraction of Image Signals;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis, John Wiley & Sons, Inc., 2001
2 T. W. Lee, Independent Component Analysis : Theory and Applications, Kluwer Academic Pub., Boston, 1998
3 J. Karhunen, "Neural Approaches to Independent Component Analysis and Source Seperation", 4th European Symp., Artificial Neural Network, ESANN96, Burges, Belgium, pp. 249-266, Apr. 1996
4 J. Karhunen and J. Joutsensalo, "Generation of Principal Component Analysis, Optimization Problems, and Neural Networks," Neural Networks, vol. 8, No. 4, pp. 549-562, 1995   DOI   ScienceOn
5 A. J. Bell and T. J. Sejnowski, "Edges are 'Independent Components' of Natural Scenes", "Advances in Neural Information Processing Systems 9", MIT Press, 1996
6 S. Haykin, Neural Networks : A Comprehensive Foundation, Prentice-Hall, 2ed, London, 1999
7 K. Atkinson, Elementary Numerical Analysis', John Wiley & Sons, Inc., New York, 1993
8 P. Comon, "Independent Component Analysis A New Concept?", Signal Processing, vol. 36, No. 3, pp. 287-314, Apr. 1994   DOI   ScienceOn
9 K. I. Diamantara sand S. Y. Kung, Principal Component Neural Networks : Theory and Applications, Adaptive and learning Systems for Signal Processing, Communications, and Control, John Wiley & Sons, Inc., 1996
10 S. Roberts and R. Everson, Independent Component Analysis : Principles and Practice, Cambridge Univ. Press, 2001