Browse > Article
http://dx.doi.org/10.4218/etrij.13.0112.0224

An Improved Multiplicative Updating Algorithm for Nonnegative Independent Component Analysis  

Li, Hui (Institute of Communication Engineering, PLA University of Science and Technology)
Shen, Yue-Hong (Institute of Communication Engineering, PLA University of Science and Technology)
Wang, Jian-Gong (Institute of Communication Engineering, PLA University of Science and Technology)
Publication Information
ETRI Journal / v.35, no.2, 2013 , pp. 193-199 More about this Journal
Abstract
This paper addresses nonnegative independent component analysis (NICA), with the aim to realize the blind separation of nonnegative well-grounded independent source signals, which arises in many practical applications but is hardly ever explored. Recently, Bertrand and Moonen presented a multiplicative NICA (M-NICA) algorithm using multiplicative update and subspace projection. Based on the principle of the mutual correlation minimization, we propose another novel cost function to evaluate the diagonalization level of the correlation matrix, and apply the multiplicative exponentiated gradient (EG) descent update to it to maintain nonnegativity. An efficient approach referred to as the EG-NICA algorithm is derived and its validity is confirmed by numerous simulations conducted on different types of source signals. Results show that the separation performance of the proposed EG-NICA algorithm is superior to that of the previous M-NICA algorithm, with a better unmixing accuracy. In addition, its convergence speed is adjustable by an appropriate user-defined learning rate.
Keywords
Blind source separation (BSS); independent component analysis (ICA); nonnegative constraint; multiplicative update; exponentiated gradient descent;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Comon and C. Jutten, Handbook of Blind Source Separation: Independent Component Analysis and Applications, Oxford: Academic Press, 2010.
2 P. Comon, "Independent Component Analysis, A New Concept?" Signal Process., vol. 36, no. 3, Apr. 1994, pp. 287-314.   DOI   ScienceOn
3 J. Nascimento and J. Dias, "Does Independent Component Analysis Play a Role in Unmixing Hyperspectral Data?" IEEE Trans. Geosci. Remote Sens., vol. 43, no. 1, Jan. 2005, pp. 175- 187.   DOI   ScienceOn
4 C.-I. Chang, Hyperspectral Data Exploitation: Theory and Applications, Hoboken, NJ: John Wiley & Sons, Inc., 2007.
5 V.P. Pauce et al., "Unmixing Spectral Data for Space Objects Using Independent Component Analysis and Nonnegative Matrix Factorization," Proc. ATC, 2004.
6 N. Dobigeon et al., "Bayesian Separation of Spectral Sources under Non-negativity and Full Additivity Constraints," Signal Process., vol. 89, no. 12, Dec. 2009, pp. 2657-2669.   DOI   ScienceOn
7 Y. Sun et al., "Postprocessing and Sparse Blind Source Separation of Positive and Partially Overlapped Data," Signal Process., vol. 91, no. 8, Aug. 2011, pp. 1838-1851.   DOI   ScienceOn
8 R.-C. Henry, "Multivariate Receptor Models - Current Practice and Future Trends," Chemom. Intell. Lab. Syst., vol. 60, no. 1-2, Jan. 2002, pp. 43-48.   DOI   ScienceOn
9 M.-D. Plumbley et al., "Automatic Music Transcription and Audio Source Separation," Cybern. Syst., vol. 33, no. 6, 2002, pp. 603-627.   DOI
10 S. Abdallah and M. Plumbley, "Polyphonic Transcription by Nonnegative Sparse Coding of Power Spectra," Proc. ISMIR, Barcelona, Spain, 2004, pp. 318-325.
11 M.-D. Plumbley, "Algorithms for Nonnegative Independent Component Analysis," IEEE Trans. Neural Netw., vol. 4, no. 3, May 2003, pp. 534-543.
12 D.-D. Lee and H.-S. Seung, "Learning the Parts of Objects by Non-negative Matrix Factorization," Nature, vol. 401, Oct. 1999, pp. 788-791.   DOI   ScienceOn
13 D.-D. Lee and H.-S. Seung, "Algorithms for Non-negative Matrix Factorization," Proc. NIPS, Cambridge, MA: MIT Press, 2001, pp. 556-562.
14 G.-F. Harpur, Low Entropy Coding with Unsupervised Neural Networks, doctoral dissertation, University of Cambridge, 1997.
15 M.-D. Plumbley, "Conditions for Nonnegative Independent Component Analysis," IEEE Signal Process. Lett., vol. 9, no. 6, June 2002, pp. 177-180.   DOI   ScienceOn
16 E. Oja and M.-D. Plumbley, "Blind Separation of Positive Sources Using Non-negative PCA," Proc. ICABSS, Nara, Japan, 2003, pp. 11-16.
17 M.-D. Plumbley and E. Oja, "A 'Nonnegative PCA' Algorithm for Independent Component Analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, Jan. 2004, pp. 66-76.   DOI   ScienceOn
18 A. Bertrand and M. Moonen, "Blind Separation of Non-negative Source Signals Using Multiplicative Updates and Subspace Projection," Signal Process., vol. 90, no. 10, Oct. 2010, pp. 2877- 2890.   DOI   ScienceOn
19 Z. Yang and J. Laaksonen, "Multiplicative Updates for Nonnegative Projections," Neurocomputing, vol. 71, no. 1-3, Dec. 2007, pp. 363-373.   DOI   ScienceOn
20 A. Cichocki and S. Amari, "Extended SMART Algorithms for Non-negative Matrix Factorization," Proc. AISC, Zakopane, Poland, 2006, pp. 548-562.
21 H. Lutkepohl, Handbook of Matrices, Chichester: John Wiley & Sons Ltd., 1996.
22 A. Cichocki et al., ICALAB Toolboxes. http://www.bsp.brain. riken.jp/ICALAB