• Title/Summary/Keyword: Independent Component Analysis, ICA

Search Result 235, Processing Time 0.032 seconds

GENERALIZED GAUSSIAN PRIOR FOR ICA (ICA를 위한 Generalized 가우시안 Prior)

  • 최승진
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 1999.10b
    • /
    • pp.467-469
    • /
    • 1999
  • Independent component analysis (ICA)는 주어진 데이터를 통계적으로 독립인 요소들의 선형 결합으로 표시하는 통계학적 방법이다. ICA의 주요한 적용분야중의 하나는 source들의 선형 mixture로부터 어떠한 서전 정보도 없는 상태에서 원래의 통계학적 독립변수인 source를 복원하는 blind separation이다. ICA와 source separation을 위한 다양한 신경 학습 알고리듬이 제시되어왔다. ICA의 학습 알고리듬에서는 비선형 함수가 중요한 역할을 한다. 이 논문에서는 generalized 가우시안 prior를 도입하여 다양한 확률분포를 갖는 source들의 mixture를 분리하는 효율적인 source separation 알고리즘을 제시한다. 모의실험을 통하여 제안된 방법의 우수성을 살펴본다.

  • PDF

Classification of Signals Segregated using ICA (ICA로 분리한 신호의 분류)

  • Kim, Seon-Il
    • 전자공학회논문지 IE
    • /
    • v.47 no.4
    • /
    • pp.10-17
    • /
    • 2010
  • There is no general method to find out from signals of the channel outputs of ICA(Independent Component Analysis) which is what you want. Assuming speech signals contaminated with the sound from the muffler of a car, this paper presents the method which shows what you want, It is anticipated that speech signals will show larger correlation coefficients for speech signals than others. Batch, maximum and average method were proposed using 'ah', 'oh', 'woo' vowels whose signals were spoken by the same person who spoke the speech signals and using the same vowels whose signals are by another person. With the correlation coefficients which were calculated for each vowel, voting and summation methods were added. This paper shows what the best is among several methods tried.

Audio Watermarking Using Independent Component Analysis

  • Seok, Jong-Won
    • Journal of information and communication convergence engineering
    • /
    • v.10 no.2
    • /
    • pp.175-180
    • /
    • 2012
  • This paper presents a blind watermark detection scheme for an additive watermark embedding model. The proposed estimation-correlation-based watermark detector first estimates the embedded watermark by exploiting non-Gaussian of the real-world audio signal and the mutual independence between the host-signal and the embedded watermark and then a correlation-based detector is used to determine the presence or the absence of the watermark. For watermark estimation, blind source separation (BSS) based on independent component analysis (ICA) is used. Low watermark-to-signal ratio (WSR) is one of the limitations of blind detection with the additive embedding model. The proposed detector uses two-stage processing to improve the WSR at the blind detector; the first stage removes the audio spectrum from the watermarked audio signal using linear predictive (LP) filtering and the second stage uses the resulting residue from the LP filtering stage to estimate the embedded watermark using BSS based on ICA. Simulation results show that the proposed detector performs significantly better than existing estimation-correlationbased detection schemes.

Independent Component Analysis for Clustering Components by Using Fixed-Point Algorithm of Secant Method and Kurtosis (할선법의 고정점 알고리즘과 첨도에 의한 군집성의 독립성분분석)

  • Cho, Yong-Hyun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.3
    • /
    • pp.336-341
    • /
    • 2004
  • This paper proposes an independent component analysis(ICA) of the fixed-point (FP) algorithm based on secant method and the kurtosis. The FP algorithm based on secant method is applied to improve the analysis speed and performance by simplifying the calculation process of the complex derivative in Newton method, the kurtosis is applied to cluster the components. The proposed ICA has been applied to the problems for separating the 6-mixed signals of 500 samples and 8-mixed images of $512{\times}512$ pixels, respectively. The experimental results show that the proposed ICA has always a fixed analysis sequence. The result can be solved the limit of conventional ICA based on secant method which has a variable sequence depending on the running of algorithm. Especially, the proposed ICA can be used for classifying and identifying the signals or the images.

Independent Component Analysis of Fixed-Point Algorithm for Clustering Components Using Kurtosis (첨도를 이용한 군집성을 가진 고정점 알고리즘의 독립성분분석)

  • Cho, Yong-Hyun;Kim, A-Ram
    • The KIPS Transactions:PartB
    • /
    • v.11B no.3
    • /
    • pp.381-386
    • /
    • 2004
  • This paper proposes an independent component analysis(ICA) of the fixed-point(FP) algorithm based on Newton method by adding the kurtosis. The kurtosis is applied for clustering the components, and the FP algorithm of Newton method is applied for improving the analysis speed and performance. The proposed ICA has been applied to the problems for separating the 6-mixed signals of 500 samples and 8-mixed images of $512\times512$pixels, respectively. The experimental results show that the proposed ICA has always a fixed analysis sequence. The result can be solved the limit of conventional ICA which has a variable sequence depending on the running of algorithm. Especially, the proposed ICA can be used to classify and identify the signals or the images.

Multivariate Time Series Simulation With Component Analysis (독립성분분석을 이용한 다변량 시계열 모의)

  • Lee, Tae-Sam;Salas, Jose D.;Karvanen, Juha;Noh, Jae-Kyoung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2008.05a
    • /
    • pp.694-698
    • /
    • 2008
  • In hydrology, it is a difficult task to deal with multivariate time series such as modeling streamflows of an entire complex river system. Normal distribution based model such as MARMA (Multivariate Autorgressive Moving average) has been a major approach for modeling the multivariate time series. There are some limitations for the normal based models. One of them might be the unfavorable data-transformation forcing that the data follow the normal distribution. Furthermore, the high dimension multivariate model requires the very large parameter matrix. As an alternative, one might be decomposing the multivariate data into independent components and modeling it individually. In 1985, Lins used Principal Component Analysis (PCA). The five scores, the decomposed data from the original data, were taken and were formulated individually. The one of the five scores were modeled with AR-2 while the others are modeled with AR-1 model. From the time series analysis using the scores of the five components, he noted "principal component time series might provide a relatively simple and meaningful alternative to conventional large MARMA models". This study is inspired from the researcher's quote to develop a multivariate simulation model. The multivariate simulation model is suggested here using Principal Component Analysis (PCA) and Independent Component Analysis (ICA). Three modeling step is applied for simulation. (1) PCA is used to decompose the correlated multivariate data into the uncorrelated data while ICA decomposes the data into independent components. Here, the autocorrelation structure of the decomposed data is still dominant, which is inherited from the data of the original domain. (2) Each component is resampled by block bootstrapping or K-nearest neighbor. (3) The resampled components bring back to original domain. From using the suggested approach one might expect that a) the simulated data are different with the historical data, b) no data transformation is required (in case of ICA), c) a complex system can be decomposed into independent component and modeled individually. The model with PCA and ICA are compared with the various statistics such as the basic statistics (mean, standard deviation, skewness, autocorrelation), and reservoir-related statistics, kernel density estimate.

  • PDF

Image Classification Method Using Proposed Grey Block Distance Algorithm for Independent Component Analysis and Principal Component Analysis (주성분분석과 독립성분분석에서의 제안된 GBD 알고리즘을 이용한 영상분류 방법)

  • Hong, Jun-Sik
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2004.05a
    • /
    • pp.809-812
    • /
    • 2004
  • 본 논문에서는 다중해상도에서 기존의 그레이 블록 거리(grey block distance; GBD, 이하 GBD)알고리즘과 비교하여 이차원 영상간의 상대적 식별을 더 용이하게 하기 위한 새로운 GBD 알고리즘 방법을 제안한다. 이 제시된 방법은 다중해상도에서 기존의 GBD 알고리즘과 비교해서 영상이 급격히 변화하는 부분의 정보를 잃지 않게 개선할 수 있었다. 모의 실험 예로서 주성분분석(principal component analysis; 이하 PCA)기법과 독립성분분석(independent component analysis; 이하 ICA)기법을 적용하여 유용성과 제안된 방법이 이전의 연구보다 k가 감소할 때 편차는 줄어들어 좋은 영상 분류 특징을 보였으며, ICA가 PCA에 비하여 영상간의 상대적 식별을 용이하게 하여 빨리 수렴이 되는 것을 모의 실험을 통하여 확인하였다.

  • PDF

An Image Separation Scheme using Independent Component Analysis and Expectation-Maximization (독립성분 분석과 E-M을 이용한 혼합영상의 분리 기법)

  • 오범진;김성수;유정웅
    • Journal of KIISE:Information Networking
    • /
    • v.30 no.1
    • /
    • pp.24-29
    • /
    • 2003
  • In this paper, a new method for the mixed image separation is presented using the independent component analysis, the innovation process, and the expectation-maximization. In general, the independent component analysis (ICA) is one of the widely used statistical signal processing schemes, which represents the information from observations as a set of random variables in the from of linear combinations of another statistically independent component variables. In various useful applications, ICA provides a more meaningful representation of the data than the principal component analysis through the transformation of the data to be quasi-orthogonal to each other. which can be utilized in linear projection.. However, it has been known that ICA does not establish good performance in source separation by itself. Thus, in order to overcome this limitation, there have been many techniques that are designed to reinforce the good properties of ICA, which improves the mixed image separation. Unfortunately, the innovation process still needs to be studied since it yields inconsistent innovation process that is attached to the ICA, the expectation and maximization process is added. The results presented in this paper show that the proposed improves the image separation as presented in experiments.

A simple iterative independent component analysis algorithm for vibration source signal identification of complex structures

  • Lee, Dong-Sup;Cho, Dae-Seung;Kim, Kookhyun;Jeon, Jae-Jin;Jung, Woo-Jin;Kang, Myeng-Hwan;Kim, Jae-Ho
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • v.7 no.1
    • /
    • pp.128-141
    • /
    • 2015
  • Independent Component Analysis (ICA), one of the blind source separation methods, can be applied for extracting unknown source signals only from received signals. This is accomplished by finding statistical independence of signal mixtures and has been successfully applied to myriad fields such as medical science, image processing, and numerous others. Nevertheless, there are inherent problems that have been reported when using this technique: instability and invalid ordering of separated signals, particularly when using a conventional ICA technique in vibratory source signal identification of complex structures. In this study, a simple iterative algorithm of the conventional ICA has been proposed to mitigate these problems. The proposed method to extract more stable source signals having valid order includes an iterative and reordering process of extracted mixing matrix to reconstruct finally converged source signals, referring to the magnitudes of correlation coefficients between the intermediately separated signals and the signals measured on or nearby sources. In order to review the problems of the conventional ICA technique and to validate the proposed method, numerical analyses have been carried out for a virtual response model and a 30 m class submarine model. Moreover, in order to investigate applicability of the proposed method to real problem of complex structure, an experiment has been carried out for a scaled submarine mockup. The results show that the proposed method could resolve the inherent problems of a conventional ICA technique.

Speaker Adaptation using ICA-based Feature Transformation (ICA 기반의 특징변환을 이용한 화자적응)

  • Park ManSoo;Kim Hoi-Rin
    • MALSORI
    • /
    • no.43
    • /
    • pp.127-136
    • /
    • 2002
  • The speaker adaptation technique is generally used to reduce the speaker difference in speech recognition. In this work, we focus on the features fitted to a linear regression-based speaker adaptation. These are obtained by feature transformation based on independent component analysis (ICA), and the transformation matrix is learned from a speaker independent training data. When the amount of data is small, however, it is necessary to adjust the ICA-based transformation matrix estimated from a new speaker utterance. To cope with this problem, we propose a smoothing method: through a linear interpolation between the speaker-independent (SI) feature transformation matrix and the speaker-dependent (SD) feature transformation matrix. We observed that the proposed technique is effective to adaptation performance.

  • PDF