• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.05a
• /
• pp.86-88
• /
• 2014

Naive Bayes (NB) assumption has some harmful effects in classification to the real world data. To relax this assumption, we now propose approach called Naive Bayes Mutual Information Attribute Weighting with Smooth Kernel Density Estimation (NBMIKDE) that combine the smooth kernel for attribute and attribute weighting method based on mutual information measure.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.11 no.6
• /
• pp.691-696
• /
• 2018

We propose an algorithm to update weight to use the mean square error method and mutual coupling matrix in a coherent channel. The algorithm proposed in this paper estimates the desired signal by using the updated weight. The updated weight is obtained by covariance matrix using mean square error and mutual coupling matrix. The MUSIC algorithm, which is direction of arrival estimation method, is mostly used in the desired signal estimation. The MUSIC algorithm has a good resolution because it uses subspace techniques. The proposed method estimates the desired signal by updating the weights using the mutual coupling matrix and mean square error method. Through simulation, we analyze the performance by comparing the classical MUSIC and the proposed algorithm in a coherent channel. In this case of the coherent channel for estimating at the three targets (-10o, 0o, 10o), the proposed algorithm estimates all the three targets (-10o, 0o, 10o). But the classical MUSIC algorithm estimates only one target (x, x, 10o). The simulation results indicate that the proposed method is superior to the classical MUSIC algorithm for desired signal estimation.

• Journal of Korea Water Resources Association
• /
• v.30 no.6
• /
• pp.641-648
• /
• 1997

Mutual information is useful for analyzing nonlinear dependence in time series in much the same way as correlation is used to characterize linear dependence. We use multivariate kernel density estimators for the estimation of mutual information at different time lags for single and multiple time series. This approach is tested on a variety of hydrologic data sets, and suggested an appropriate delay time $ au$ at which the mutual information is almost zerothen multi-dimensional phase portraits could be constructed from measurements of a single scalar time series.

• Proceedings of the KSPS conference
• /
• 2005.04a
• /
• pp.53-56
• /
• 2005

In this paper, we propose a transformation based robust adaptation technique that uses the maximum mutual information(MMI) estimation for the objective function and the linear spectral transformation(LST) for adaptation. LST is an adaptation method that deals with environmental noises in the linear spectral domain, so that a small number of parameters can be used for fast adaptation. The proposed technique is called MMI-LST, and evaluated on TIMIT and FFMTIMIT corpora to show that it is advantageous when only a small amount of adaptation speech is used.

• Journal of Communications and Networks
• /
• v.17 no.4
• /
• pp.362-369
• /
• 2015

This study addresses the effects of channel estimation error and mutual interference between licensed and unlicensed systems on outage performance of reactive relay selection in unlicensed systems over independent non-identical (i.n.i) Rayleigh fading channels and under both the maximum transmit power constraint and primary outage constraint. Toward this end, power allocation for unlicensed users is first recommended to satisfy both constraints and account for channel estimation error and mutual interference. Then, we derive an exact closed-form outage probability representation for unlicensed systems to quickly evaluate this effect in key operation parameters. Various results corroborate the derived expressions and provide useful insights into system performance.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.4
• /
• pp.511-518
• /
• 2007

This paper presents an efficient face recognition method by using both centroid shift and mutual information estimation of images. The centroid shift is to move an image to center coordinate calculated by first moment, which is applied to improve the recognition performance by excluding the needless backgrounds in face image. The mutual information which is a measurements of correlations, is applied to efficiently measure the similarity between images. Adaptive partition mutual information(AP-MI) estimation is especially applied to find an accurate dependence information by equally partitioning the samples of input image for calculating the probability density function(PDF). The proposed method has been applied to the problem for recognizing the 48 face images(12 persons * 4 scenes) of 64*64 pixels. The experimental results show that the proposed method has a superior recognition performances(speed, rate) than a conventional method without centroid shift. The proposed method has also robust performance to changes of facial expression, position, and angle, etc. respectively.

• Genomics & Informatics
• /
• v.20 no.2
• /
• pp.17.1-17.11
• /
• 2022

Genetic associations have been quantified using a number of statistical measures. Entropy-based mutual information may be one of the more direct ways of estimating the association, in the sense that it does not depend on the parametrization. For this purpose, both the entropy and conditional entropy of the phenotype distribution should be obtained. Quantitative traits, however, do not usually allow an exact evaluation of entropy. The estimation of entropy needs a probability density function, which can be approximated by kernel density estimation. We have investigated the proper sequence of procedures for combining the kernel density estimation and entropy estimation with a probability density function in order to calculate mutual information. Genotypes and their interactions were constructed to set the conditions for conditional entropy. Extensive simulation data created using three types of generating functions were analyzed using two different kernels as well as two types of multifactor dimensionality reduction and another probability density approximation method called m-spacing. The statistical power in terms of correct detection rates was compared. Using kernels was found to be most useful when the trait distributions were more complex than simple normal or gamma distributions. A full-scale genomic dataset was explored to identify associations using the 2-h oral glucose tolerance test results and γ-glutamyl transpeptidase levels as phenotypes. Clearly distinguishable single-nucleotide polymorphisms (SNPs) and interacting SNP pairs associated with these phenotypes were found and listed with empirical p-values.

• The Korean Journal of Applied Statistics
• /
• v.21 no.2
• /
• pp.301-312
• /
• 2008

Mutual information is a measure of association of explanatory variable for predicting target variable. It is used for variable ranking and variable subset selection. This study is about the Sample-spacing approach which can be used for the estimation of mutual information from data consisting of continuous explanation variables and categorical target variable without estimating a joint probability density function. The results of Monte-Carlo simulation and experiments with real-world data show that m = 1 is preferable in using Sample-spacing.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2006.11a
• /
• pp.175-178
• /
• 2006

본 논문에서는 주요성분분석과 상호정보 추정을 조합한 입력변수선택 기법을 제안하였다. 여기서 주요성분분석은 2차원 통계성을 이용하여 입력변수 간의 독립성을 찾기 위함이고, 상호정보의 추정은 적응적 분할을 이용하여 입력변수의 확률밀도함수를 계산함으로써 변수상호간의 종속성을 좀더 정확하게 측정하기 위함이다. 제안된 기법을 인위적으로 제시된 각 500개의 샘플을 가지는 6개의 독립신호와 1개의 종속신호를 대상으로 실험한 결과, 빠르고 정확한 변수의 선택이 이루어짐을 확인하였다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.2
• /
• pp.220-225
• /
• 2007

This paper presents an efficient input variable selection method using both principal component analysis(PCA) and adaptive partition mutual information(AP-MI) estimation. PCA which is based on 2nd order statistics, is applied to prevent a overestimation by quickly removing the dependence between input variables. AP-MI estimation is also applied to estimate an accurate dependence information by equally partitioning the samples of input variable for calculating the probability density function. The proposed method has been applied to 2 problems for selecting the input variables, which are the 7 artificial signals of 500 samples and the 24 environmental pollution signals of 55 samples, respectively. The experimental results show that the proposed methods has a fast and accurate selection performance. The proposed method has also respectively better performance than AP-MI estimation without the PCA and regular partition MI estimation.