• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.3
• /
• pp.347-352
• /
• 2011

Entropy used for measuring the richness in details of the image and absolute mean brightness error(AMBE) providing a change in the image global appearance are two quantitative measures generally used for measuring quality of images. In this paper, we propose an entropy and AMBE-based thresholding method to binalize a given image. The effectiveness of the proposed method is demonstrated by thresholding experiments on nine test images and comparison with other conventional thresholding methods, that is, Otsu method and entropy-based method.

• Communications for Statistical Applications and Methods
• /
• v.8 no.1
• /
• pp.193-207
• /
• 2001

When designing a test set, we need to consider constraints on items that are deemed important by item developers or test specialists. The constraints are essentially on the components of the test domain or abilities relevant to a given test set. And so if the test domain could be represented in a more refined form, test construction would be made in a more efficient way. We assume that relationships among task abilities are representable by a causal model and that the item response theory (IRT) is not fully available for them. In such a case we can not apply traditional item selection methods that are based on the IRT. In this paper, we use entropy as an uncertainty measure for making inferences on task abilities and developed an optimal item selection algorithm which reduces most the entropy of task abilities when items are selected from an item pool.

• Journal of applied mathematics & informatics
• /
• v.26 no.1_2
• /
• pp.177-189
• /
• 2008

In this paper, we have considered an investigation on goodness of fit tests based on divergence measures. In the case of categorical data, under certain regularity conditions, we obtained asymptotic distribution of these tests. Also, we have proposed a modified test that improves the rate of convergence. In continuous case, we used our modified entropy estimator [10], for Kullback-Leibler information estimation. A comparative study based on simulation results is discussed also.

• The Korean Journal of Applied Statistics
• /
• v.20 no.1
• /
• pp.79-89
• /
• 2007

A test for normality introduced by Arizono and Ohta(1989) is based on fullback-Leibler discrimination information. The test statistic is derived from the discrimination information estimated using sample entropy of Vasicek(1976) and the maximum likelihood estimator of the variance. However, these estimators are biased and so it is reasonable to make use of unbiased estimators to accurately estimate the discrimination information. In this paper, Arizono-Ohta test for normality is improved. The derived test statistic is based on the bias-corrected entropy estimator and the uniformly minimum variance unbiased estimator of the variance. The properties of the improved KL test are investigated and Monte Carlo simulation is performed for power comparison.

• Genomics & Informatics
• /
• v.20 no.2
• /
• pp.17.1-17.11
• /
• 2022

Genetic associations have been quantified using a number of statistical measures. Entropy-based mutual information may be one of the more direct ways of estimating the association, in the sense that it does not depend on the parametrization. For this purpose, both the entropy and conditional entropy of the phenotype distribution should be obtained. Quantitative traits, however, do not usually allow an exact evaluation of entropy. The estimation of entropy needs a probability density function, which can be approximated by kernel density estimation. We have investigated the proper sequence of procedures for combining the kernel density estimation and entropy estimation with a probability density function in order to calculate mutual information. Genotypes and their interactions were constructed to set the conditions for conditional entropy. Extensive simulation data created using three types of generating functions were analyzed using two different kernels as well as two types of multifactor dimensionality reduction and another probability density approximation method called m-spacing. The statistical power in terms of correct detection rates was compared. Using kernels was found to be most useful when the trait distributions were more complex than simple normal or gamma distributions. A full-scale genomic dataset was explored to identify associations using the 2-h oral glucose tolerance test results and γ-glutamyl transpeptidase levels as phenotypes. Clearly distinguishable single-nucleotide polymorphisms (SNPs) and interacting SNP pairs associated with these phenotypes were found and listed with empirical p-values.

• Communications for Statistical Applications and Methods
• /
• v.9 no.1
• /
• pp.13-19
• /
• 2002

In nonparametric entropy estimation, both mass and mean-preserving maximum entropy distribution (Theil, 1980) and the underlying distribution of the sample entropy (Vasicek, 1976), the most widely used entropy estimator, consist of nb mass-preserving densities based on disjoint Intervals of the simple averages of two adjacent order statistics. In this paper, we notice that those nonparametric density functions do not actually keep the mass-preserving constraint, and propose a modified sample entropy by considering the generalized 0-statistics (Kaigh and Driscoll, 1987) in averaging two adjacent order statistics. We consider the proposed estimator in a goodness of fit test for normality and compare its performance with that of the sample entropy.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.5
• /
• pp.543-548
• /
• 2011

Entropy measuring the richness in details of the image is generally obtained by using the histogram of gray levels in an image, and has been widely used as an index for thresholding of the image. In this paper, we propose an entropy-based thresholding method, where the entropy is obtained not by the histogram but by the variance of the gray levels, to binalize a given image. The effectiveness of the proposed method is demonstrated by thresholding experiments on nine test images and comparison with conventional two thresholding methods, that is, Otsu method and entropy-based method using the histogram.

• Journal of the Korean Data and Information Science Society
• /
• v.28 no.3
• /
• pp.659-668
• /
• 2017

The inverse Weibull distribution (IWD) can be readily applied to a wide range of situations including applications in medicines, reliability and ecology. It is generally known that the lifetimes of test items may not be recorded exactly. In this paper, therefore, we consider the maximum likelihood estimation (MLE) and Bayes estimation of the entropy of a IWD under generalized progressive hybrid censoring (GPHC) scheme. It is observed that the MLE of the entropy cannot be obtained in closed form, so we have to solve two non-linear equations simultaneously. Further, the Bayes estimators for the entropy of IWD based on squared error loss function (SELF), precautionary loss function (PLF), and linex loss function (LLF) are derived. Since the Bayes estimators cannot be obtained in closed form, we derive the Bayes estimates by revoking the Tierney and Kadane approximate method. We carried out Monte Carlo simulations to compare the classical and Bayes estimators. In addition, two real data sets based on GPHC scheme have been also analysed for illustrative purposes.

• Journal of Information Processing Systems
• /
• v.14 no.1
• /
• pp.218-227
• /
• 2018

Vocal effort detection is important for both robust speech recognition and speaker recognition. In this paper, the spectral information entropy feature which contains more salient information regarding the vocal effort level is firstly proposed. Then, the model fusion method based on complementary model is presented to recognize vocal effort level. Experiments are conducted on isolated words test set, and the results show the spectral information entropy has the best performance among the three kinds of features. Meanwhile, the recognition accuracy of all vocal effort levels reaches 81.6%. Thus, potential of the proposed method is demonstrated.

• Smart Structures and Systems
• /
• v.11 no.3
• /
• pp.299-314
• /
• 2013

This paper presents a nonlinear time series analysis technique for evaluating machine defect severity, based on the Recurrence Plot (RP) entropy. The RP entropy is calculated from the probability distribution of the diagonal line length in the recurrence plot, which graphically depicts a system's dynamics and provides a global picture of the autocorrelation in a time series over all available time-scales. Results of experimental studies conducted on a spindle-bearing test bed have demonstrated that, as the working condition of the bearing deteriorates due to the initiation and/or progression of structural damages, the frequency information contained in the vibration signal becomes increasingly complex, leading to the increase of the RP entropy. As a result, RP entropy can serve as an effective indicator for defect severity assessment of rolling bearings.