• 한국지능시스템학회논문지
• /
• 제21권3호
• /
• pp.347-352
• /
• 2011

영상의 세세한 부분에 대한 표현 정확도를 나타내는 엔트로피와 전체 영상에 있어서의 밝기의 변화를 나타내는 평균밝기 오차의 절대값은 영상의 질을 측정하기 위하여 일반적으로 사용되어지는 두 종류의 양적 측도이다. 본 논문에서는 이러한 엔트로피와 평균밝기오차의 절대값에 기반하여 주어진 영상을 이진화하는 영상 임계화 기법을 제안하고, 9개의 시험 영상에 대한 실험과 기존의 오츠 방법 및 엔트로피 기반의 임계값 결정법과의 비교 및 검토를 통해 제안된 기법의 효용성을 보인다.

• Communications for Statistical Applications and Methods
• /
• 제8권1호
• /
• pp.193-207
• /
• 2001

When designing a test set, we need to consider constraints on items that are deemed important by item developers or test specialists. The constraints are essentially on the components of the test domain or abilities relevant to a given test set. And so if the test domain could be represented in a more refined form, test construction would be made in a more efficient way. We assume that relationships among task abilities are representable by a causal model and that the item response theory (IRT) is not fully available for them. In such a case we can not apply traditional item selection methods that are based on the IRT. In this paper, we use entropy as an uncertainty measure for making inferences on task abilities and developed an optimal item selection algorithm which reduces most the entropy of task abilities when items are selected from an item pool.

• Journal of applied mathematics & informatics
• /
• 제26권1_2호
• /
• pp.177-189
• /
• 2008

In this paper, we have considered an investigation on goodness of fit tests based on divergence measures. In the case of categorical data, under certain regularity conditions, we obtained asymptotic distribution of these tests. Also, we have proposed a modified test that improves the rate of convergence. In continuous case, we used our modified entropy estimator [10], for Kullback-Leibler information estimation. A comparative study based on simulation results is discussed also.

• 응용통계연구
• /
• 제20권1호
• /
• pp.79-89
• /
• 2007

Arizono와 Ohta(1989)에 의해 소개된 정규성 검정은 쿨백-라이블러 판별정보를 이용하고 있으며, 검정통계량의 유도에 기반이 되는 판별정보의 추정량을 얻기 위해 Vasicek(1976)의 표본엔트로피와 분산의 최대가능도 추정량을 사용했다. 그런데 두 추정량은 편향성을 가지게 되므로 보다 정확한 판별정보의 추정을 위해 비편향 추정량을 사용하는 것이 바람직하다. 본 논문에서는 편향을 수정한 엔트로피 추정량과 분산의 균일최소분산비편향 추정량을 사용하여 판별정보의 추정량을 구하고 이로부터 유도되는 검정통계량을 사용하는 개선된 정규성 검정을 제시한다. 제안한 검정의 특성을 규명하고 검정력 비교를 위해서 모의실험을 수행한다.

• Genomics & Informatics
• /
• 제20권2호
• /
• pp.17.1-17.11
• /
• 2022

Genetic associations have been quantified using a number of statistical measures. Entropy-based mutual information may be one of the more direct ways of estimating the association, in the sense that it does not depend on the parametrization. For this purpose, both the entropy and conditional entropy of the phenotype distribution should be obtained. Quantitative traits, however, do not usually allow an exact evaluation of entropy. The estimation of entropy needs a probability density function, which can be approximated by kernel density estimation. We have investigated the proper sequence of procedures for combining the kernel density estimation and entropy estimation with a probability density function in order to calculate mutual information. Genotypes and their interactions were constructed to set the conditions for conditional entropy. Extensive simulation data created using three types of generating functions were analyzed using two different kernels as well as two types of multifactor dimensionality reduction and another probability density approximation method called m-spacing. The statistical power in terms of correct detection rates was compared. Using kernels was found to be most useful when the trait distributions were more complex than simple normal or gamma distributions. A full-scale genomic dataset was explored to identify associations using the 2-h oral glucose tolerance test results and γ-glutamyl transpeptidase levels as phenotypes. Clearly distinguishable single-nucleotide polymorphisms (SNPs) and interacting SNP pairs associated with these phenotypes were found and listed with empirical p-values.

• Communications for Statistical Applications and Methods
• /
• 제9권1호
• /
• pp.13-19
• /
• 2002

In nonparametric entropy estimation, both mass and mean-preserving maximum entropy distribution (Theil, 1980) and the underlying distribution of the sample entropy (Vasicek, 1976), the most widely used entropy estimator, consist of nb mass-preserving densities based on disjoint Intervals of the simple averages of two adjacent order statistics. In this paper, we notice that those nonparametric density functions do not actually keep the mass-preserving constraint, and propose a modified sample entropy by considering the generalized 0-statistics (Kaigh and Driscoll, 1987) in averaging two adjacent order statistics. We consider the proposed estimator in a goodness of fit test for normality and compare its performance with that of the sample entropy.

• 한국지능시스템학회논문지
• /
• 제21권5호
• /
• pp.543-548
• /
• 2011

영상의 세세한 부분에 대한 표현 정확도를 나타내는 엔트로피는 일반적으로 영상이 가진 그레이 레벨의 도수, 즉, 히스토그램을 바탕으로 얻어지며, 영상의 이진화를 위한 지표로 널리 사용되어 왔다. 본 논문에서는 이러한 영상 이진화를 위한 엔트로피 계산에 있어서 히스토그램이 아닌 그레이 레벨의 분산을 이용한 엔트로피를 바탕으로 그레이 영상을 이진화하는 알고리즘을 제안하고, 9개의 시험 영상에 대한 실험과 기존의 영상 이진화 기법인 오츠 기법 및 히스토그램을 이용한 엔트로피 기반의 임계값 결정법과의 비교 및 검토를 통하여 제안된 기법의 효용성을 보인다.

• Journal of the Korean Data and Information Science Society
• /
• 제28권3호
• /
• pp.659-668
• /
• 2017

The inverse Weibull distribution (IWD) can be readily applied to a wide range of situations including applications in medicines, reliability and ecology. It is generally known that the lifetimes of test items may not be recorded exactly. In this paper, therefore, we consider the maximum likelihood estimation (MLE) and Bayes estimation of the entropy of a IWD under generalized progressive hybrid censoring (GPHC) scheme. It is observed that the MLE of the entropy cannot be obtained in closed form, so we have to solve two non-linear equations simultaneously. Further, the Bayes estimators for the entropy of IWD based on squared error loss function (SELF), precautionary loss function (PLF), and linex loss function (LLF) are derived. Since the Bayes estimators cannot be obtained in closed form, we derive the Bayes estimates by revoking the Tierney and Kadane approximate method. We carried out Monte Carlo simulations to compare the classical and Bayes estimators. In addition, two real data sets based on GPHC scheme have been also analysed for illustrative purposes.

• Journal of Information Processing Systems
• /
• 제14권1호
• /
• pp.218-227
• /
• 2018

Vocal effort detection is important for both robust speech recognition and speaker recognition. In this paper, the spectral information entropy feature which contains more salient information regarding the vocal effort level is firstly proposed. Then, the model fusion method based on complementary model is presented to recognize vocal effort level. Experiments are conducted on isolated words test set, and the results show the spectral information entropy has the best performance among the three kinds of features. Meanwhile, the recognition accuracy of all vocal effort levels reaches 81.6%. Thus, potential of the proposed method is demonstrated.

• Smart Structures and Systems
• /
• 제11권3호
• /
• pp.299-314
• /
• 2013

This paper presents a nonlinear time series analysis technique for evaluating machine defect severity, based on the Recurrence Plot (RP) entropy. The RP entropy is calculated from the probability distribution of the diagonal line length in the recurrence plot, which graphically depicts a system's dynamics and provides a global picture of the autocorrelation in a time series over all available time-scales. Results of experimental studies conducted on a spindle-bearing test bed have demonstrated that, as the working condition of the bearing deteriorates due to the initiation and/or progression of structural damages, the frequency information contained in the vibration signal becomes increasingly complex, leading to the increase of the RP entropy. As a result, RP entropy can serve as an effective indicator for defect severity assessment of rolling bearings.