• Communications for Statistical Applications and Methods
• /
• v.9 no.1
• /
• pp.13-19
• /
• 2002

In nonparametric entropy estimation, both mass and mean-preserving maximum entropy distribution (Theil, 1980) and the underlying distribution of the sample entropy (Vasicek, 1976), the most widely used entropy estimator, consist of nb mass-preserving densities based on disjoint Intervals of the simple averages of two adjacent order statistics. In this paper, we notice that those nonparametric density functions do not actually keep the mass-preserving constraint, and propose a modified sample entropy by considering the generalized 0-statistics (Kaigh and Driscoll, 1987) in averaging two adjacent order statistics. We consider the proposed estimator in a goodness of fit test for normality and compare its performance with that of the sample entropy.

• Communications for Statistical Applications and Methods
• /
• v.18 no.5
• /
• pp.625-636
• /
• 2011

This paper proposes two parametric entropy estimators, the minimum variance unbiased estimator and the maximum likelihood estimator, for the lognormal distribution for a comparison of the properties of the two estimators. The variances of both estimators are derived. The influence of the bias of the maximum likelihood estimator on estimation is analytically revealed. The distributions of the proposed estimators obtained by the delta approximation method are also presented. Performance comparisons are made with the two estimators. The following observations are made from the results. The MSE efficacy of the minimum variance unbiased estimator appears consistently high and increases rapidly as the sample size and variance, n and ${\sigma}^2$, become simultaneously small. To conclude, the minimum variance unbiased estimator outperforms the maximum likelihood estimator.

• Proceedings of the IEEK Conference
• /
• 2000.11d
• /
• pp.77-80
• /
• 2000

In this paper, we present a new automatic thresholding algorithm based on maximum entropy of two-dimensional pixel histogram. While most of the previous algorithms select thresholds depending only on the histogram of gray level itself in the image, the presented algorithm considers 2D relational histogram of gray levels of two adjacent pixels in the image. Thus, the new algorithm tends to leave salient edge features on the image after thresholding. The experimental results show the good performance of the presented algorithm.

• Proceedings of the Korean Information Science Society Conference
• /
• 2003.04c
• /
• pp.522-524
• /
• 2003

품사 결정 문제는 자연언어처리의 가장 기본적인 문제들 중 하나이며, 기계학습의 관점에서 보면 분류 문제(classification problem)로 쉽게 표현된다. 본 논문에서는 품사 결정의 모호성을 해소하기 위해서 최대 엔트로피 부스팅 모델(maximum entropy boosting model)을 이 문제에 적응하였다. 그리고, 품사 결정에서 중요한 요소 중의 하나인 미지어 처리를 위해서 특별히 설계된 일차 자질을 고려하였다. 최대 엔트로피 부스팅 모델의 장점은 쉬운 모델링인데, 실제로 품사 결정을 위한 일차 자질만 작성하는 노려만 들이고도 96.78%의 정확도를 보여 지금까지 알려진 최고의 성능과 거의 비슷한 결과를 보였다.

• Proceedings of the IEEK Conference
• /
• 1999.11a
• /
• pp.609-612
• /
• 1999

In this paper, we propose wavelet transform image compression method such that an image is decomposed into multiresolutions using biorthogonal wavelet transform with linear phase response property and decomposed subbands are classified by maximum classification gain. The classified data is quantized by allocating bits in accordance with classified class informations within subbands through arbitrary set bit allocation algorithm. And then, quantized data in each subband are entropy coded. The proposed coding method is that the quantized data perform shuffling before entropy coding in order to remove sign bit plane. And the context is assigned by maximum correlation direction for bit plane coding.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.7 no.5
• /
• pp.7-14
• /
• 1998

In this paper, Fractal analysis applied to evaluate machined surface profile. The spectrum method was used to calculate fractal dimension of generated surface profiles by Weierstrass-Mandelbrot fractal function. To avoid estimation errors by low frequency characteristics of FFT, the Maximum Entropy Method (MEM) was examined. We suggest a new criterion to define the MEM order m. MEM power spectrum with our criterion is proved to be advantageous by the comparison with the experimental results.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.9 no.1
• /
• pp.154-159
• /
• 2008

This study proposes how to decide mean velocity which is one of the very important and efficient discharge measurement in water resources area. In order to achieve this goal, Chiu's velocity distribution equation recently developed from the probability and entropy concepts is used to establish, analyze and compare a linkage between the mean velocity obtained from the Manning's equation which is well known in the world. Besides, it becomes clear that a channel cross section also has a propensity to establish and maintain an equilibrium state that can be measured and classified by a function of entropy M, ratio of mean and maximum velocities irrespective of including sediment or varied channel slope. Therefore, The linkage to be established in this study can be used to compute the cross sectional velocity distribution with the maximum velocity.

• Journal of Fisheries and Marine Sciences Education
• /
• v.18 no.1
• /
• pp.19-30
• /
• 2006

For fishery stock assessment and optimum sustainable yield of anchovy in Korea, surplus production(SP) models and a maximum entropy(ME) model are employed in this paper. For determining appropriate models, five traditional SP models-Schaefer model, Schnute model, Walters and Hilborn model, Fox model, and Clarke, Yoshimoto and Pooley (CYP) model- are tested for effort and catch data of anchovy that occupies 7% in the total fisheries landings of Korea. Only CYP model of five SP models fits statistically significant at the 10% level. Estimated intrinsic growth rates are similar in both CYP and ME models, while environmental carrying capacity of the ME model is quite greater than that of the CYP model. In addition, the estimated maximum sustainable yield(MSY), 213,287 tons in the ME model is slightly higher than that of CYP model (198,364 tons). Biomass for MSY in the ME model, however, is calculated 651,000 tons which is considerably greater than that of the CYP model (322,881 tons). It is meaningful in that two models are compared for noting some implications about any significant difference of stock assessment and their potential strength and weakness.

• Bulletin of the Korean Chemical Society
• /
• v.16 no.6
• /
• pp.498-503
• /
• 1995

The adsorption behaviors of two major components purified, endo Ⅱ and exo Ⅱ, from Trichoderma viride were investigated using microcrystalline cellulose with different specific surface area as substrates. Adsorption was found to apparently obey the Langmuir isotherm and the thermodynamic parameters, ΔH, ΔS, and ΔG, were calculated from adsorption equilibrium constant,K. The adsorption process was found to be endothermic and an adsorption entropy-controlled reaction. The amount of adsorption of cellulase components increased with specific surface area and decreased with temperature and varied with a change in composition of the cellulase components. The maximum synergistic degradation occurred at the specific weight ratio of the cellulase components at which the maximum affinity of cellulase components obtains. The adsorption entropy and enthalpy for respective enzyme system increased with specific surface area increase. The adsorption entropy was shown to have a larger value with enzyme mixture.

• Current Optics and Photonics
• /
• v.5 no.1
• /
• pp.16-22
• /
• 2021

We present the Shannon entropy as an indicator of the spatial resolutions of the morphologies of the resonance mode patterns in an optical resonator. We obtain each optimized number of mesh points, one of minimum size and the other of maximum one. The optimized mesh-point number of minimum size is determined by the identifiable quantum number through a chi-squared test, whereas the saturation of the difference between Shannon entropies corresponds to the other mesh-point number of maximum size. We also show that the optimized minimum mesh-point increases as the (real) wave number increases and approximates the proportionality constant between them.