• The Korean Journal of Applied Statistics
• /
• v.24 no.2
• /
• pp.383-391
• /
• 2011

This paper presents a modified entropy-based test of fit for the inverse Gaussian distribution. The test is based on the entropy difference of the unknown data-generating distribution and the inverse Gaussian distribution. The entropy difference estimator used as the test statistic is obtained by employing Vasicek's sample entropy as an entropy estimator for the data-generating distribution and the uniformly minimum variance unbiased estimator as an entropy estimator for the inverse Gaussian distribution. The critical values of the test statistic empirically determined are provided in a tabular form. Monte Carlo simulations are performed to compare the proposed test with the previous entropy-based test in terms of power.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.4
• /
• pp.847-856
• /
• 2013

In this paper, we deal with testing goodness-of-fit for normal distribution based on parametric and nonparametric entropy estimators. The minimum variance unbiased estimator for the entropy of the normal distribution is derived as a parametric entropy estimator to be used for the construction of a test statistic. For a nonparametric entropy estimator of a data-generating distribution under the alternative hypothesis sample entropy and its modifications are used. The critical values of the proposed tests are estimated by Monte Carlo simulations and presented in a tabular form. The performance of the proposed tests under some selected alternatives are investigated by means of simulations. The results report that the proposed tests have better power than the previous entropy-based test by Vasicek (1976). In applications, the new tests are expected to be used as a competitive tool for testing normality.

• Communications for Statistical Applications and Methods
• /
• v.18 no.5
• /
• pp.625-636
• /
• 2011

This paper proposes two parametric entropy estimators, the minimum variance unbiased estimator and the maximum likelihood estimator, for the lognormal distribution for a comparison of the properties of the two estimators. The variances of both estimators are derived. The influence of the bias of the maximum likelihood estimator on estimation is analytically revealed. The distributions of the proposed estimators obtained by the delta approximation method are also presented. Performance comparisons are made with the two estimators. The following observations are made from the results. The MSE efficacy of the minimum variance unbiased estimator appears consistently high and increases rapidly as the sample size and variance, n and ${\sigma}^2$, become simultaneously small. To conclude, the minimum variance unbiased estimator outperforms the maximum likelihood estimator.

• The Korean Journal of Applied Statistics
• /
• v.19 no.3
• /
• pp.521-534
• /
• 2006

This paper considers a panel regression model with ill-posed data and proposes the generalized maximum entropy(GME) estimator of the unknown parameters. These are natural extensions from the biometries, statistics and econometrics literature. The performance of this estimator is investigated by using of Monte Carlo experiments. The results indicate that the GME method performs the best in estimating the unknown parameters.

• The Korean Journal of Applied Statistics
• /
• v.20 no.1
• /
• pp.79-89
• /
• 2007

A test for normality introduced by Arizono and Ohta(1989) is based on fullback-Leibler discrimination information. The test statistic is derived from the discrimination information estimated using sample entropy of Vasicek(1976) and the maximum likelihood estimator of the variance. However, these estimators are biased and so it is reasonable to make use of unbiased estimators to accurately estimate the discrimination information. In this paper, Arizono-Ohta test for normality is improved. The derived test statistic is based on the bias-corrected entropy estimator and the uniformly minimum variance unbiased estimator of the variance. The properties of the improved KL test are investigated and Monte Carlo simulation is performed for power comparison.

• Journal of the Korean Data and Information Science Society
• /
• v.10 no.2
• /
• pp.387-395
• /
• 1999

The goal of this paper is to study of the entropy - based on goodness-of-fit tests with several parametric models. It is also to study the relationship of the Moran's test statistic on the view of entropy.

• Communications for Statistical Applications and Methods
• /
• v.16 no.2
• /
• pp.265-275
• /
• 2009

This paper considers a linear regression model with a spatial autoregressive disturbance with ill-posed data and proposes the generalized maximum entropy(GME) estimator of regression coefficients. The performance of this estimator is investigated via Monte Carlo experiments. The results show that the GME estimator provides efficient and robust estimate for the unknown parameter.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.28 no.1
• /
• pp.25-39
• /
• 2018

NIST(National Institute of Standards and Technology) has recently published SP 800-90B second draft which is the document for evaluating security of entropy source, a key element of a cryptographic random number generator(RNG), and provided a tool implemented on Python code. In SP 800-90B, the security evaluation of the entropy sources is a process of estimating min-entropy by several estimators. The process of estimating min-entropy is divided into IID track and non-IID track. In IID track, the entropy sources are estimated only from MCV estimator. In non-IID Track, the entropy sources are estimated from 10 estimators including MCV estimator. The running time of the NIST's tool in non-IID track is approximately 20 minutes and the memory usage is over 5.5 GB. For evaluation agencies that have to perform repeatedly evaluations on various samples, and developers or researchers who have to perform experiments in various environments, it may be inconvenient to estimate entropy using the tool and depending on the environment, it may be impossible to execute. In this paper, we propose high-speed implementations and an efficient memory usage technique for min-entropy estimation algorithm of SP 800-90B. Our major achievements are the three improved speed and efficient memory usage reduction methods which are the method applying advantages of C++ code for improving speed of MultiMCW estimator, the method effectively reducing the memory and improving speed of MultiMMC by rebuilding the data storage structure, and the method improving the speed of LZ78Y by rebuilding the data structure. The tool applied our proposed methods is 14 times faster and saves 13 times more memory usage than NIST's tool.

• Environmental and Resource Economics Review
• /
• v.28 no.2
• /
• pp.277-306
• /
• 2019

Mackerel is one of the most widely consumed aquatic products in Korea. Concerns about the depletion of stocks have also arisen as the catch has decreased. The primary purpose of this study is to estimate the mackerel stock and derive the optimal level of catch in Korea. We apply a generalized maximum entropy econometric method to estimate the mackerel growth function, which does not require the steady state assumption. We incorporate a bootstrapping approach to derive the significance levels of parameter estimates. We found that the average ratio of catch to the estimated total stock was less than 30% before the 1990s but exceeded 40% in the 1990s. After 2000, it dropped back to about 36%. This finding indicates that mackerel may have been over-fished in the 1990s, but the government regulations introduced in the 2000s alleviated over-fishing problems. Nevertheless, our dynamic optimization analysis suggests that the total allowable catch may need to be carefully controlled to achieve socially optimal management of resources.

• Journal of Korea Society of Industrial Information Systems
• /
• v.5 no.2
• /
• pp.62-69
• /
• 2000

In this paper, we propose two Buckley-James type nonparametric estimators for entropy of lifetimes under random censorship model. We investigate the small sample behaviors of the proposed estimators when the underlying distribution has decreasing failure rate, constant failure rate, and increasing failure rate. Also some examples are illustrated for analysing data.