• The Korean Journal of Applied Statistics
• /
• v.24 no.2
• /
• pp.383-391
• /
• 2011

This paper presents a modified entropy-based test of fit for the inverse Gaussian distribution. The test is based on the entropy difference of the unknown data-generating distribution and the inverse Gaussian distribution. The entropy difference estimator used as the test statistic is obtained by employing Vasicek's sample entropy as an entropy estimator for the data-generating distribution and the uniformly minimum variance unbiased estimator as an entropy estimator for the inverse Gaussian distribution. The critical values of the test statistic empirically determined are provided in a tabular form. Monte Carlo simulations are performed to compare the proposed test with the previous entropy-based test in terms of power.

• Bulletin of the Korean Mathematical Society
• /
• v.53 no.2
• /
• pp.351-363
• /
• 2016

In this paper, we consider the entropy-based goodness of fit test (Vasicek's test) for a composite hypothesis. The test measures the discrepancy between the nonparametric entropy estimate and the parametric entropy estimate obtained from an assumed parametric family of distributions. It is shown that the proposed test is asymptotically normal under regularity conditions, but is affected by parameter estimates. As a remedy, a bootstrap version of Vasicek's test is proposed. Simulation results are provided for illustration.

• Journal of The Korean Association For Science Education
• /
• v.32 no.3
• /
• pp.415-427
• /
• 2012

In this study, we conducted preliminary survey, diagnostic test and in-depth interview in order to study Korean pre-service chemistry teachers' understanding on entropy and investigate how Korean pre-service chemistry teachers deal with the natural phenomenon which is related to entropy conceptions. Firstly, as a result of the preliminary survey, it was found that pre-service chemistry teachers strongly recognized entropy as the degree of disorder. Secondly, the diagnostic test showed pre-service chemistry teachers were mostly confused about whether the entropy of the universe increases during a spontaneous change, and they had a tendency to interpret the natural phenomenon related to entropy change as the change of disorder. Finally, during in-depth interview, after we explained entropy change in all diagnostic test questions with the concept of microstate, pre-service chemistry teachers revealed a better understanding about entropy. Through this research, pre-service chemistry teachers had an opportunity to reflect on their deficiencies of entropy conceptions, which will ultimately help students to approach the concept of entropy more correctly.

• Communications for Statistical Applications and Methods
• /
• v.19 no.6
• /
• pp.837-847
• /
• 2012

Inverse Gaussian distribution is widely used in applications to analyze and model right-skewed data. To assess the appropriateness of the distribution prior to data analysis, Mudholkar and Tian (2002) proposed an entropy-based test of fit. The test is based on the entropy power fraction(EPF) index suggested by Gokhale (1983). The simulation results report that the power of the entropy-based test is superior compared to other goodness-of-fit tests; however, this observation is based on the small-scale simulation results on the standard exponential, Weibull W(1; 2) and lognormal LN(0:5; 1) distributions. A large-scale simulation should be performed against various alternative distributions to evaluate the power of the entropy-based test; however, the use of a theoretical method is more effective to investigate the powers. In this paper, utilizing the information discrimination(ID) index defined by Ehsan et al. (1995) as a mathematical tool, we scrutinize the power of the entropy-based test. The selected alternative distributions are the gamma, Weibull and lognormal distributions, which are widely used in data analysis as an alternative to inverse Gaussian distribution. The study results are provided and an illustrative example is analyzed.

• Journal of the Korean Mathematical Society
• /
• v.50 no.4
• /
• pp.879-897
• /
• 2013

Shannon entropy is one of the widely used randomness measures especially for cryptographic applications. However, the conventional entropy tests are less sensitive to the inter-bit dependency in random samples. In this paper, we propose new online randomness test schemes for true random number generators (TRNGs) based on the mutual information between consecutive ${\kappa}$-bit output blocks for testing of inter-bit dependency in random samples. By estimating the block entropies of distinct lengths at the same time, it is possible to measure the mutual information, which is closely related to the amount of the statistical dependency between two consecutive data blocks. In addition, we propose a new estimation method for entropies, which accumulates intermediate values of the number of frequencies. The proposed method can estimate entropy with less samples than Maurer-Coron type entropy test can. By numerical simulations, it is shown that the new proposed scheme can be used as a reliable online entropy estimator for TRNGs used by cryptographic modules.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.3
• /
• pp.637-642
• /
• 2013

In this paper, we consider the maximum entropy test in in nite order autoregressiv models. Its asymptotic distribution is derived under the null hypothesis. A bootstrap version of the test is discussed and its performance is evaluated through Monte Carlo simulations.

• Journal of the Korean Data and Information Science Society
• /
• v.15 no.1
• /
• pp.119-127
• /
• 2004

To test uniformity of a population, we modify the test statistic based on the sample entropy in the literature, and establish its limiting distribution under weaker conditions, which improves the existing results. It is also to study the proposed test statistic based on Vasicek's entropy estimator is consistent.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.4
• /
• pp.847-856
• /
• 2013

In this paper, we deal with testing goodness-of-fit for normal distribution based on parametric and nonparametric entropy estimators. The minimum variance unbiased estimator for the entropy of the normal distribution is derived as a parametric entropy estimator to be used for the construction of a test statistic. For a nonparametric entropy estimator of a data-generating distribution under the alternative hypothesis sample entropy and its modifications are used. The critical values of the proposed tests are estimated by Monte Carlo simulations and presented in a tabular form. The performance of the proposed tests under some selected alternatives are investigated by means of simulations. The results report that the proposed tests have better power than the previous entropy-based test by Vasicek (1976). In applications, the new tests are expected to be used as a competitive tool for testing normality.

• Communications for Statistical Applications and Methods
• /
• v.8 no.1
• /
• pp.193-207
• /
• 2001

When designing a test set, we need to consider constraints on items that are deemed important by item developers or test specialists. The constraints are essentially on the components of the test domain or abilities relevant to a given test set. And so if the test domain could be represented in a more refined form, test construction would be made in a more efficient way. We assume that relationships among task abilities are representable by a causal model and that the item response theory (IRT) is not fully available for them. In such a case we can not apply traditional item selection methods that are based on the IRT. In this paper, we use entropy as an uncertainty measure for making inferences on task abilities and developed an optimal item selection algorithm which reduces most the entropy of task abilities when items are selected from an item pool.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.1
• /
• pp.259-268
• /
• 2006

For Type-II censored sample, we propose three modified entropy estimators based on the Vasieck's estimator, van Es' estimator, and Correa's estimator. We also propose the goodness-of-fit tests of the Weibull distribution based on the modified entropy estimators. We simulate the mean squared errors (MSE) of the proposed entropy estimators and the powers of the proposed tests. We also compare the proposed tests with the modified Kolmogorov-Smirnov and Cramer-von-Mises tests which were proposed by Kang et al. (2003).