Browse > Article
http://dx.doi.org/10.5351/CKSS.2011.18.4.457

Improving Sample Entropy Based on Nonparametric Quantile Estimation  

Park, Sang-Un (Department of Applied Statistics, Yonsei University)
Park, Dong-Ryeon (Department of Statistics, Hanshin University)
Publication Information
Communications for Statistical Applications and Methods / v.18, no.4, 2011 , pp. 457-465 More about this Journal
Abstract
Sample entropy (Vasicek, 1976) has poor performance, and several nonparametric entropy estimators have been proposed as alternatives. In this paper, we consider a piecewise uniform density function based on quantiles, which enables us to evaluate entropy in each interval, and study the poor performance of the sample entropy in terms of the poor estimation of lower and upper quantiles. Then we propose some improved entropy estimators by simply modifying the quantile estimators, and compare their performances with some existing estimators.
Keywords
Kernel density estimator; maximum entropy; order statistics; sample entropy;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Dmitriev, Y. G. and Tarasenko, F. P. (1973). On the estimation of functionals of the probability density and its derivatives, Theory of Probability and its Applications, 18, 628-633.
2 Dudewicz, E. and van der Meulen, E. (1987). The empiric entropy, a new approach to nonparametric entropy estimation, New Prospectives in Theoretical and Applied Statistics, 207-227.
3 Ebrahimi, N., Pflughoeft, K. and Soofi, E. S. (1994). Two measures of sample entropy, Statistics and Probability Letters, 20, 225-234.   DOI   ScienceOn
4 Park, S. and Park, D. (2003). Correcting moments for goodness of fit tests based on two entropy estimates, Journal of Statistical Computation and Simulation, 73, 685-694.   DOI   ScienceOn
5 Reiss, R. D. (1981). Nonparametric estimation of smooth distribution functions, Scandinavian Journal of Statistics, 8, 116-119.
6 Shannon, C. E. (1948). A mathematical theory of communications, Bell System Technical Journal, 27, 379-423, 623-656.   DOI
7 Theil, H. (1980). The entropy of the maximum entropy distribution, Economics Letters, 5, 145-148.   DOI   ScienceOn
8 Vasicek, O. (1976). A test for normality based on sample entropy, Journal of the Royal Statistical Society, Series B, 38, 54-59.
9 Yang, S. S. (1985). A smooth nonparametric estimator of a quantile function, Journal of American Statistical Association, 80, 1004-1011.   DOI
10 Ahmad, I. A. and Lin, P. E. (1976). A nonparametric estimation of the entropy for absolutely continuous distributions, IEEE Transactions on Information Theory, 22, 372-375.   DOI
11 Bowman, A. W. (1992). Density based tests for goodness-of-fit, Journal of Statistical Computation and Simulation, 40, 1-13.   DOI   ScienceOn
12 Choi, B. and Kim, K. (2006). Testing goodness of fit for Laplace distribution based on maximum entropy, Statistics, 40, 517-531.   DOI   ScienceOn
13 Correa, J. C. (1995). A new estimator of entropy, Communications in Statistics: Theory and Method, 24, 2439-2449   DOI   ScienceOn