Journal of the Korean Statistical Society

  • 제26권1호
  • /
  • Pages.131-146
  • /
  • 1997
  • /
  • 1226-3192(pISSN)
  • /
  • 2005-2863(eISSN)
한국통계학회 (The Korean Statistical Society)
권호 표지

On Information Theoretic Index for Measuring the Stochastic Dependence Among Sets of Variates

  • Kim, Hea-Jung (Department of Statistics, Dongguk University, Seoul, 100-715)
  • 발행 : 1997.03.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

In this paper the problem of measuring the stochastic dependence among sets fo random variates is considered, and attention is specifically directed to forming a single well-defined measure of the dependence among sets of normal variates. A new information theoretic measure of the dependence called dependence index (DI) is introduced and its several properties are studied. The development of DI is based on the generalization and normalization of the mutual information introduced by Kullback(1968). For data analysis, minimum cross entropy estimator of DI is suggested, and its asymptotic distribution is obtained for testing the existence of the dependence. Monte Carlo simulations demonstrate the performance of the estimator, and show that is is useful not only for evaluation of the dependence, but also for independent model testing.

키워드

참고문헌

  1. An Introduction to Multivariate Statistical Analysis Anderson, T.W.
  2. Communication in Statistics-Theory and Methods v.19 no.1 On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models Bozdogan, H.
  3. Biometrika v.36 A general distribution theory for a class of likelihood criteia Box, G.E.P.
  4. In Recent Theorietical Developments in Control An information theoretic approach to estimation Harris, C.J.;M.J. Gregson(ed.)
  5. Entropy Optimization Principles with Applications Kapur, J.N.;Kesavan, H.J.
  6. Information Theory and Statistics Kullback, S.
  7. Annals of Mathematical Statistics v.22 On information and sufficiency Kullback, S.;Leibler, R.A.
  8. Biometrika v.64 A note on the estimation of probability density functions Murray, G.D.
  9. Akaike Information Criterion Statistics Sakamoto, Y.;Ishiguro, M.;Kitagawa, G.
  10. SIAM Review v.4 Normal functions of normal variables Shepp, L.
  11. IEEE Transactions on Information Theory v.IT26 no.1 Axiomatic deviation of the principle of maximum entropy and the principle of minimum cross entropy Shore, J.E.;Johnson, R.W.
  12. Journal of American Statistical Association v.89 Capturing the intangible concept of information Soofi, E.S.
  13. Exploiting Continuity; Maximum Entropy Estimation of Continuous Distributions Theil, H.;Fiebig, D.G.
  14. Pattern Recognition: Human and Mechanical Watanabe, S.