Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Permutation Test for the Equality of Several Independent Cronbach's Alpha Coefficients

  • Um, Yonghwan (Division of Industrial and Management Engineering, Sungkyul University)
  • Received : 2019.04.19
  • Accepted : 2019.05.31
  • Published : 2019.06.28
Download PDF
⟨ Previous Next ⟩

Abstract

The statistical inference of Cronbach's alpha measure of internal reliability is known to be inaccurate when sample size is small and the assumption of normality is violated. In this paper, we describe the permutation method in which we compute resampling p-values for testing the difference between two or more independent Cronbach's alpha coefficients. When the over-all permutation test is significant, we also make pairwise post-hoc comparisons using permutaion method. The permutation tests for the equality of two independent Cronbach's alpha coefficients and three independent Cronbach's alpha coefficients are illustrated with an example analysis of survey data.

Keywords

Table 1. Survey data on female college students’ consumption propensity

CPTSCQ_2019_v24n6_159_t0001.png 이미지

Table 2. Observed alpha coefficients($\widehat{{\alpha}_A}$, $\widehat{{\alpha}_B}$)

CPTSCQ_2019_v24n6_159_t0002.png 이미지

Table 3. p values for testing equality of two alpha coefficients

CPTSCQ_2019_v24n6_159_t0003.png 이미지

Table 4. Survey data on primary school students’(2nd, 3rd, 4th grade) sociality

CPTSCQ_2019_v24n6_159_t0004.png 이미지

Table 5. Observed alpha coefficients($\widehat{{\alpha}_A}$, $\widehat{{\alpha}_B}$, $\widehat{{\alpha}_C}$)

CPTSCQ_2019_v24n6_159_t0005.png 이미지

Table 6. p values for over-all test and post-hoc test

CPTSCQ_2019_v24n6_159_t0006.png 이미지

Table 7. Resampling permutation p values for over-all test and post-hoc test

CPTSCQ_2019_v24n6_159_t0007.png 이미지

References

  1. R. A. Peterson, A meta-analysis of Cronbach's alpha. The Journal of Consumer Research, 21, 381-391. 1994. https://doi.org/10.1086/209405
  2. W. Kristof, The statistical theory of stepped-up reliability coefficients when a test has been divided into deveral equivalent parts, Psychometrika, 28, 221-238, 1963. https://doi.org/10.1007/BF02289571
  3. L. S. Feldt, The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty, Psychometrika, 30, 357-370, 1965. https://doi.org/10.1007/BF02289499
  4. L. S. Feldt, D. J. Woodruff, and F. A. Salih, Statistical inference for coefficient alpha, Applied Psychological Measurement, 11, 93-103, 1987. https://doi.org/10.1177/014662168701100107
  5. L. S. Feldt, A test of the hypothesis for Cronbach's alpha or Kuder-Richardson coefficient twenty is the same for two tests, Psychometrika, 34, 363-373, 1969. https://doi.org/10.1007/BF02289364
  6. A. R. Hakstian and T. E. Whalen, A k-sample significance test for independent alpha coefficients, Psychometrika, 41, 219-231, 1976. https://doi.org/10.1007/BF02291840
  7. L. S. Feldt, A test of the hypothesis that Cronbach's alpha reliability coefficient is the same for two tests administered to the same sample, Psychometrika, 45, 99-105, 1980. https://doi.org/10.1007/BF02293600
  8. D. J. Woodruff and L. S. Feldt, Tests for equality of several alpha coefficients when their sample estimates are dependent, Psychometrika, 51, 393-413, 1986. https://doi.org/10.1007/BF02294063
  9. R. A. Fisher, A design of experiment, Oliver & Boyd, Edinburgh, 1935.
  10. E. S. Edington and P. Onghena, Randomization tests, (4th ed.) Boca Raton, FL: Chapman & Hall/CRC, 2007.
  11. A.J. Prelog, K.J. Berry, and P.W. Mielke, Resampling Permutation Probability Values For Cronbach's Alpha, Perceptual and motor skills, 108, 2, 431-439, 2009. https://doi.org/10.2466/pms.108.2.431-438
  12. Y. Um, Permutation Analysis of Split-Half Reliability Coefficient, Journal of the Korea society of computer and information, 22, 7, 133-139, 2017. https://doi.org/10.9708/JKSCI.2017.22.07.133
  13. C. B. Holms, Sample size in Psychological research, Percepyual and Motor Skills, 49, 283-288, 1979. https://doi.org/10.2466/pms.1979.49.1.283
  14. P. W. Mielke and K. J. Berry, Permutation methods : A distance function approach, Springer-Verlag, New York. 2001.
  15. P. I. Good, Permutation tests: A practical guide to data analysis, 2nd ed. Birkhauser, Massachusetts, 2001.
  16. M. H. Huh, SPSS Questionnaire Survey Methods: from Basic to Practical Use. Hannnare Publishing Col, 2010.
  17. E. H. Suh, SPSS Statistical Analysis, Free Academy, 2005.