Browse > Article
http://dx.doi.org/10.5351/KJAS.2013.26.1.081

A New Statistical Index for Detecting Cheaters on Multiple Choice Tests  

Han, Eun Su (Division of Planning and Research, Korea National Institute of Health)
Lim, Johan (Department of Statistics, Seoul National University)
Lee, Kyeong Eun (Department of Statistics, Kyungpook National University)
Publication Information
The Korean Journal of Applied Statistics / v.26, no.1, 2013 , pp. 81-92 More about this Journal
Abstract
It is important to construct a firm basis for accusing potential violators of academic integrity in order to avoid spurious accusations and false convictions. Educational researchers have developed many statistical methods that can either uncover or confirm cases of cheating on tests. However, most of them rely on simple correlation-based measures, and often fail to account for patterns in responses or answers. In this paper, we propose a new statistical index denoted by a Standardized Signed Entropy Similarity Score to resolve this difficulty. In addition, we apply the proposed method to analyze a real data set and compare the results to other existing methods.
Keywords
Detecting Cheaters; Angoff's B; Crawford's method; Error Similarity Analysis; K index; Standardized Signed Entropy Similarity Score;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Angoff, W. H. (1974). The development of statistical indices for detecting cheaters, Journal of the American Statistical Association, 69, 44-49.   DOI   ScienceOn
2 Bellezza, F. S. and Bellezza, S. F. (1989). Detection of cheating on multiple-choice tests by using error similarity analysis, Teaching of Psychology, 16, 151-155.   DOI
3 Buss, W. G. and Novick, M. R. (1980). The detection of cheating on standardized tests: Statistical and legal analysis, Journal of Law and Education, 9, 1-64.
4 Crawford, C. C. (1930). Dishonesty in objective tests, School Review, 38, 776-781.   DOI   ScienceOn
5 Haney, W. M. (1993). Cheating and escheating on standardized tests, Paper presented at the annual meeting of the American Educational Research Association, Atlanta, GA.
6 Holland, P. W. (1996). Assessing unusual agreement between the incorrect answers of two examinees using the K-Index: Statistical theory and empirical support, ETS Research Report No.96-7. Princeton, NJ: Educational Testing Service.
7 Storey, J. D. (2003). The positive False Discovery Rate: A Bayesian interpretation and the q-value, The Annals of Statistics, 6, 2013-2035.