Browse > Article
http://dx.doi.org/10.9708/jksci.2013.18.1.177

Assessing Classification Accuracy using Cohen's kappa in Data Mining  

Um, Yonghwan (Division of Industrial and Management Engineering, Sungkyul University)
Publication Information
Journal of the Korea Society of Computer and Information / v.18, no.1, 2013 , pp. 177-183 More about this Journal
Abstract
In this paper, Cohen's kappa and weighted kappa are applied to measuring classification accuracy when performing classification in data minig. Cohen's kappa compensates for classifications that may be due to chance and is used for the data with nominal or ordinal scales. Especially, for the ordinal data, weighted kappa which measures the classification accuracy by quantifying the classification errors as weights is used. We used two weights (linear weight, quadratic weight) for calculations of weighted kappa. Also for the calculation and comparison of kappa and weighted kappa we used a real data set, fat-liver data.
Keywords
classification accuracy; ordinal data; weighted Cohen's kappa;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Hollmen, M. Skubacz, and M. Taniguchi, "Input Dependent Misclassification costs for cost-sensitive classifiers". In N. Ebechen & C.Brebbia(Eds.), Data Mining II - Proceedings of the Second International Conference on Data Mining (pp. 495-503) Cambridge. MA: MIT Press, 2000.
2 D. D. Margineantu, and T. G. Ditterich, "Boostrap Methods for the Cost-sensitive Evaluation of Classifiers", In: Proceedings of the Seventh International Conference on Machine Learning, Morgan Kauffmann (pp. 582-590), 2000
3 J. Cohen, "A Coefficient of Agreement for Nominal Scales", Educational and Psychological Measurement, 20, 37-46, 1960.   DOI
4 J. Cohen, "Weighted Kappa: Nominal Scale Agreement with Provision for Scaled Disagreement or Partial Credit", Psychological Bulletin, 70, 213-220, 1968.   DOI
5 J. L. Fleiss, "Statistical Methods for Rates and Proportions (2nd ed.)", New York: Wiley, 1981.
6 J. J. Barko, and W. T. Carpenter, "On the Methods and Theory of Reliability", The Journal of Nervous and Mental Disease, 163, 307-317, 1976.   DOI
7 J. R. Landis, and G. G. Koch, "Measurement of Observer Agreement for Categorical Data", Biometrics, 33, 159-174, 1977.   DOI   ScienceOn
8 H. S. Bae, et. al. "SAS Enterprise Miner, Data Mining", Kyowoo Co. 2004.
9 B. S. Everitt, "The Analysis of Contingency Tables", London: Chapman and Hall, 1977.