DOI QR코드

DOI QR Code

The Use of Confidence Interval of Measures of Diagnostic Accuracy

진단검사 정확도 평가지표의 신뢰구간

  • Oh, Tae-Ho (College of Veterinary Medicine, Kyungpook National University) ;
  • Pak, Son-Il (College of Veterinary Medicine and Institute of Veterinary Science, Kangwon National University)
  • 오태호 (경북대학교 수의과대학) ;
  • 박선일 (강원대학교 수의과대학 및 동물의학종합연구소)
  • Accepted : 2015.08.24
  • Published : 2015.08.31

Abstract

The performance of diagnostic test accuracy is usually summarized by a variety of statistics such as sensitivity, specificity, predictive value, likelihood ratio, and kappa. These indices are most commonly presented when evaluations of competing diagnostic tests are reported, and it is of utmost importance to compare the accuracies of diagnostic tests to decide on the best available test for certain medical disorder. However, it is important to emphasize that specific point values of these indices are merely estimates. If parameter estimates are reported without a measure of uncertainty (precision), knowledgeable readers cannot know the range within which the true values of the indices are likely to lie. Therefore, when evaluations of diagnostic accuracy are reported the precision of estimates should be stated in parallel. To reflect the precision of any estimate of a diagnostic performance characteristic or of the difference between performance characteristics, the computation of confidential interval (CI), an indicator of precision, is widely used in medical literatures in that CIs are more informative to interpret test results than the simple point estimates. The majority of peer-reviewed journals usually require CIs to be specified for descriptive estimates, whereas domestic veterinary journals seem less vigilant on this issues. This paper describes how to calculate the indices and associated CIs using practical examples when assessing diagnostic test performance.

Keywords

References

  1. Agresti A, Coull BA. Approximate is better than exact for interval estimation of binomial proportions. Am Stat 1998; 52: 119-126.
  2. Altman DA, Machin D, Bryant TN, Gardner MJ. Statistics with Confidence. 2nd ed. British Medical Journal, 2000.
  3. Beam CA. Analysis of clustered data in receiver operating characteristic studies. Stat Methods Med Res 1998; 7: 324-336. https://doi.org/10.1191/096228098669595619
  4. Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 1934; 26: 404-413. https://doi.org/10.1093/biomet/26.4.404
  5. Cox DR. The analysis of binary data. Methuen, London. 1970.
  6. Daly L. Simple SAS macros for the calculation of exact binomial and Poisson confidence limits. Comput Biol Med 1992; 22: 351-361. https://doi.org/10.1016/0010-4825(92)90023-G
  7. Fleiss JL. Statistical methods for rates and proportions. John Wiley & Sons, New York, 1981.
  8. ICMJE (International committee of medical journal editors). Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. ICMJE, 2014.
  9. Mercaldo ND, Lau KF, Zhou XH. Confidence intervals for predictive values with an emphasis to case-control studies. Stat Med 2007; 26: 2170-2183. https://doi.org/10.1002/sim.2677
  10. Mossman D, Berger JO. Intervals for posttest probabilities: a comparison of 5 methods. Med Decis Making 2001; 21: 498-507. https://doi.org/10.1177/02729890122062857
  11. Newcombe RG. Improved confidence intervals for the difference between binomial proportions based on paired data. Stat Med 1998; 17: 2635-2650. https://doi.org/10.1002/(SICI)1097-0258(19981130)17:22<2635::AID-SIM954>3.0.CO;2-C
  12. Pak SI, Lee YW. An introduction to data analysis. J Vet Clin 2009; 26: 189-199.
  13. Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol 1991; 44: 763-770. https://doi.org/10.1016/0895-4356(91)90128-V
  14. Wilson EB. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc 1927; 22: 209-212. https://doi.org/10.1080/01621459.1927.10502953
  15. Zhou XH1, Li CM, Yang Z. Improving interval estimation of binomial proportions. Philos Trans A Math Phys Eng Sci 2008; 366: 2405-2418. https://doi.org/10.1098/rsta.2008.0037