DOI QR코드

DOI QR Code

Analysis of Statistical Methods and Errors in the Articles Published in the Korean Journal of Pain

  • Yim, Kyoung-Hoon (Department of Anesthesiology and Pain Medicine, Seoul National University Bundang Hospital) ;
  • Nahm, Francis Sahn-Gun (Department of Anesthesiology and Pain Medicine, Seoul National University Bundang Hospital) ;
  • Han, Kyoung-Ah (Department of Anesthesiology and Pain Medicine, Seoul National University Hospital) ;
  • Park, Soo-Young (Department of Anesthesiology and Pain Medicine, Seoul National University Hospital)
  • Received : 2009.10.16
  • Accepted : 2009.11.11
  • Published : 2010.03.01

Abstract

Background: Statistical analysis is essential in regard to obtaining objective reliability for medical research. However, medical researchers do not have enough statistical knowledge to properly analyze their study data. To help understand and potentially alleviate this problem, we have analyzed the statistical methods and errors of articles published in the Korean Journal of Pain (KJP), with the intention to improve the statistical quality of the journal. Methods: All the articles, except case reports and editorials, published from 2004 to 2008 in the KJP were reviewed. The types of applied statistical methods and errors in the articles were evaluated. Results: One hundred and thirty-nine original articles were reviewed. Inferential statistics and descriptive statistics were used in 119 papers and 20 papers, respectively. Only 20.9% of the papers were free from statistical errors. The most commonly adopted statistical method was the t-test (21.0%) followed by the chi-square test (15.9%). Errors of omission were encountered 101 times in 70 papers. Among the errors of omission, "no statistics used even though statistical methods were required" was the most common (40.6%). The errors of commission were encountered 165 times in 86 papers, among which "parametric inference for nonparametric data" was the most common (33.9%). Conclusions: We found various types of statistical errors in the articles published in the KJP. This suggests that meticulous attention should be given not only in the applying statistical procedures but also in the reviewing process to improve the value of the article.

Keywords

References

  1. Rosenbaum SH. Statistical methods in anesthesia. In: Miller's anesthesia. 7th ed. Edited by Miller RD. Philadelphia, Elsevier Inc. 2009, pp 3075-86.
  2. Ahn YO, Lee HK. Development of a checklist for assessing the methodological and statistical validity of medical articles. Korean J Med Educ 1991; 3: 19-35.
  3. Park HC, Choi DH, Ahn SV, Kang JO, Kim ES, Park W, et al. Statistical errors in papers published in the journal of the Korean society for therapeutic radiology and oncology. J Korean Soc Ther Radiol Oncol 2008; 26: 289-94. https://doi.org/10.3857/jkstro.2008.26.4.289
  4. Park IK, Kang JO, Kim TY, Keum DG. An Evaluation of the statistical techniques used in the 1995-1996 editions of the Korean journal of clinical pathology. Korean J Clin Pathol 1999; 19: 460-4.
  5. Yu TY, Jin Y, Jeong TO, Lee JB. Statistical methods in the articles in the journal of the Korean society of emergency medicine published from 1998 to 2002. J Korean Soc Emerg Med 2003; 14: 475-80.
  6. Shin MH, Son YI, Cho YS, Kim HY, Ha BS, Kim SI. The use of statistical analysis-In the Korean journal of otolaryngology- Head and Neck Surgery-. Korean J Otolaryngol-Head Neck Surg 1999; 42: 1364-9.
  7. Ko H, Kwak IY, Choe IH, Ham BM, Kim KW. Statistical methods in the articles of the journal of the Korean society of anesthesiologists from 1981 to 1990. Korean J Anesthesiol 1993; 26: 22-7. https://doi.org/10.4097/kjae.1993.26.1.22
  8. Song K, Han M, Cheong MY, Lim KS, Kim DK. Clinical research design and biostatistical methods. Korean J Urol 2005; 46: 835-41.
  9. Kim BS, Lee YG, Lee TR. Categorical data analysis. Seoul, Korea National Open University Press. 2004, pp 32-5.
  10. Song KI, Choi JS. Clinical data analysis by SPSS 15-A practical guide for clinicians. Seoul, Hannarae publishing Co. 2008, pp 31-3, 55-61.
  11. Ahn JU, Yoo KY. Statistical analysis in medicine and public health. 2nd ed. Seoul, Hannarae publishing Co. 2006, pp 311-78.
  12. Hwang K, Lee HJ, Kim YJ, Lee SI. Statistical errors in papers in the journal of Korean society of plastic and reconstructive surgeons (JKPRS). J Korean Soc Plast Reconstr Surg 2001; 28: 302-9.
  13. White SJ. Statistical errors in papers in the British journal of psychiatry. Br J Psychiatry 1979; 135: 336-42. https://doi.org/10.1192/bjp.135.4.336
  14. MacArthur RD, Jackson GG. An evaluation of the use of statistical methodology in the journal of infectious diseases. J Infect Dis 1984; 149: 349-54. https://doi.org/10.1093/infdis/149.3.349
  15. Pocock SJ, Hughes MD, Lee RJ. Statistical problems in the reporting of clinical trials. A survey of three medical journals. N Engl J Med 1987; 317: 426-32. https://doi.org/10.1056/NEJM198708133170706
  16. Gore SM, Jones IG, Rytter EC. Misuse of statistical methods: critical assessment of articles in BMJ from January to March 1976. Br Med J 1977; 1: 85-7. https://doi.org/10.1136/bmj.1.6053.85
  17. Avram MJ, Shanks CA, Dykes MH, Ronai AK, Stiers WM. Statistical methods in anesthesia articles: an evaluation of two American journals during two six-month periods. Anesth Analg 1985; 64: 607-11.
  18. Altman DG, Gore SM, Gardner MJ, Pocock SJ. Statistical guidelines for contributors to medical journals. Br Med J (Clin Res Ed) 1983; 286: 1489-93. https://doi.org/10.1136/bmj.286.6376.1489
  19. Gardner MJ, Machin D, Campbell MJ. Use of check lists in assessing the statistical content of medical studies. Br Med J (Clin Res Ed) 1986; 292: 810-2. https://doi.org/10.1136/bmj.292.6523.810
  20. Reed JF 3rd, Salen P, Bagher P. Methodological and statistical techniques: what do residents really need to know about statistics? J Med Syst 2003; 27: 233-8. https://doi.org/10.1023/A:1022519227039

Cited by

  1. Misuse of Statistical Methods in 10 Leading Chinese Medical Journals in 1998 and 2008 vol.11, pp.1537-744X, 2011, https://doi.org/10.1100/2011/139494
  2. Thyroid Nodule Recognition Based on Feature Selection and Pixel Classification Methods vol.26, pp.1, 2013, https://doi.org/10.1007/s10278-012-9475-5
  3. T test as a parametric statistic vol.68, pp.6, 2015, https://doi.org/10.4097/kjae.2015.68.6.540
  4. Nonparametric statistical tests for the continuous data: the basic concept and the practical use vol.69, pp.1, 2016, https://doi.org/10.4097/kjae.2016.69.1.8
  5. Practical statistics in pain research vol.30, pp.4, 2017, https://doi.org/10.3344/kjp.2017.30.4.243
  6. Analysis of the Potential of Entrepreneurship Education in Young Children vol.9, pp.1, 2018, https://doi.org/10.1515/erj-2017-0064
  7. A Correlation Analysis of the Relationship between Land Use and Land Cover/Land Surface Temperature in Abuja Municipal, FCT, Nigeria vol.11, pp.01, 2019, https://doi.org/10.4236/jgis.2019.111004
  8. Examination of data analyses used for master's theses in educational sciences vol.9, pp.None, 2010, https://doi.org/10.1016/j.sbspro.2010.12.351
  9. Policy of reviewing statistics in Indian medical and surgical journals vol.4, pp.2, 2010, https://doi.org/10.4103/0976-500x.110897
  10. Statistical methods and errors in family medicine articles between 2010 and 2014-Suez Canal University, Egypt: A cross-sectional study vol.5, pp.1, 2010, https://doi.org/10.4103/2249-4863.184619
  11. EĞİTİM BİLİMLERİ ALANINDAKİ LİSANSÜSTÜ TEZLERDE VARSAYIM KULLANIMI vol.18, pp.2, 2010, https://doi.org/10.17240/aibuefd.2018.18.37322-431426
  12. The Use and Misuse of Statistical Methods in Cytopathology Studies: Review of 6 Journals vol.50, pp.1, 2010, https://doi.org/10.1093/labmed/lmy036
  13. Spatiotemporal Change Characteristics of Nodes’ Heterogeneity in the Directed and Weighted Spatial Interaction Networks: Case Study within the Sixth Ring Road of Beijing, China vol.11, pp.22, 2010, https://doi.org/10.3390/su11226359
  14. Pain scores and statistical analysis-the conundrum vol.12, pp.1, 2010, https://doi.org/10.1186/s42077-020-00085-8
  15. An Introduction to Statistics: Choosing the Correct Statistical Test vol.25, pp.suppl2, 2010, https://doi.org/10.5005/jp-journals-10071-23815
  16. A Review of Statistical Reporting in Dietetics Research (2010-2019): How is a Canadian Journal Doing? vol.82, pp.2, 2021, https://doi.org/10.3148/cjdpr-2021-005