Journal of Korean Medicine Rehabilitation (한방재활의학과학회지)

The society of Korean Medicine Rehabilitation (한방재활의학과학회)
권호 표지
DOI QR코드

DOI QR Code

Reporting Qualitative Research of Systematic Review in the Journal of Korean Medicine Rehabilitation According to Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 Guidelines

PRISMA 2020 지침에 근거한 한방재활의학과학회지 체계적 문헌고찰 보고의 질 평가 연구

  • Na, Hyeon-Uk (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University) ;
  • Park, Shin-Hyeok (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University) ;
  • Woo, Hyeon-Jun (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University) ;
  • Han, Yun-Hee (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University) ;
  • Geum, Ji-Hye (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University) ;
  • Lee, Jung-Han (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University) ;
  • Ha, Won-Bae (Chuna Manual Medicine Research Group, College of Korean Medicine Wonkwang University)
  • 나현욱 (원광대학교 한의과대학 추나의학연구회) ;
  • 박신혁 (원광대학교 한의과대학 추나의학연구회) ;
  • 우현준 (원광대학교 한의과대학 추나의학연구회) ;
  • 한윤희 (원광대학교 한의과대학 추나의학연구회) ;
  • 금지혜 (원광대학교 한의과대학 추나의학연구회) ;
  • 이정한 (원광대학교 한의과대학 추나의학연구회) ;
  • 하원배 (원광대학교 한의과대학 추나의학연구회)
  • Received : 2022.06.20
  • Accepted : 2022.07.03
  • Published : 2022.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives The purpose of this study was to assess the reporting quality of systematic reviews and meta-analyses in the Journal of Korean Medicine Rehabilitation (JKMR) using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guidelines. Methods Systematic reviews and meta-analyses in JKMR, published from January 1991 to January 2022, were selected by searching the Korean studies Information Service System and JKMR homepage. Two independent researchers searched and selected systematic reviews and meta-analyses and evaluated the reporting quality of abstracts and main texts using the PRISMA 2020 guidelines. Results Of 1,515 articles, 39 systematic reviews were finally included for assessment. Evaluation of abstracts resulted in 2 studies rated as high, 11 studies rated as moderate, and 26 studies rated as low. A maximum of 83.3% and a minimum of 25.0% of the items were reported in the abstracts. Evaluation of the manuscripts resulted in no studies rated as high, 14 studies rated as moderate, and 25 studies rated as low. A maximum of 67.9% and a minimum of 34.1% of the items were reported in the manuscripts. Conclusions To improve the quality of systematic reviews published in JKMR, it is necessary to conduct systematic reviews based on the PRISMA 2020 guidelines.

Keywords

References

  1. Mulrow CD. Rationale for systematic reviews. BMJ. 1994;309(6954):597-9. https://doi.org/10.1136/bmj.309.6954.597
  2. Gurevitch J, Koricheva J, Nakagawa S, Stewart G. Meta-analysis and the science of research synthesis. Nature. 2018;555(7695):175-82. https://doi.org/10.1038/nature25753
  3. Gough D, Thomas J, Oliver S. Clarifying differences between reviews within evidence ecosystems. Syst Rev. 2019;8(1):170. https://doi.org/10.1186/s13643-019-1089-2
  4. Pussegoda K, Turner L, Garritty C, Mayhew A, Skidmore B, Stevens A, Boutron I, Sarkis-Onofre R, Bjerre LM, Hrobjartsson A, Altman DG, Moher D. Systematic review adherence to methodological or reporting quality. Syst Rev. 2017;6(1):131. https://doi.org/10.1186/s13643-017-0527-2
  5. Moher D. Reporting guidelines: doing better for readers. BMC Med. 2018;16(1):233. https://doi.org/10.1186/s12916-018-1226-0
  6. Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007;4(3):e78. https://doi.org/10.1371/journal.pmed.0040078
  7. McKenzie JE, Brennan SE, Ryan RE, Thomson HJ, Johnston RV. Cochrane handbook for systematic reviews of interventions. Chichester:John Wiley&Sons. 2019:229-40.
  8. Higgins JPT, Lopez-Lopez JA, Becker BJ, Davies SR, Dawson S, Grimshaw JM, McGuinness LA, Moore THM, Rehfuess EA, Thomas J, Caldwell DM. Synthesising quantitative evidence in systematic reviews of complex health interventions. BMJ Glob Health. 2019;4(Suppl 1):e000858. https://doi.org/10.1136/bmjgh-2018-000858
  9. Campbell M, McKenzie JE, Sowden A, Katikireddi SV, Brennan SE, Ellis S, Hartmann-Boyce J, Ryan R, Shepperd S, Thomas J, Welch V, Thomson H. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890.
  10. Sterne JAC, Savovic J, Page MJ, Elbers RG, Blencowe NS, Boutron I, Cates CJ, Cheng HY, Corbett MS, Eldridge SM, Emberson JR, Hernan MA, Hopewell S, Hrobjartsson A, Junqueira DR, Juni P, Kirkham JJ, Lasserson T, Li T, McAleenan A, Reeves BC, Shepperd S, Shrier I, Stewart LA, Tilling K, White IR, Whiting PF, Higgins JPT. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898.
  11. Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I, Carpenter JR, Chan AW, Churchill R, Deeks JJ, Hrobjartsson A, Kirkham J, Juni P, Loke YK, Pigott TD, Ramsay CR, Regidor D, Rothstein HR, Sandhu L, Santaguida PL, Schunemann HJ, Shea B, Shrier I, Tugwell P, Turner L, Valentine JC, Waddington H, Waters E, Wells GA, Whiting PF, Higgins JP. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.
  12. Whiting P, Savovic J, Higgins JP, Caldwell DM, Reeves BC, Shea B, Davies P, Kleijnen J, Churchill R; ROBIS Group. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225-34. https://doi.org/10.1016/j.jclinepi.2015.06.005
  13. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, Moher D, Tugwell P, Welch V, Kristjansson E, Henry DA. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. https://doi.org/10.1136/bmj.j4008
  14. Booth A, Clarke M, Dooley G, Ghersi D, Moher D, Petticrew M, Stewart L. The nuts and bolts of PROSPERO: an international prospective register of systematic reviews. Syst Rev. 2012;1:2. https://doi.org/10.1186/2046-4053-1-2
  15. Moher D, Stewart L, Shekelle P. Establishing a new journal for systematic review products. Syst Rev. 2012;1:1. https://doi.org/10.1186/2046-4053-1-1
  16. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hrobjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. J Clin Epidemiol. 2021;134:178-89. https://doi.org/10.1016/j.jclinepi.2021.03.001
  17. Song EH, Park SJ, Lin A, Kim KH, Jun JH, Lee MS. Methodological and reporting quality of systematic reviews published in Journal of Society of Preventive Korean Medicine. Society of Preventive Korean Medicine. 2019;23(2):67-76. https://doi.org/10.25153/spkom.2019.23.2.006
  18. Shim SB, Lee JA, Lee HL. Evaluation of the reporting and methodological quality of the systematic review from the Journal of Pediatrics of Korean Medicine. The Journal of Pediatrics of Korean Medicine. 2020;34(1):26-36. https://doi.org/10.7778/JPKM.2020.34.1.26
  19. Seo JH, Kang SH, Hur DH, Lee DN, Kim HJ. A methodological and reporting quality assessment of the systematic reviews in the Journal of Korean Obstetrics and Gynecology. The Journal of Oriental Gynecology. 2021;34(2):108-23.
  20. An N, Ge L, Liu YC, Xu JF, Liang L, Ma JC, Wang J, Shi XT, Tian JH. A PRISMA assessment of the reporting quality of systematic reviews or meta-analysis of interventions on diabetic nephropathy. Abstracts of the 21st Cochrane Colloquium. 2013:19-23.
  21. Do SR, Lee SJ, Park JS, Park TY, Lee JH, Cho JH, Hwang EH, Kim KJ, Choi MY, Song YK. Effects of acupuncture after rotator cuff surgery: a systematic review. J Korean Med Rehabil. 2021;31(4):25-34.
  22. Do SR, Lee SJ, Park JS, Park TY, Lee JH, Cho JH, Hwang EH, Kim KJ, Choi MY, Song YK. Effects of herbal medicine after total knee arthroplasty: a systematic review and meta-analysis. J Korean Med Rehabil. 2021;31(4):35-47. https://doi.org/10.18325/jkmr.2021.31.4.35
  23. Park SM, Jung SU, Park JH, Do HJ, Cho SW. Systematic review and meta-analysis on acupotomy for piriformis muscle syndrome. J Korean Med Rehabil. 2021;31(2):25-40.
  24. Chung IC, Kim YE, Ahn JH, Han IS, Park IH, Cha YY. Chuna manual therapy for lymphedema: a systematic review and meta-analysis. J Korean Med Rehabil. 2021;31(2):15-24. https://doi.org/10.18325/jkmr.2021.31.2.15
  25. Kim YE, Chung IC, Cha YY, Han IS, Park IH. Electroacupuncture for cervical vertigo: a systematic review and meta-analysis. J Korean Med Rehabil. 2021;31(1):109-18.
  26. Jerng UM. Effectiveness of exercise after lung cancer surgery: a systematic review in PubMed database. J Korean Med Rehabil. 2021;31(1):149-63. https://doi.org/10.18325/jkmr.2021.31.1.149
  27. Hong SM, Ha HJ, Yoon KS. Chuna manual therapy for spondylolisthesis: a systematic review and meta-analysis. J Korean Med Rehabil. 2020;30(4):65-77. https://doi.org/10.18325/jkmr.2020.30.4.65
  28. Oh EM, Hong SM, Kim HG, Lee EJ. Electoacupuncture for patients undergoing hip arthroplasty: a systematic review and meta-analysis. J Korean Med Rehabil. 2020;30(4):105-17.
  29. Oh EM, Lee EJ. The effect of Chuna manual therapy for shoulder pain in hemiplegic patients after stroke: a systematic review and meta-analysis. J Korean Med Rehabil. 2020;30(3):89-101.
  30. Yoon YJ, Kim SJ, Cho JH, Kim KW, Song MY. Effect of acupuncture on sciatica in rat models: systematic review and meta-analysis. J Korean Med Rehabil. 2020;30(1):79-93.
  31. Han SH, Lee GE, Byun DY, Kim YI, Kim MK, Min BK, Lim HB, Jeong YJ, Oh MS. A systematic review of moxibustion for frozen shoulder. J Korean Med Rehabil. 2019;29(3):35-49. https://doi.org/10.18325/jkmr.2019.29.3.35
  32. Oh TY, Kim YH, Oh EM, Hong SM, Ha HJ, Lee EJ, Oh MS. A systematic review and meta-analysis of herbal medicine for frozen shoulder. J Korean Med Rehabil. 2019;29(3):15-33.
  33. Shin SH, Min KJ, Kim EB, Ha WB, Ko YS. Chuna manual therapy alone for cervicogenic dizziness: a systematic review. J Korean Med Rehabil. 2019;29(1):1-6.
  34. Gu JH, Li YC, Jo DC, Lee EJ. A systematic review of bee venom acupuncture for ankle sprain. J Korean Med Rehabil. 2018;28(3):55-66. https://doi.org/10.18325/jkmr.2018.28.3.55
  35. Kim YJ, Kim TR, Woo CH, Shin BC. Acupuncture for upper extremity peripheral nerve injury: a systematic review. J Korean Med Rehabil. 2018;28(2):73-82.
  36. Kim MK, Seo HR, Ha HJ, O TY, Jeon DH, Li YC, Lee JE, Lee EJ, Oh MS. Systematic review of soyeom pharmacopuncture therapy for pain. J Korean Med Rehabil. 2017;27(3):95-105. https://doi.org/10.18325/JKMR.2017.27.3.95
  37. Gu JH, Kim ES, Park YC, Jung IC, Lee EJ. A systematic review of bee venom acupuncture for knee osteoarthritis. J Korean Med Rehabil. 2017;27(3):47-60. https://doi.org/10.18325/JKMR.2017.27.3.47
  38. Seo HR, Li YC, Lee JE, Kim MK. Chuna manual therapy for primary dysmenorrhea: a systematic review. J Korean Med Rehabil. 2017;27(3):81-93. https://doi.org/10.18325/JKMR.2017.27.3.81
  39. Bae DR, Cho HJ, Kim HN, Hwang EH. Chuna manual therapy for temporomandibular joint disorder: systematic review. J Korean Med Rehabil. 2017;27(3):71-9. https://doi.org/10.18325/JKMR.2017.27.3.71
  40. Heo I, Kim CY, Hwang EH. Chuna manual therapy combined acupuncture for trigeminal neuralgia: a systematic review. J Korean Med Rehabil. 2016;26(4):37-44. https://doi.org/10.18325/JKMR.2016.26.4.37
  41. Han KS, Lee MJ, Kim HJ. Systematic review on herbal treatment for obesity in adults. J Korean Med Rehabil. 2016;26(4):23-35. https://doi.org/10.18325/JKMR.2016.26.4.23
  42. Heo I, Hwang MS, Shin BC, Heo KH, Kim BJ, Kim KB, Cheon JH, Park JH, Hwang EH. Review articles: Chuna manual therapy for nocturnal crying; a systematic review. J Korean Med Rehabil. 2015;25(3):51-7. https://doi.org/10.18325/JKMR.2015.25.3.51
  43. Yi WS, Kim SS. Review article: reporting of adverse events in randomized controlled trials of bee venom acupuncture: a systematic review. J Korean Med Rehabil. 2014;24(4):97-109.
  44. Heo I, Kim BJ, Lee SH, Kim HT, Park HJ, Park SY, Hwang MS, Shin BC, Hwang EH. Extracorporeal shock wave therapy with meridian and acupoint theory for knee osteoarthritis: systematic review. J Korean Med Rehabil. 2021;31(2):41-8. https://doi.org/10.18325/jkmr.2021.31.2.41
  45. Lee SJ, Shin BC, Song GS, Hwang EH, Yun YJ. A systematic review of the effectiveness of eastern-western integrative medicine for musculoskeletal disorders. J Korean Med Rehabil. 2011;21(4):87-96.
  46. Choi HM, Han SY, Hwang DR, Kang JH. Acupuncture treatment for rotator cuff disorder: a systematic review. J Korean Med Rehabil. 2018;28(4):11-20. https://doi.org/10.18325/jkmr.2018.28.4.11
  47. Chang SJ, Lee MJ, Kim HJ. Systematic review on traditional chinese herbal medicine treatment for antibiotic associated diarrhea. J Korean Med Rehabil. 2017;27(4):85-96. https://doi.org/10.18325/jkmr.2017.27.4.85
  48. Ha HJ, Oh MS. A systemic review of Korean medical treatment combined with continuous passive motion therapy on the knee joint postoperative rehabilitation. J Korean Med Rehabil. 2017;27(3):33-45. https://doi.org/10.18325/JKMR.2017.27.3.33
  49. Choi JM, Jeon SH, Lim YH, Jung MJ, Kim SJ. A systematic review of acupuncture treatment for thromboangiitis obliterans. J Korean Med Rehabil. 2022;32(1):37-49.
  50. Sagong HS, Kim HT, Heo I, Shin BC. Randomized controlled trials of acupuncture for healthy volunteers in Korea: a systematic review. J Korean Med Rehabil. 2021;31(1):137-47. https://doi.org/10.18325/jkmr.2021.31.1.137
  51. Oh SJ, Ha HJ, Gu JH, Park YC, Oh MS, Jung IC, Lee EJ. The effect of herbal medicine on rheumatoid arthritis animal model: a systematic review of animal experiment studies published in Korea and Overseas. J Korean Med Rehabil. 2020;30(3):103-16. https://doi.org/10.18325/jkmr.2020.30.3.103
  52. Kim JH, Yoon YS, Lee WJ, Ko HJ, Kim SJ. A systematic review of herbal medicine treatment for knee osteoarthritis. J Korean Med Rehabil. 2019;29(4):47-60. https://doi.org/10.18325/jkmr.2019.29.4.47
  53. Won JY, Jeon CH, Song HJ, Jeong JW, Kim TG, Kim HH, Leem JT. The effect of orally administered herbal medicines in collagen, LPS, CFA induced rheumatoid like arthritis animal model: a systematic review of animal study articles published in Korea after 2008. J Korean Med Rehabil. 2017;27(4):33-53. https://doi.org/10.18325/JKMR.2017.27.4.33
  54. Lee JE, Lee CH, Lee EJ, Lee JM, Oh MS. Systematic review of bee venom therapy for traumatic injury. J Korean Med Rehabil. 2016;26(3):67-77. https://doi.org/10.18325/JKMR.2016.26.3.67
  55. Heo I, Lee HY, Hwang MS, Shin BC, Heo KH, Hwang EH. Review article: systematic review of external Qigong therapy for joint pain. J Korean Med Rehabil. 2014;24(4):187-93.
  56. Huh G, Nam DJ, Lee HE, Choi BM, Lee JM, Lee EJ, Oh MS. Systematic review of high frequency of acupuncture point and self exercise therapy for lower back pain. J Korean Med Rehabil. 2013;23(4):59-71.
  57. Kook KH, Lee EJ, Oh MS. Domestic clinical studies related to the exercise program targeting farmers: a systematic review. J Korean Med Rehabil. 2011;21(4):77-86.
  58. Park JH, Nam JK, Kwon DH, Kim HJ, Lee MJ. Systematic review of randomized controlled trials on herbal medicine for treatment of human obesity. J Korean Med Rehabil. 2009;19(3):33-46.
  59. Hwang EH, Heo KH, Lee GS. Effect of Tai Chi as therapeutic exercise on blood pressure: rapid systematic review. J Korean Med Rehabil. 2013;23(1):101-13.
  60. Ahn EJ, Kang H. Introduction to systematic review and meta-analysis. Korean J Anesthesiol. 2018;71(2):103-12. https://doi.org/10.4097/kjae.2018.71.2.103
  61. Gopalakrishnan S, Ganeshkumar P. Systematic reviews and meta-analysis: understanding the best evidence in primary healthcare. J Family Med Prim Care. 2013;2(1):9-14. https://doi.org/10.4103/2249-4863.109934
  62. Lee YH. An overview of meta-analysis for clinicians. Korean J Intern Med. 2018;33(2):277-83. https://doi.org/10.3904/kjim.2016.195
  63. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374(9683):86-9. https://doi.org/10.1016/S0140-6736(09)60329-9
  64. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed.1000097
  65. Alspach JG. Writing for publication 101: why the abstract is so important. Crit Care Nurse. 2017;37(4):12-5. https://doi.org/10.4037/ccn2017466
  66. Dworkin SL. Sample size policy for qualitative studies using in-depth interviews. Arch Sex Behav. 2012;41(6):1319-20. https://doi.org/10.1007/s10508-012-0016-6
  67. Tawfik GM, Giang HTN, Ghozy S, Altibi AM, Kandil H, Le HH, Eid PS, Radwan I, Makram OM, Hien TTT, Sherif M, Hossain AS, Thang TLL, Puljak L, Salem H, Numair T, Moji K, Huy NT. Protocol registration issues of systematic review and meta-analysis studies: a survey of global researchers. BMC Med Res Methodol. 2020;20(1):213. https://doi.org/10.1186/s12874-020-01094-9
  68. Thabane L, Mbuagbaw L, Zhang S, Samaan Z, Marcucci M, Ye C, Thabane M, Giangregorio L, Dennis B, Kosa D, Borg Debono V, Dillenburg R, Fruci V, Bawor M, Lee J, Wells G, Goldsmith CH. A tutorial on sensitivity analyses in clinical trials: the what, why, when and how. BMC Med Res Methodol. 2013;13:92. https://doi.org/10.1186/1471-2288-13-92
  69. Kirmayr M, Quilodran C, Valente B, Loezar C, Garegnani L, Franco JVA. The GRADE approach, Part 1: how to assess the certainty of the evidence. Medwave. 2021;21(2):e8109. https://doi.org/10.5867/medwave.2021.02.8109
  70. National Academy of Sciences, National Academy of Engineering (US) and Institute of Medicine (US) Committee on Science, Engineering, and Public Policy. On being a scientist: a guide to responsible conduct in research. 3rd ed. Washington (DC):National Academies Press (US). 2009:62-6.
  71. Kim SY, Park DA, Seo HJ, Shin SS, Lee SJ, Lee M, Jang BH, Cha YJ, Choi IS, Park KI. Health technology assessment methodology: systematic review. 1st ed. Seoul: National Evidence-based Healthcare Collaborating Agency. 2020.