DOI QR코드

DOI QR Code

Statistical Data Extraction and Validation from Graph for Data Integration and Meta-analysis

데이터통합과 메타분석을 위한 그래프 통계량 추출과 검증

  • 심성률 (차의과학대학교 의학전문대학원 정보의학교실) ;
  • 임요환 (차의과학대학교 의학전문대학원 정보의학연구소) ;
  • 홍명희 (차의과학대학교 의학전문대학원 정보의학교실) ;
  • 송규선 (차의과학대학교 의학전문대학원 정보의학교실) ;
  • 한현욱 (차의과학대학교 의학전문대학원 정보의학교실)
  • Received : 2021.11.26
  • Accepted : 2021.12.13
  • Published : 2021.12.31

Abstract

The objective of this study was to describe specific approaches for data extraction from graph when statistical information is not directly reported in some articles, enabling data intergration and meta-analysis for quantitative data synthesis. Particularly, meta-analysis is an important analysis tool that allows the right decision making for evidence-based medicine by systematically and objectively selects target literature, quantifies the results of individual studies, and provides the overall effect size. For data integration and meta-analysis, we investigated the strength points about the introduction and application of Adobe Acrobet Reader and Python-based Jupiter Lab software, a computer tool that extracts accurate statistical figures from graphs. We used as an example data that was statistically verified throught an previous studies and the original data could be obtained from ClinicalTrials.gov. As a result of meta-analysis of the original data and the extraction values of each computer software, there was no statistically significant difference between the extraction methods. In addition, the intra-rater reliability of between researchers was confirmed and the consistency was high. Therefore, In terms of maintaining the integrity of statistical information, measurement using a computational tool is recommended rather than the classically used methods.

본 연구의 목적은 개별연구들이 정확한 통계량을 제시하지 않고 그래프로만 나타내었을 경우 그래프로부터 통계량을 추출해내는 구체적인 방법을 기술한 것으로서 데이터통합과 정량적합성을 위한 메타분석을 가능하게 한다. 특히 메타분석(meta-analysis)은 체계적·객관적으로 대상문헌을 선택한 후 개별 연구들의 결과를 계량화하여 이를 통합된 효과크기(effect size)로 제시함으로써 근거중심의학(evidence based medicine)를 위한 올바른 의사결정을 할 수 있게 하는 중요한 분석도구이다. 데이터통합과 메타분석을 위해서 그래프로부터 정확한 통계수치를 추출하는 전산도구인 Adobe Acrobat Reader 와 Python기반의 JupyterLab 소프트웨어의 소개와 적용에 대한 주요사항을 알아보았다. 사용된 예제자료는 선행연구를 통해서 통계결과가 검증되어졌고 ClinicalTrials.gov에서 원자료 확보가 가능한 것을 사용하였다. 원자료와 각 전산도구들의 측정값을 각각 메타분석한 결과 통계적으로 유의한 차이는 없었다. 또한 연구자들간의 측정 신뢰도를 확인하였으며 높은 일치도를 나타내었다. 만약 그래프로부터 통게수치를 추출해야만 할 경우 연구의 완결성 유지를 위해서 전통적 사용 방법들보다는 전산 도구를 이용한 측정이 권고된다.

Keywords

Acknowledgement

본 연구는 교육부 지원의 한국연구재단 기초과학연구 (과제번호: NRF-2019M3C7A1032262), 산업통상자원부 지원의 바이오산업기술개발 프로그램 (과제번호: 20015086), 그리고 과학기술정보통신부 산하 정보통신산업진흥원 지원의 정보통신촉진기금 연구개발비로 수행되었으며 이에 감사드립니다.

References

  1. Shim SR, Kim SJ. Intervention meta-analysis: application and practice using R software. Epidemiol Health. 2019;41:e2019008. 
  2. 심성률, 의학보건학 연구자를 위한 R 메타분석, 한나래출판사, 2019. 
  3. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0[updated March 2011]. The Cochrane Collaboration, 2011. Available from http://www.cochrane-handbook.org.[accessed on 28 Sept 2021] 
  4. Barratt A, Wyer PC, Hatala R, McGinn T, Dans AL, Keitz S, et al. Tips for learners of evidence-based medicine: 1. Relative risk reduction, absolute risk reduction and number needed to treat. CMAJ 2004; 171(4): 353-358.  https://doi.org/10.1503/cmaj.1021197
  5. Smeeth L, Haines A, Ebrahim S. Numbers needed to treat derived from meta-analyses--sometimes informative, usually misleading. BMJ 1999; 318(7197): 1548-1551.  https://doi.org/10.1136/bmj.318.7197.1548
  6. Spruance SL, Reid JE, Grace M, Samore M. Hazard ratio in clinical trials. Antimicrob Agents Chemother 2004; 48(8): 2787-2792.  https://doi.org/10.1128/AAC.48.8.2787-2792.2004
  7. Shim SR, Kim JH, Choi H, Lee WJ, Kim HJ, Bae MY, Hwang SD, Kim KH, Bae JH, Yoon SJ. General effect of low-dose tamsulosin (0.2 mg) as a first-line treatment for lower urinary tract symptoms associated with benign prostatic hyperplasia: a systematic review and meta-analysis. Curr Med Res Opin. 2015 Feb; 31(2): 353-65.  https://doi.org/10.1185/03007995.2014.980887
  8. Shim SR, Cho YJ, Shin IS, Kim JH. Efficacy and safety of botulinum toxin injection for benign prostatic hyperplasia: a systematic review and meta-analysis. Int Urol Nephrol. 2015 Nov 11. [PMID: 26560471]. 
  9. Fu R, Vandermeer BW, Shamliyan TA, O'Neil ME, Yazdi F, Fox SH, Morton SC. Handling Continuous Outcomes in Quantitative Synthesis. Methods Guide for Comparative Effectiveness Reviews. (Prepared by the Oregon Evidence-based Practice Center under Contract No. 290-2007-10057-I.) AHRQ Publication No. 13-EHC103-EF. Rockville, MD: Agency for Healthcare Research and Quality. July 2013. www.effectivehealthcare.ahrq.gov/reports/final.cfm. 
  10. Idris N, Robertson C. The effects of imputing the missing standard deviations on the standard error of meta analysis estimates. Communiations in Statistics - Simulaiton and Computation. 2009;38(3):513-26.  https://doi.org/10.1080/03610910802556106
  11. Bae JM. A Practical Method for Using a Survival Curve for Meta-analysis. Journal of Health Informatics and Statistics (JHIS) 2015; 40(2): 56-64. 
  12. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Syst Rev. 2014; 3: 74. 
  13. Carderas, A., Yuan, Y., Livnat, I., Yanagihara, R., Saul, R., De Oca, G. M., Zheng K., Browne, A. W. (2020). Automated data extraction of bar chart raster images. arXiv preprint arXiv:2011.04137. 
  14. Durg S, Dhadde SB, Vandal R, Shivakumar BS, Charan CS. Withania somnifera (Ashwagandha) in neurobehavioural disorders induced by brain oxidative stress in rodents: a systematic review and meta-analysis. J Pharm Pharmacol 2015; 67(7): 879-899.  https://doi.org/10.1111/jphp.12398
  15. Gupta R, Saini MK, Doungmene F, de Oliveira P, Hussain F. Lanthanoid containing phosphotungstates: the syntheses, crystal structure, electrochemistry, photoluminescence and magnetic properties. Dalton Trans 2014; 43(22): 8290-8299.  https://doi.org/10.1039/C4DT00260A
  16. Mukherjee S, Seok SC, Vieland VJ, Das J. Cell responses only partially shape cell-to-cell variations in protein abundances in Escherichia coli chemotaxis. Proc Natl Acad Sci U S A 2013; 110(46): 18531-18536.  https://doi.org/10.1073/pnas.1311069110
  17. Van der Mierden S, Spineli LM, Talbot SR, Yiannakou C, Zentrich E, Weegh N, Struve B, Zur Brugge TF, Bleich A, Leenaars CHC. Extracting data from graphs: A case-study on animal research with implications for meta-analyses. Res Synth Methods. 2021 Nov;12(6):701-710.  https://doi.org/10.1002/jrsm.1481
  18. Jelicic Kadic A, Vucic K, Dosenovic S, Sapunar D, Puljak L. Extracting data from figures with software was faster, with higher interrater reliability than manual extraction. J Clin Epidemiol. 2016 Jun;74:119-23.  https://doi.org/10.1016/j.jclinepi.2016.01.002
  19. Adobe Acrobat. Adobe Systems Incorporated, San Jose (California), The United States. Available from http://www.adobe.com/kr/.[accessed on 28 Sept 2021] 
  20. Rohatgi A. WebPlotDigitizer. Available at https://automeris.io/WebPlotDigitizer/.[accessed on 28 Sept 2021] 
  21. Huwaldt JA. Plot Digitizer. Available at http://plotdigitizer.sf.net.[accessed on 28 Sept 2021] 
  22. Egner J, Mitchell M, Richter T, Winchen T. Engauge Digitizer. Convert graphs or map files into numbers. Available at http://digitizer.sf.net/. [accessed on 28 Sept 2021] 
  23. Maria G, Brisinda G, Civello IM, Bentivoglio AR, Sganga G, Albanese A. Relief by botulinum toxin of voiding dysfunction due to benign prostatic hyperplasia: results of a randomized, placebo-controlled study. Urology. 2003;62:259-264; discussion 264-255. 
  24. Marberger M, Chartier-Kastler E, Egerdie B, Lee KS, Grosse J, Bugarin D, et al. A randomized double-blind placebo-controlled phase 2 dose-ranging study of onabotulinumtoxinA in men with benign prostatic hyperplasia. Eur Urol. 2013;63:496-503.  https://doi.org/10.1016/j.eururo.2012.10.005
  25. McVary KT, Roehrborn CG, Chartier-Kastler E, Eros M, Bugarin D, Chen R, et al. A multicenter, randomized, double-blind, placebo controlled study of onabotulinumtoxinA 200 U to treat lower urinary tract symptoms in men with benign prostatic hyperplasia. J Urol. 2014;192:150-156.  https://doi.org/10.1016/j.juro.2014.02.004
  26. ClinicalTrials.gov. A service of the U.S. National Institute of Health. Available at http://www.clinicaltrials.gov/[accessed on 28 Sept 2021] 
  27. Kotz D, Cals JW. Effective writing and publishing scientific papers, part VII: tables and figures. J Clin Epidemiol 2013; 66(11): 1197.