Browse > Article
http://dx.doi.org/10.3348/kjr.2016.17.5.706

Does the Reporting Quality of Diagnostic Test Accuracy Studies, as Defined by STARD 2015, Affect Citation?  

Choi, Young Jun (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
Chung, Mi Sun (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
Koo, Hyun Jung (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
Park, Ji Eun (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
Yoon, Hee Mang (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
Park, Seong Ho (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
Publication Information
Korean Journal of Radiology / v.17, no.5, 2016 , pp. 706-714 More about this Journal
Abstract
Objective: To determine the rate with which diagnostic test accuracy studies that are published in a general radiology journal adhere to the Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015, and to explore the relationship between adherence rate and citation rate while avoiding confounding by journal factors. Materials and Methods: All eligible diagnostic test accuracy studies that were published in the Korean Journal of Radiology in 2011-2015 were identified. Five reviewers assessed each article for yes/no compliance with 27 of the 30 STARD 2015 checklist items (items 28, 29, and 30 were excluded). The total STARD score (number of fulfilled STARD items) was calculated. The score of the 15 STARD items that related directly to the Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 was also calculated. The number of times each article was cited (as indicated by the Web of Science) after publication until March 2016 and the article exposure time (time in months between publication and March 2016) were extracted. Results: Sixty-three articles were analyzed. The mean (range) total and QUADAS-2-related STARD scores were 20.0 (14.5-25) and 11.4 (7-15), respectively. The mean citation number was 4 (0-21). Citation number did not associate significantly with either STARD score after accounting for exposure time (total score: correlation coefficient = 0.154, p = 0.232; QUADAS-2-related score: correlation coefficient = 0.143, p = 0.266). Conclusion: The degree of adherence to STARD 2015 was moderate for this journal, indicating that there is room for improvement. When adjusted for exposure time, the degree of adherence did not affect the citation rate.
Keywords
STARD; STARD 2015; Citation; Reporting quality; Accuracy; Adherence; Impact; Impact factor;
Citations & Related Records
Times Cited By KSCI : 63  (Citation Analysis)
연도 인용수 순위
1 Song YS, Choi SH, Park CK, Yi KS, Lee WJ, Yun TJ, et al. True progression versus pseudoprogression in the treatment of glioblastomas: a comparison study of normalized cerebral blood volume and apparent diffusion coefficient by histogram analysis. Korean J Radiol 2013;14:662-672   DOI
2 Moon JH, Park EA, Lee W, Yin YH, Chung JW, Park JH, et al. The diagnostic accuracy, image quality and radiation dose of 64-slice dual-source CT in daily practice: a single institution's experience. Korean J Radiol 2011;12:308-318   DOI
3 Lee KH, Lee JM, Park JH, Kim JH, Park HS, Yu MH, et al. MR imaging in patients with suspected liver metastases: value of liver-specific contrast agent gadoxetic acid. Korean J Radiol 2013;14:894-904   DOI
4 Lee DH, Lee JM, Klotz E, Kim SJ, Kim KW, Han JK, et al. Detection of recurrent hepatocellular carcinoma in cirrhotic liver after transcatheter arterial chemoembolization: value of quantitative color mapping of the arterial enhancement fraction of the liver. Korean J Radiol 2013;14:51-60   DOI
5 Ko ES, Han BK, Kim SM, Ko EY, Jang M, Lyou CY, et al. Comparison of new and established full-field digital mammography systems in diagnostic performance. Korean J Radiol 2013;14:164-170   DOI
6 Kim SA, Chang JM, Cho N, Yi A, Moon WK. Characterization of breast lesions: comparison of digital breast tomosynthesis and ultrasonography. Korean J Radiol 2015;16:229-238   DOI
7 Sohn CH, Lee HP, Park JB, Chang HW, Kim E, Kim E, et al. Imaging findings of brain death on 3-tesla MRI. Korean J Radiol 2012;13:541-549   DOI
8 Shin JE, Choi HJ, Kim MH, Cho KS. The serum CA-125 concentration data assists in evaluating CT imaging information when used to differentiate borderline ovarian tumor from malignant epithelial ovarian tumors. Korean J Radiol 2011;12:456-462   DOI
9 Ryoo I, Suh S, Lee YH, Seo HS, Seol HY. Comparison of ultrasonographic findings of biopsy-proven tuberculous lymphadenitis and Kikuchi disease. Korean J Radiol 2015;16:767-775   DOI
10 Rief M, Stenzel F, Kranz A, Schlattmann P, Dewey M. Time efficiency and diagnostic accuracy of new automated myocardial perfusion analysis software in 320-row CT cardiac imaging. Korean J Radiol 2013;14:21-29   DOI
11 Kim HJ, Lee SH, Kang CH, Ryu JA, Shin MJ, Cho KJ, et al. Evaluation of the chondromalacia patella using a microscopy coil: comparison of the two-dimensional fast spin echo techniques and the three-dimensional fast field echo techniques. Korean J Radiol 2011;12:78-88   DOI
12 Kim SH, Kang BJ, Choi BG, Choi JJ, Lee JH, Song BJ, et al. Radiologists' performance for detecting lesions and the interobserver variability of automated whole breast ultrasound. Korean J Radiol 2013;14:154-163   DOI
13 Kim MY, Cho N, Yi A, Koo HR, Yun BL, Moon WK. Sonoelastography in distinguishing benign from malignant complex breast mass and making the decision to biopsy. Korean J Radiol 2013;14:559-567   DOI
14 Kim JE, Lee JY, Bae KS, Han JK, Choi BI. Acoustic radiation force impulse elastography for focal hepatic tumors: usefulness for differentiating hemangiomas from malignant tumors. Korean J Radiol 2013;14:743-753   DOI
15 Kim DW, Jung SL, Kim J, Ryu JH, Sung JY, Lim HK. Comparison between ultrasonography and computed tomography for detecting the pyramidal lobe of the thyroid gland: a prospective multicenter study. Korean J Radiol 2015;16:402-409   DOI
16 Kang KM, Choi SI, Chun EJ, Kim JA, Youn TJ, Choi DJ. Coronary vasospastic angina: assessment by multidetector CT coronary angiography. Korean J Radiol 2012;13:27-33   DOI
17 Kang KA, Kim YK, Kim E, Jeong WK, Choi D, Lee WJ, et al. T2-weighted liver MRI using the MultiVane technique at 3T: comparison with conventional T2-weighted MRI. Korean J Radiol 2015;16:1038-1046   DOI
18 Park SO, Seo JB, Kim N, Lee YK, Lee J, Kim DS. Comparison of usual interstitial pneumonia and nonspecific interstitial pneumonia: quantification of disease severity and discrimination between two diseases on HRCT using a texturebased automated system. Korean J Radiol 2011;12:297-307   DOI
19 Kim JI, Kim YH, Lee KH, Kim SY, Lee YJ, Park YS, et al. Typespecific diagnosis and evaluation of longitudinal tumor extent of borrmann type IV gastric cancer: CT versus gastroscopy. Korean J Radiol 2013;14:597-606   DOI
20 Kim J, Kim YH, Lee KH, Lee YJ, Park JH. Diagnostic performance of CT angiography in patients visiting emergency department with overt gastrointestinal bleeding. Korean J Radiol 2015;16:541-549   DOI
21 Park B, Kim HK, Choi YS, Kim J, Zo JI, Choi JY, et al. Prediction of pathologic grade and prognosis in mucoepidermoid carcinoma of the lung using $^{18}F$-FDG PET/CT. Korean J Radiol 2015;16:929-935   DOI
22 Niu XK, Bhetuwal A, Yang HF. CT-guided core needle biopsy of pleural lesions: evaluating diagnostic yield and associated complications. Korean J Radiol 2015;16:206-212   DOI
23 Lyou CY, Cho N, Kim SM, Jang M, Park JS, Baek SY, et al. Computer-aided evaluation of breast MRI for the residual tumor extent and response monitoring in breast cancer patients receiving neoadjuvant chemotherapy. Korean J Radiol 2011;12:34-43   DOI
24 Bang SH, Lee JY, Woo H, Joo I, Lee ES, Han JK, et al. Differentiating between adenomyomatosis and gallbladder cancer: revisiting a comparative study of high-resolution ultrasound, multidetector CT, and MR imaging. Korean J Radiol 2014;15:226-234   DOI
25 Jeh SK, Kim SH, Kang BJ. Comparison of the diagnostic performance of response evaluation criteria in solid tumor 1.0 with response evaluation criteria in solid tumor 1.1 on MRI in advanced breast cancer response evaluation to neoadjuvant chemotherapy. Korean J Radiol 2013;14:13-20   DOI
26 Jung SI, Park HS, Yim Y, Jeon HJ, Yu MH, Kim YJ, et al. Added value of using a CT coronal reformation to diagnose adnexal torsion. Korean J Radiol 2015;16:835-845   DOI
27 Jung SI, Park HS, Kim YJ, Jeon HJ. Multidetector computed tomography for the assessment of adnexal mass: is unenhanced CT scan necessary? Korean J Radiol 2014;15:72-79   DOI
28 Iannicelli E, Di Renzo S, Ferri M, Pilozzi E, Di Girolamo M, Sapori A, et al. Accuracy of high-resolution MRI with lumen distention in rectal cancer staging and circumferential margin involvement prediction. Korean J Radiol 2014;15:37-44   DOI
29 Chung SY, Park SH, Lee SS, Lee JH, Kim AY, Park SK, et al. Comparison between CT colonography and double-contrast barium enema for colonic evaluation in patients with renal insufficiency. Korean J Radiol 2012;13:290-299   DOI
30 Zhang JJ, Liu T, Feng Y, Wu WF, Mou CY, Zhai LH. Diagnostic value of 64-slice dual-source CT coronary angiography in patients with atrial fibrillation: comparison with invasive coronary angiography. Korean J Radiol 2011;12:416-423   DOI
31 Choi HS, Kim AH, Ahn SS, Shin NY, Kim J, Lee SK. Glioma grading capability: comparisons among parameters from dynamic contrast-enhanced MRI and ADC value on DWI. Korean J Radiol 2013;14;487-492   DOI
32 Lv P, Mahyoub R, Lin X, Chen K, Chai W, Xie J. Differentiating pancreatic ductal adenocarcinoma from pancreatic serous cystadenoma, mucinous cystadenoma, and a pseudocyst with detailed analysis of cystic features on CT scans: a preliminary study. Korean J Radiol 2011;12:187-195   DOI
33 Luczynska E, Heinze-Paluchowska S, Dyczek S, Blecharz P, Rys J, Reinfuss M. Contrast-enhanced spectral mammography: comparison with conventional mammography and histopathology in 152 women. Korean J Radiol 2014;15:689-696   DOI
34 Lu Q, Huang BJ, Wang WP, Li CX, Xue LY. Qualitative and quantitative analysis with contrast-enhanced ultrasonography: diagnosis value in hypoechoic renal angiomyolipoma. Korean J Radiol 2015;16:334-341   DOI
35 Hur S, Kim HC, Chung JW, Kim MU, Kim JD, Kim GM, et al. Hepatocellular carcinomas smaller than 4 cm supplied by the intercostal artery: can we predict which intercostal artery supplies the tumor? Korean J Radiol 2011;12:693-699   DOI
36 Chun KY, Choi YS, Lee SH, Kim JS, Young KW, Jeong MS, et al. Deltoid ligament and tibiofibular syndesmosis injury in chronic lateral ankle instability: magnetic resonance imaging evaluation at 3t and comparison with arthroscopy. Korean J Radiol 2015;16:1096-1103   DOI
37 Cheung JY, Kim Y, Shim SS, Lim SM. Combined fluoroscopyand CT-guided transthoracic needle biopsy using a C-arm cone-beam CT system: comparison with fluoroscopy-guided biopsy. Korean J Radiol 2011;12:89-96   DOI
38 Ahn HS, Kim SM, Jang M, Yun BL, Kim B, Ko ES, et al. A new full-field digital mammography system with and without the use of an advanced post-processing algorithm: comparison of image quality and diagnostic performance. Korean J Radiol 2014;15:305-312   DOI
39 Korevaar DA, Wang J, van Enst WA, Leeflang MM, Hooft L, Smidt N, et al. Reporting diagnostic accuracy studies: some improvements after 10 years of STARD. Radiology 2015;274:781-789   DOI
40 Walther S, Schueler S, Tackmann R, Schuetz GM, Schlattmann P, Dewey M. Compliance with STARD checklist among studies of coronary CT angiography: systematic review. Radiology 2014;271:74-86   DOI
41 Not-so-deep impact. Nature 2005;435:1003-1004
42 Lee SJ, Lee WW, Kim SE. Bone positron emission tomography with or without CT is more accurate than bone scan for detection of bone metastasis. Korean J Radiol 2013;14:510-519   DOI
43 Yu H, Cui JL, Cui SJ, Sun YC, Cui FZ. Differentiating benign from malignant bone tumors using fluid-fluid level features on magnetic resonance imaging. Korean J Radiol 2014;15:757-763   DOI
44 Yoon SH, Goo JM, Jung J, Hong H, Park EA, Lee CH, et al. Computer-aided classification of visual ventilation patterns in patients with chronic obstructive pulmonary disease at twophase xenon-enhanced CT. Korean J Radiol 2014;15:386-396   DOI
45 Liu X, Peng W, Zhou L, Wang H. Biexponential apparent diffusion coefficients values in the prostate: comparison among normal tissue, prostate cancer, benign prostatic hyperplasia and prostatitis. Korean J Radiol 2013;14:222-232   DOI
46 Lim HJ, Chung MJ, Lee G, Yie M, Shin KE, Moon JW, et al. Interpretation of digital chest radiographs: comparison of light emitting diode versus cold cathode fluorescent lamp backlit monitors. Korean J Radiol 2013;14:968-976   DOI
47 Lee YH, Kim DW, In HS, Park JS, Kim SH, Eom JW, et al. Differentiation between benign and malignant solid thyroid nodules using an US classification system. Korean J Radiol 2011;12:559-567   DOI
48 Lee S, Lee YH, Chung TS, Jeong EK, Kim S, Yoo YH, et al. Accuracy of diffusion tensor imaging for diagnosing cervical spondylotic myelopathy in patients showing spinal cord compression. Korean J Radiol 2015;16:1303-1312   DOI
49 Yoo JY, Chung MJ, Choi B, Jung HN, Koo JH, Bae YA, et al. Digital tomosynthesis for PNS evaluation: comparisons of patient exposure and image quality with plain radiography. Korean J Radiol 2012;13:136-143   DOI
50 Yoon HJ, Chung MJ, Hwang HS, Moon JW, Lee KS. Adaptive statistical iterative reconstruction-applied ultra-low-dose CT with radiography-comparable radiation dose: usefulness for lung nodule detection. Korean J Radiol 2015;16:1132-1141   DOI
51 Yi J, Lee EH, Kwak JJ, Cha JG, Jung SH. Retrieval rate and accuracy of ultrasound-guided 14-G semi-automated core needle biopsy of breast microcalcifications. Korean J Radiol 2014;15:12-19   DOI
52 Wu EH, Chen YL, Wu YM, Huang YT, Wong HF, Ng SH. CTguided core needle biopsy of deep suprahyoid head and neck lesions. Korean J Radiol 2013;14:299-306   DOI
53 Tong T, Zhenwei Y, Xiaoyuan F. Transient ischemic attack and stroke can be differentiated by analyzing the diffusion tensor imaging. Korean J Radiol 2011;12:280-288   DOI
54 Lee MH, Kim SH, Kim H, Lee MW, Lee WJ. Differentiating focal eosinophilic infiltration from metastasis in the liver with gadoxetic acid-enhanced magnetic resonance imaging. Korean J Radiol 2011;12:439-449   DOI
55 Lee KH, Goo JM, Park CM, Lee HJ, Jin KN. Computeraided detection of malignant lung nodules on chest radiographs: effect on observers' performance. Korean J Radiol 2012;13:564-571   DOI
56 Wu CH, Huang CC, Wang LJ, Wong YC, Wang CJ, Lo WC, et al. Value of CT in the discrimination of fatal from non-fatal stercoral colitis. Korean J Radiol 2012;13:283-289   DOI
57 Woo S, Kim SY, Cho JY, Kim SH. Shear wave elastography for detection of prostate cancer: a preliminary study. Korean J Radiol 2014;15:346-355   DOI
58 Ucar M, Guryildirim M, Tokgoz N, Kilic K, Borcek A, Oner Y, et al. Evaluation of aqueductal patency in patients with hydrocephalus: three-dimensional high-sampling-efficiency technique (SPACE) versus two-dimensional turbo spin echo at 3 Tesla. Korean J Radiol 2014;15:827-835   DOI
59 Tomozawa Y, Inaba Y, Yamaura H, Sato Y, Kato M, Kanamoto T, et al. Clinical value of CT-guided needle biopsy for retroperitoneal lesions. Korean J Radiol 2011;12:351-357   DOI
60 Lee JH, Yoon YC, Jee S, Kwon JW, Cha JG, Yoo JC. Comparison of three-dimensional isotropic and two-dimensional conventional indirect MR arthrography for the diagnosis of rotator cuff tears. Korean J Radiol 2014;15:771-780   DOI
61 Lee JH, Byun JH, Kim JH, Lee SS, Kim HJ, Lee MG. Solid pancreatic tumors with unilocular cyst-like appearance on CT: differentiation from unilocular cystic tumors using CT. Korean J Radiol 2014;15:704-711   DOI
62 Lee JE, Lee JM, Lee KB, Yoon JH, Shin CI, Han JK, et al. Noninvasive assessment of hepatic fibrosis in patients with chronic hepatitis B viral infection using magnetic resonance elastography. Korean J Radiol 2014;15:210-217   DOI
63 Lee EK, Choi SH, Yun TJ, Kang KM, Kim TM, Lee SH, et al. Prediction of response to concurrent chemoradiotherapy with temozolomide in glioblastoma: application of immediate post-operative dynamic susceptibility contrast and diffusionweighted MR imaging. Korean J Radiol 2015;16:1341-1348   DOI
64 Koo JH, Kim CK, Choi D, Park BK, Kwon GY, Kim B. Diffusionweighted magnetic resonance imaging for the evaluation of prostate cancer: optimal B value at 3T. Korean J Radiol 2013;14:61-69   DOI
65 Kim YP, Kannengiesser S, Paek MY, Kim S, Chung TS, Yoo YH, et al. Differentiation between focal malignant marrowreplacing lesions and benign red marrow deposition of the spine with T2*-corrected fat-signal fraction map using a three-echo volume interpolated breath-hold gradient echo Dixon sequence. Korean J Radiol 2014;15:781-791   DOI
66 Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, et al. STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies. Radiology 2015;277:826-832   DOI
67 Kim SY, Moon SK, Jung DC, Hwang SI, Sung CK, Cho JY, et al. Pre-operative prediction of advanced prostatic cancer using clinical decision support systems: accuracy comparison between support vector machine and artificial neural network. Korean J Radiol 2011;12:588-594   DOI
68 Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 2015;351:h5527
69 Equator Network, Essential Resources for Writing and Publishing Health Research. Web site. http://www.equatornetwork.org/. Accessed July 3, 2016
70 Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Radiology 2003;226:24-28   DOI
71 Wikipedia. Open access journal. Web site. https://en.wikipedia.org/wiki/Open_access_journal. Accessed March 3, 2016
72 Smidt N, Rutjes AW, van der Windt DA, Ostelo RW, Reitsma JB, Bossuyt PM, et al. Quality of reporting of diagnostic accuracy studies. Radiology 2005;235:347-353   DOI
73 Smith R. Peer review: reform or revolution? BMJ 1997;315:759-760   DOI
74 Goldbeck-Wood S. Evidence on peer review-scientific quality control or smokescreen? BMJ 1999;318:44-45   DOI
75 Van Raan AFJ. The use of bibliometric analysis in research performance assessment and monitoring of interdisciplinary scientific developments. Technikfolgenabschatzung 2003;1:20-29
76 Dilauro M, McInnes MD, Korevaar DA, van der Pol CB, Petrcich W, Walther S, et al. Is There an Association between STARD Statement Adherence and Citation Rate? Radiology 2016;280:62-67   DOI
77 Wilczynski NL. Quality of reporting of diagnostic accuracy studies: no change since STARD statement publication--before-and-after study. Radiology 2008;248:817-823   DOI
78 Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011;155:529-536   DOI
79 Rutjes AW, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PM. Case-control and two-gate designs in diagnostic accuracy studies. Clin Chem 2005;51:1335-1341   DOI
80 Knottnerus JA, Muris JW. Assessment of the accuracy of diagnostic tests: the cross-sectional study. J Clin Epidemiol 2003;56:1118-1128   DOI
81 Bossuyt PM, Leeflang MM. Developing Criteria for Including Studies. In: Deeks JJ, Bossuyt PM, Gatsonis C, eds. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 0.4 [updated September 2008]. Oxford: The Cochrane Collaboration, 2008