• 제목/요약/키워드: Receiver Operating Characteristic

검색결과 668건 처리시간 0.025초

Additional Value of Integrated 18F-FDG PET/MRI for Evaluating Biliary Tract Cancer: Comparison with Contrast-Enhanced CT

  • Jeongin Yoo;Jeong Min Lee;Jeong Hee Yoon;Ijin Joo;Dong Ho Lee
    • Korean Journal of Radiology
    • /
    • 제22권5호
    • /
    • pp.714-724
    • /
    • 2021
  • Objective: To evaluate the value of 18F-fluorodeoxyglucose PET/MRI added to contrast-enhanced CT (CECT) in initial staging, assessment of resectability, and postoperative follow-up of biliary tract cancer. Materials and Methods: This retrospective study included 100 patients (initial workup [n = 65] and postoperative follow-up [n = 35]) who had undergone PET/MRI and CECT for bile duct or gallbladder lesions between January 2013 and March 2020. Two radiologists independently reviewed the CECT imaging set and CECT plus PET/MRI set to determine the likelihood of malignancy, local and overall resectability, and distant metastasis in the initial workup group, and local recurrence and distant metastasis in the follow-up group. Diagnostic performances of the two imaging sets were compared using clinical-surgical-pathologic findings as standards of reference. Results: The diagnostic performance of CECT significantly improved after the addition of PET/MRI for liver metastasis (area under the receiver operating characteristic curve [Az]: 0.77 vs. 0.91 [p = 0.027] for reviewer 1; 0.76 vs. 0.92 [p = 0.021] for reviewer 2), lymph node metastasis (0.73 vs. 0.92 [p = 0.004]; 0.81 vs. 0.92 [p = 0.023]), and overall resectability (0.79 vs. 0.92 [p = 0.007]; 0.82 vs. 0.94 [p = 0.021]) in the initial workup group. In the follow-up group, the diagnostic performance of CECT plus PET/MRI was significantly higher than that of CECT imaging for local recurrence (0.81 vs. 1.00 [p = 0.029]; 0.82 vs. 0.94 [p = 0.045]). Conclusion: PET/MRI may add value to CECT in patients with biliary tract cancer both in the initial workup for staging and determination of overall resectability and in follow-up for local recurrence.

Comparison of Abbreviated MRI and Full Diagnostic MRI in Distinguishing between Benign and Malignant Lesions Detected by Breast MRI: A Multireader Study

  • Eun Sil Kim;Nariya Cho;Soo-Yeon Kim;Bo Ra Kwon;Ann Yi;Su Min Ha;Su Hyun Lee;Jung Min Chang;Woo Kyung Moon
    • Korean Journal of Radiology
    • /
    • 제22권3호
    • /
    • pp.297-307
    • /
    • 2021
  • Objective: To compare the performance of simulated abbreviated breast MRI (AB-MRI) and full diagnostic (FD)-MRI in distinguishing between benign and malignant lesions detected by MRI and investigate the features of discrepant lesions of the two protocols. Materials and Methods: An AB-MRI set with single first postcontrast images was retrospectively obtained from an FD-MRI cohort of 111 lesions (34 malignant, 77 benign) detected by contralateral breast MRI in 111 women (mean age, 49.8. ± 9.8; range, 28-75 years) with recently diagnosed breast cancer. Five blinded readers independently classified the likelihood of malignancy using Breast Imaging Reporting and Data System assessments. McNemar tests and area under the receiver operating characteristic curve (AUC) analyses were performed. The imaging and pathologic features of the discrepant lesions of the two protocols were analyzed. Results: The sensitivity of AB-MRI for lesion characterization tended to be lower than that of FD-MRI for all readers (58.8-82.4% vs. 79.4-100%), although the findings of only two readers were significantly different (p < 0.05). The specificity of AB-MRI for lesion characterization was higher than that of FD-MRI for 80% of readers (39.0-74.0% vs. 19.5-45.5%, p ≤ 0.001). The AUC of AB-MRI was comparable to that of FD-MRI for all readers (p > 0.05). Fifteen percent (5/34) of the cancers were false-negatives on AB-MRI. More suspicious margins or internal enhancement on the delayed phase images were related to the discrepancies. Conclusion: The overall performance of AB-MRI was similar to that of FD-MRI in distinguishing between benign and malignant lesions. AB-MRI showed lower sensitivity and higher specificity than FD-MRI, as 15% of the cancers were misclassified compared to FD-MRI.

Circularity Index on Contrast-Enhanced Computed Tomography Helps Distinguish Fat-Poor Angiomyolipoma from Renal Cell Carcinoma: Retrospective Analyses of Histologically Proven 257 Small Renal Tumors Less Than 4 cm

  • Hye Seon Kang;Jung Jae Park
    • Korean Journal of Radiology
    • /
    • 제22권5호
    • /
    • pp.735-741
    • /
    • 2021
  • Objective: To evaluate circularity as a quantitative shape factor of small renal tumor on computed tomography (CT) in differentiating fat-poor angiomyolipoma (AML) from renal cell carcinoma (RCC). Materials and Methods: In 257 consecutive patients, 257 pathologically confirmed renal tumors (either AML or RCC less than 4 cm), which did not include visible fat on unenhanced CT, were retrospectively evaluated. A radiologist drew the tumor margin to measure the perimeter and area in all the contrast-enhanced axial CT images. In each image, a quantitative shape factor, circularity, was calculated using the following equation: 4 x π x (area ÷ perimeter2). The median circularity (circularity index) was adopted as a representative value in each tumor. The circularity index was compared between fat-poor AML and RCC, and the receiver operating characteristic (ROC) curve analysis was performed. Univariable and multivariable binary logistic regression analysis was performed to determine the independent predictor of fat-poor AML. Results: Of the 257 tumors, 26 were AMLs and 231 were RCCs (184 clear cell RCCs, 25 papillary RCCs, and 22 chromophobe RCCs). The mean circularity index of AML was significantly lower than that of RCC (0.86 ± 0.04 vs. 0.93 ± 0.02, p < 0.001). The mean circularity index was not different between the subtypes of RCCs (0.93 ± 0.02, 0.92 ± 0.02, and 0.92 ± 0.02 for clear cell, papillary, and chromophobe RCCs, respectively, p = 0.210). The area under the ROC curve of circularity index was 0.924 for differentiating fat-poor AML from RCC. The sensitivity and specificity were 88.5% and 90.9%, respectively (cut-off, 0.90). Lower circularity index (≤ 0.9) was an independent predictor (odds ratio, 41.0; p < 0.001) for predicting fat-poor AML on multivariable logistic regression analysis. Conclusion: Circularity is a useful quantitative shape factor of small renal tumor for differentiating fat-poor AML from RCC.

Contrast-Enhanced Spectral Mammography Versus Ultrasonography: Diagnostic Performance in Symptomatic Patients with Dense Breasts

  • Zhongfei Lu;Cuijuan Hao;Yan Pan;Ning Mao;Xin Wang;Xundi Yin
    • Korean Journal of Radiology
    • /
    • 제21권4호
    • /
    • pp.442-449
    • /
    • 2020
  • Objective: To compare the diagnostic performance of contrast-enhanced spectral mammography (CESM) versus ultrasonography (US) in symptomatic patients with dense breasts, while using histology as the gold standard. Materials and Methods: After obtaining approval from the local ethics board, this prospective study collected data from patients with symptomatic breasts who underwent CESM and US examinations from May 1, 2017 to September 30, 2017. We then selected those with dense breasts and pathological results as our sample population. Both CESM and US results were classified by a radiologist through the Breast Imaging Reporting and Data System, and the results were compared with their corresponding histological results. The chi-square test was conducted to compare the diagnostic performance of CESM and US, and the receiver operating characteristic curves for the two imaging modalities were obtained. Results: A total of 131 lesions from 115 patients with dense breasts were included in this study. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were 93.8%, 88.1%, 88.2%, 93.7%, and 90.8% for CESM, and 90.6%, 82.1%, 82.9%, 90.2%, and 86.3% for US, respectively. The p values for sensitivity, specificity, PPV, NPV, and accuracy were 0.687, 0.388, 0.370, 0.702, and 0.238, respectively. The area under the curve of CESM (0.917) was comparable with that of US (0.884); however, the differences between CESM and US were not statistically significant (p = 0.225). Eight false-positive cases and 4 false-negative cases for breast cancer were found in CESM, while 12 false-positive cases and 6 false-negative cases were found in US. Conclusion: The diagnostic performances of CESM and US are comparable in symptomatic women with dense breasts; however, the routine use of additional US imaging is questionable for lesions that can be detected by CESM.

Key Principles of Clinical Validation, Device Approval, and Insurance Coverage Decisions of Artificial Intelligence

  • Seong Ho Park;Jaesoon Choi;Jeong-Sik Byeon
    • Korean Journal of Radiology
    • /
    • 제22권3호
    • /
    • pp.442-453
    • /
    • 2021
  • Artificial intelligence (AI) will likely affect various fields of medicine. This article aims to explain the fundamental principles of clinical validation, device approval, and insurance coverage decisions of AI algorithms for medical diagnosis and prediction. Discrimination accuracy of AI algorithms is often evaluated with the Dice similarity coefficient, sensitivity, specificity, and traditional or free-response receiver operating characteristic curves. Calibration accuracy should also be assessed, especially for algorithms that provide probabilities to users. As current AI algorithms have limited generalizability to real-world practice, clinical validation of AI should put it to proper external testing and assisting roles. External testing could adopt diagnostic case-control or diagnostic cohort designs. A diagnostic case-control study evaluates the technical validity/accuracy of AI while the latter tests the clinical validity/accuracy of AI in samples representing target patients in real-world clinical scenarios. Ultimate clinical validation of AI requires evaluations of its impact on patient outcomes, referred to as clinical utility, and for which randomized clinical trials are ideal. Device approval of AI is typically granted with proof of technical validity/accuracy and thus does not intend to directly indicate if AI is beneficial for patient care or if it improves patient outcomes. Neither can it categorically address the issue of limited generalizability of AI. After achieving device approval, it is up to medical professionals to determine if the approved AI algorithms are beneficial for real-world patient care. Insurance coverage decisions generally require a demonstration of clinical utility that the use of AI has improved patient outcomes.

Intravoxel Incoherent Motion Magnetic Resonance Imaging for Assessing Parotid Gland Tumors: Correlation and Comparison with Arterial Spin Labeling Imaging

  • Gao Ma;Xiao-Quan Xu;Liu-Ning Zhu;Jia-Suo Jiang;Guo-Yi Su;Hao Hu;Shou-Shan Bu;Fei-Yun Wu
    • Korean Journal of Radiology
    • /
    • 제22권2호
    • /
    • pp.243-252
    • /
    • 2021
  • Objective: To compare and correlate the findings of intravoxel incoherent motion (IVIM) magnetic resonance (MR) imaging and arterial spin labeling (ASL) imaging in characterizing parotid gland tumors. Materials and Methods: We retrospectively reviewed 56 patients with parotid gland tumors evaluated by MR imaging. The true diffusion coefficient (D), pseudo-diffusion coefficient (D*), and fraction of perfusion (f) values of IVIM imaging and tumor-to-parotid gland signal intensity ratio (SIR) on ASL imaging were calculated. Spearman rank correlation coefficient, chi-squared, Mann-Whitney U, and Kruskal-Wallis tests with the post-hoc Dunn-Bonferroni method and receiver operating characteristic curve assessments were used for statistical analysis. Results: Malignant parotid gland tumors showed significantly lower D than benign tumors (p = 0.019). Within subgroup analyses, pleomorphic adenomas (PAs) showed significantly higher D than malignant tumors (MTs) and Warthin's tumors (WTs) (p < 0.001). The D* of WTs was significantly higher than that of PAs (p = 0.031). The f and SIR on ASL imaging of WTs were significantly higher than those of MTs and PAs (p < 0.05). Significantly positive correlation was found between SIR on ASL imaging and f (r = 0.446, p = 0.001). In comparison with f, SIR on ASL imaging showed a higher area under curve (0.853 vs. 0.891) in discriminating MTs from WTs, although the difference was not significant (p = 0.720). Conclusion: IVIM and ASL imaging could help differentiate parotid gland tumors. SIR on ASL imaging showed a significantly positive correlation with f. ASL imaging might hold potential to improve the ability to discriminate MTs from WTs.

A Multicenter Pilot Study of Biliary Atresia Screening Using Digital Stool Color Imaging

  • Kannamon Waitayagitgumjon;Wannisa Poocharoen;Suchin Trirongjitmoah;Kriengsak Treeprapin;Arada Suttiwongsing;Thetiya Wirifai;Chira Trirongchitmoh;Pitiporn Tangkabuanbutr
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • 제27권3호
    • /
    • pp.168-175
    • /
    • 2024
  • Purpose: The presence of alcoholic stool in biliary atresia (BA) patients is the basis of a stool color card (SCC), a screening tool that has led to more patients receiving Kasai portoenterostomy earlier. This study aimed to evaluate the color image processing of stool images captured using smartphones. We propose that measuring digital color parameters is a more objective method for identifying BA stools and may improve the sensitivity of BA screening. Methods: A prospective study was conducted in five hospitals in Thailand between October 1, 2020, and December 31, 2021. Stools from infants presenting with jaundice, acholic stool, or dark-colored urine were photographed. Digital image color analysis was performed, and software was developed based on the color on the original SCC. Sensitivity and specificity for predicting BA stools were compared between the SCC and the software. Results: Of 33 infants eligible for data collection, 19 were diagnosed with BA. Saturation and blue were two potential digital color parameters used to differentiate BA stools. The receiver operating characteristic curve was used to determine the optimum cutoff point of both values, and when saturation ≤56 or blue ≥61 was set as a threshold for detecting BA stool, high accuracy was achieved at 81.8% and 78.8%, respectively. Conclusion: Digital image processing is a promising technology. With appropriate cutoff values of saturation in hue, saturation, value and blue in red, green, blue color models, BA stools can be identified, and equivocal-colored stools of non-BA patients can be differentiated with acceptable accuracy in infants presenting with jaundice.

Evaluation of peri-implant bone defects on cone-beam computed tomography and the diagnostic accuracy of detecting these defects on panoramic images

  • Takayuki Oshima;Rieko Asaumi;Shin Ogura;Taisuke Kawai
    • Imaging Science in Dentistry
    • /
    • 제54권2호
    • /
    • pp.171-180
    • /
    • 2024
  • Purpose: This study was conducted to identify the typical sites and patterns of peri-implant bone defects on cone-beam computed tomography (CBCT) images, as well as to evaluate the detectability of the identified bone defects on panoramic images. Materials and Methods: The study population included 114 patients with a total of 367 implant fixtures. CBCT images were used to assess the presence or absence of bone defects around each implant fixture at the mesial, distal, buccal, and lingual sites. Based on the number of defect sites, the presentations of the peri-implant bone defects were categorized into 3 patterns: 1 site, 2 or 3 sites, and circumferential bone defects. Two observers independently evaluated the presence or absence of bone defects on panoramic images. The bone defect detection rate on these images was evaluated using receiver operating characteristic analysis. Results: Of the 367 implants studied, 167 (45.5%) had at least 1 site with a confirmed bone defect. The most common type of defect was circumferential, affecting 107 of the 167 implants(64.1%). Implants were most frequently placed in the mandibular molar region. The prevalence of bone defects was greatest in the maxillary premolar and mandibular molar regions. The highest kappa value was associated with the mandibular premolar region. Conclusion: The typical bone defect pattern observed was a circumferential defect surrounding the implant. The detection rate was generally higher in the molar region than in the anterior region. However, the capacity to detect partial bone defects using panoramic imaging was determined to be poor.

Prediction of Treatment Outcome of Chemotherapy Using Perfusion Computed Tomography in Patients with Unresectable Advanced Gastric Cancer

  • Dong Ho Lee;Se Hyung Kim;Sang Min Lee;Joon Koo Han
    • Korean Journal of Radiology
    • /
    • 제20권4호
    • /
    • pp.589-598
    • /
    • 2019
  • Objective: To evaluate whether data acquired from perfusion computed tomography (PCT) parameters can aid in the prediction of treatment outcome after palliative chemotherapy in patients with unresectable advanced gastric cancer (AGC). Materials and Methods: Twenty-one patients with unresectable AGCs, who underwent both PCT and palliative chemotherapy, were prospectively included. Treatment response was assessed according to Response Evaluation Criteria in Solid Tumors version 1.1 (i.e., patients who achieved complete or partial response were classified as responders). The relationship between tumor response and PCT parameters was evaluated using the Mann-Whitney test and receiver operating characteristic analysis. One-year survival was estimated using the Kaplan-Meier method. Results: After chemotherapy, six patients exhibited partial response and were allocated to the responder group while the remaining 15 patients were allocated to the non-responder group. Permeability surface (PS) value was shown to be significantly different between the responder and non-responder groups (51.0 mL/100 g/min vs. 23.4 mL/100 g/min, respectively; p = 0.002), whereas other PCT parameters did not demonstrate a significant difference. The area under the curve for prediction in responders was 0.911 (p = 0.004) for PS value, with a sensitivity of 100% (6/6) and specificity of 80% (12/15) at a cut-off value of 29.7 mL/100 g/min. One-year survival in nine patients with PS value > 29.7 mL/100 g/min was 66.7%, which was significantly higher than that in the 12 patients (33.3%) with PS value ≤ 29.7 mL/100 g/min (p = 0.019). Conclusion: Perfusion parameter data acquired from PCT demonstrated predictive value for treatment outcome after palliative chemotherapy, reflected by the significantly higher PS value in the responder group compared with the non-responder group.

Vertical root fracture diagnosis in teeth with metallic posts: Impact of metal artifact reduction and sharpening filters

  • Debora Costa Ruiz;Lucas P. Lopes Rosado;Rocharles Cavalcante Fontenele;Amanda Farias-Gomes;Deborah Queiroz Freitas
    • Imaging Science in Dentistry
    • /
    • 제54권2호
    • /
    • pp.139-145
    • /
    • 2024
  • Purpose: This study examined the influence of a metal artifact reduction (MAR) tool, sharpening filters, and their combination on the diagnosis of vertical root fracture (VRF) in teeth with metallic posts using cone-beam computed tomography (CBCT). Materials and Methods: Twenty single-rooted human premolars - 9 with VRF and 11 without - were individually placed in a human mandible. A metallic post composed of a cobalt-chromium alloy was inserted into the root canal of each tooth. CBCT scans were then acquired under the following parameters: 8 mA, a 5×5 cm field of view, a voxel size of 0.085 mm, 90 kVp, and with MAR either enabled or disabled. Five oral and maxillofacial radiologists independently evaluated the CBCT exams under each MAR mode and across 3 sharpening filter conditions: no filter, Sharpen 1×, and Sharpen 2×. The diagnostic performance was quantified by the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity. These metrics were compared using 2-way analysis of variance with a significance level of α=5%. Intra- and inter-examiner agreement were assessed using the weighted kappa test. Results: Neither MAR nor the application of sharpening filters significantly impacted AUC or specificity (P>0.05). However, sensitivity increased when MAR was combined with Sharpen 1× and Sharpen 2× (P=0.015). The intra-examiner agreement ranged from fair to substantial (0.34-0.66), while the inter-examiner agreement ranged from fair to moderate (0.27-0.41). Conclusion: MAR in conjunction with sharpening filters improved VRF detection; therefore, their combined use is recommended in cases of suspected VRF.