• 제목/요약/키워드: ROC(Receiver operating characteristic)

검색결과 362건 처리시간 0.03초

Feasibility of a Clinical-Radiomics Model to Predict the Outcomes of Acute Ischemic Stroke

  • Yiran Zhou;Di Wu;Su Yan;Yan Xie;Shun Zhang;Wenzhi Lv;Yuanyuan Qin;Yufei Liu;Chengxia Liu;Jun Lu;Jia Li;Hongquan Zhu;Weiyin Vivian Liu;Huan Liu;Guiling Zhang;Wenzhen Zhu
    • Korean Journal of Radiology
    • /
    • 제23권8호
    • /
    • pp.811-820
    • /
    • 2022
  • Objective: To develop a model incorporating radiomic features and clinical factors to accurately predict acute ischemic stroke (AIS) outcomes. Materials and Methods: Data from 522 AIS patients (382 male [73.2%]; mean age ± standard deviation, 58.9 ± 11.5 years) were randomly divided into the training (n = 311) and validation cohorts (n = 211). According to the modified Rankin Scale (mRS) at 6 months after hospital discharge, prognosis was dichotomized into good (mRS ≤ 2) and poor (mRS > 2); 1310 radiomics features were extracted from diffusion-weighted imaging and apparent diffusion coefficient maps. The minimum redundancy maximum relevance algorithm and the least absolute shrinkage and selection operator logistic regression method were implemented to select the features and establish a radiomics model. Univariable and multivariable logistic regression analyses were performed to identify the clinical factors and construct a clinical model. Ultimately, a multivariable logistic regression analysis incorporating independent clinical factors and radiomics score was implemented to establish the final combined prediction model using a backward step-down selection procedure, and a clinical-radiomics nomogram was developed. The models were evaluated using calibration, receiver operating characteristic (ROC), and decision curve analyses. Results: Age, sex, stroke history, diabetes, baseline mRS, baseline National Institutes of Health Stroke Scale score, and radiomics score were independent predictors of AIS outcomes. The area under the ROC curve of the clinical-radiomics model was 0.868 (95% confidence interval, 0.825-0.910) in the training cohort and 0.890 (0.844-0.936) in the validation cohort, which was significantly larger than that of the clinical or radiomics models. The clinical radiomics nomogram was well calibrated (p > 0.05). The decision curve analysis indicated its clinical usefulness. Conclusion: The clinical-radiomics model outperformed individual clinical or radiomics models and achieved satisfactory performance in predicting AIS outcomes.

T2 Mapping with and without Fat-Suppression to Predict Treatment Response to Intravenous Glucocorticoid Therapy for Thyroid-Associated Ophthalmopathy

  • Linhan Zhai;Qiuxia Wang;Ping Liu;Ban Luo;Gang Yuan;Jing Zhang
    • Korean Journal of Radiology
    • /
    • 제23권6호
    • /
    • pp.664-673
    • /
    • 2022
  • Objective: To evaluate the performance of baseline clinical characteristics and pretherapeutic histogram parameters derived from T2 mapping of the extraocular muscles (EOMs) in the prediction of treatment response to intravenous glucocorticoid (IVGC) therapy for active and moderate-to-severe thyroid-associated ophthalmopathy (TAO) and to investigate the effect of fat-suppression (FS) in T2 mapping in this prediction. Materials and Methods: A total of 79 patients clinically diagnosed with active, moderate-to-severe TAO (47 female, 32 male; mean age ± standard deviation, 46.1 ± 10 years), including 43 patients with a total of 86 orbits in the responsive group and 36 patients with a total of 72 orbits in the unresponsive group, were enrolled. Baseline clinical characteristics and pretherapeutic histogram parameters derived from T2 mapping with FS (i.e., FS T2 mapping) or without FS (i.e., conventional T2 mapping) of EOMs were compared between the two groups. Independent predictors of treatment response to IVGC were identified using multivariable analysis. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the predictive performance of the prediction models. Differences between the models were examined using the DeLong test. Results: Compared to the unresponsive group, the responsive group had a shorter disease duration, lower kurtosis (FS-kurtosis), lower standard deviation, larger 75th, 90th, and 95th (FS-95th) T2 relaxation times in FS mapping and lower kurtosis in conventional T2 mapping. Multivariable analysis revealed that disease duration, FS-95th percentile, and FS-kurtosis were independent predictors of treatment response. The combined model, integrating all identified predictors, had an optimized area under the ROC curve of 0.797, 88.4% sensitivity, and 62.5% specificity, which were significantly superior to those of the imaging model (p = 0.013). Conclusion: An integrated combination of disease duration, FS-95th percentile, and FS-kurtosis was a potential predictor of treatment response to IVGC in patients with active and moderate-to-severe TAO. FS T2 mapping was superior to conventional T2 mapping in terms of prediction.

Diagnostic Performance of Spin-Echo Echo-Planar Imaging Magnetic Resonance Elastography in 3T System for Noninvasive Assessment of Hepatic Fibrosis

  • Se Woo Kim;Jeong Min Lee;Sungeun Park;Ijin Joo;Jeong Hee Yoon;Won Chang;Haeryoung Kim
    • Korean Journal of Radiology
    • /
    • 제23권2호
    • /
    • pp.180-188
    • /
    • 2022
  • Objective: To validate the performance of 3T spin-echo echo-planar imaging (SE-EPI) magnetic resonance elastography (MRE) for staging hepatic fibrosis in a large population, using surgical specimens as the reference standard. Materials and Methods: This retrospective study initially included 310 adults (155 undergoing hepatic resection and 155 undergoing donor hepatectomy) with histopathologic results from surgical liver specimens. They underwent 3T SE-EPI MRE ≤ 3 months prior to surgery. Demographic findings, underlying liver disease, and hepatic fibrosis pathologic stage according to METAVIR were recorded. Liver stiffness (LS) was measured by two radiologists, and inter-reader reproducibility was evaluated using the intraclass correlation coefficient (ICC). The mean LS of each fibrosis stage (F0-F4) was calculated in total and for each etiologic subgroup. Comparisons among subgroups were performed using the Kruskal-Wallis test and Conover post-hoc test. The cutoff values for fibrosis staging were estimated using receiver operating characteristic (ROC) curve analysis. Results: Inter-reader reproducibility was excellent (ICC, 0.98; 95% confidence interval, 0.97-0.99). The mean LS values were 1.91, 2.41, 3.24, and 5.41 kPa in F0-F1 (n = 171), F2 (n = 26), F3 (n = 38), and F4 (n = 72), respectively. The discriminating cutoff values for diagnosing ≥ F2, ≥ F3, and F4 were 2.18, 2.71, and 3.15 kPa, respectively, with the ROC curve areas of 0.97-0.98 (sensitivity 91.2%-95.9%, specificity 90.7%-99.0%). The mean LS was significantly higher in patients with cirrhosis (F4) of nonviral causes, such as primary biliary cirrhosis (9.56 kPa) and alcoholic liver disease (7.17 kPa) than in those with hepatitis B or C cirrhosis (4.28 and 4.92 kPa, respectively). There were no statistically significant differences in LS among the different etiologic subgroups in the F0-F3 stages. Conclusion: The 3T SE-EPI MRE demonstrated high interobserver reproducibility, and our criteria for staging hepatic fibrosis showed high diagnostic performance. LS was significantly higher in patients with non-viral cirrhosis than in those with viral cirrhosis.

Prediction of Cognitive Progression in Individuals with Mild Cognitive Impairment Using Radiomics as an Improvement of the ATN System: A Five-Year Follow-Up Study

  • Rao Song;Xiaojia Wu;Huan Liu;Dajing Guo;Lin Tang;Wei Zhang;Junbang Feng;Chuanming Li
    • Korean Journal of Radiology
    • /
    • 제23권1호
    • /
    • pp.89-100
    • /
    • 2022
  • Objective: To improve the N biomarker in the amyloid/tau/neurodegeneration system by radiomics and study its value for predicting cognitive progression in individuals with mild cognitive impairment (MCI). Materials and Methods: A group of 147 healthy controls (HCs) (72 male; mean age ± standard deviation, 73.7 ± 6.3 years), 197 patients with MCI (114 male; 72.2 ± 7.1 years), and 128 patients with Alzheimer's disease (AD) (74 male; 73.7 ± 8.4 years) were included. Optimal A, T, and N biomarkers for discriminating HC and AD were selected using receiver operating characteristic (ROC) curve analysis. A radiomics model containing comprehensive information of the whole cerebral cortex and deep nuclei was established to create a new N biomarker. Cerebrospinal fluid (CSF) biomarkers were evaluated to determine the optimal A or T biomarkers. All MCI patients were followed up until AD conversion or for at least 60 months. The predictive value of A, T, and the radiomics-based N biomarker for cognitive progression of MCI to AD were analyzed using Kaplan-Meier estimates and the log-rank test. Results: The radiomics-based N biomarker showed an ROC curve area of 0.998 for discriminating between AD and HC. CSF Aβ42 and p-tau proteins were identified as the optimal A and T biomarkers, respectively. For MCI patients on the Alzheimer's continuum, isolated A+ was an indicator of cognitive stability, while abnormalities of T and N, separately or simultaneously, indicated a high risk of progression. For MCI patients with suspected non-Alzheimer's disease pathophysiology, isolated T+ indicated cognitive stability, while the appearance of the radiomics-based N+ indicated a high risk of progression to AD. Conclusion: We proposed a new radiomics-based improved N biomarker that could help identify patients with MCI who are at a higher risk for cognitive progression. In addition, we clarified the value of a single A/T/N biomarker for predicting the cognitive progression of MCI.

Cutoff Values for Diagnosing Hepatic Steatosis Using Contemporary MRI-Proton Density Fat Fraction Measuring Methods

  • Sohee Park;Jae Hyun Kwon;So Yeon Kim;Ji Hun Kang;Jung Il Chung;Jong Keon Jang;Hye Young Jang;Ju Hyun Shim;Seung Soo Lee;Kyoung Won Kim;Gi-Won Song
    • Korean Journal of Radiology
    • /
    • 제23권12호
    • /
    • pp.1260-1268
    • /
    • 2022
  • Objective: To propose standardized MRI-proton density fat fraction (PDFF) cutoff values for diagnosing hepatic steatosis, evaluated using contemporary PDFF measuring methods in a large population of healthy adults, using histologic fat fraction (HFF) as the reference standard. Materials and Methods: A retrospective search of electronic medical records between 2015 and 2018 identified 1063 adult donor candidates for liver transplantation who had undergone liver MRI and liver biopsy within a 7-day interval. Patients with a history of liver disease or significant alcohol consumption were excluded. Chemical shift imaging-based MRI (CS-MRI) PDFF and high-speed T2-corrected multi-echo MR spectroscopy (HISTO-MRS) PDFF data were obtained. By temporal splitting, the total population was divided into development and validation sets. Receiver operating characteristic (ROC) analysis was performed to evaluate the diagnostic performance of the MRI-PDFF method. Two cutoff values with sensitivity > 90% and specificity > 90% were selected to rule-out and rule-in, respectively, hepatic steatosis with reference to HFF ≥ 5% in the development set. The diagnostic performance was assessed using the validation set. Results: Of 921 final participants (624 male; mean age ± standard deviation, 31.5 ± 9.0 years), the development and validation sets comprised 497 and 424 patients, respectively. In the development set, the areas under the ROC curve for diagnosing hepatic steatosis were 0.920 for CS-MRI-PDFF and 0.915 for HISTO-MRS-PDFF. For ruling-out hepatic steatosis, the CS-MRI-PDFF cutoff was 2.3% (sensitivity, 92.4%; specificity, 63.0%) and the HISTO-MRI-PDFF cutoff was 2.6% (sensitivity, 88.8%; specificity, 70.1%). For ruling-in hepatic steatosis, the CS-MRI-PDFF cutoff was 3.5% (sensitivity, 73.5%; specificity, 88.6%) and the HISTO-MRI-PDFF cutoff was 4.0% (sensitivity, 74.7%; specificity, 90.6%). Conclusion: In a large population of healthy adults, our study suggests diagnostic thresholds for ruling-out and ruling-in hepatic steatosis defined as HFF ≥ 5% by contemporary PDFF measurement methods.

Development and Validation of a Model Using Radiomics Features from an Apparent Diffusion Coefficient Map to Diagnose Local Tumor Recurrence in Patients Treated for Head and Neck Squamous Cell Carcinoma

  • Minjae Kim;Jeong Hyun Lee;Leehi Joo;Boryeong Jeong;Seonok Kim;Sungwon Ham;Jihye Yun;NamKug Kim;Sae Rom Chung;Young Jun Choi;Jung Hwan Baek;Ji Ye Lee;Ji-hoon Kim
    • Korean Journal of Radiology
    • /
    • 제23권11호
    • /
    • pp.1078-1088
    • /
    • 2022
  • Objective: To develop and validate a model using radiomics features from apparent diffusion coefficient (ADC) map to diagnose local tumor recurrence in head and neck squamous cell carcinoma (HNSCC). Materials and Methods: This retrospective study included 285 patients (mean age ± standard deviation, 62 ± 12 years; 220 male, 77.2%), including 215 for training (n = 161) and internal validation (n = 54) and 70 others for external validation, with newly developed contrast-enhancing lesions at the primary cancer site on the surveillance MRI following definitive treatment of HNSCC between January 2014 and October 2019. Of the 215 and 70 patients, 127 and 34, respectively, had local tumor recurrence. Radiomics models using radiomics scores were created separately for T2-weighted imaging (T2WI), contrast-enhanced T1-weighted imaging (CE-T1WI), and ADC maps using non-zero coefficients from the least absolute shrinkage and selection operator in the training set. Receiver operating characteristic (ROC) analysis was used to evaluate the diagnostic performance of each radiomics score and known clinical parameter (age, sex, and clinical stage) in the internal and external validation sets. Results: Five radiomics features from T2WI, six from CE-T1WI, and nine from ADC maps were selected and used to develop the respective radiomics models. The area under ROC curve (AUROC) of ADC radiomics score was 0.76 (95% confidence interval [CI], 0.62-0.89) and 0.77 (95% CI, 0.65-0.88) in the internal and external validation sets, respectively. These were significantly higher than the AUROC values of T2WI (0.53 [95% CI, 0.40-0.67], p = 0.006), CE-T1WI (0.53 [95% CI, 0.40-0.67], p = 0.012), and clinical parameters (0.53 [95% CI, 0.39-0.67], p = 0.021) in the external validation set. Conclusion: The radiomics model using ADC maps exhibited higher diagnostic performance than those of the radiomics models using T2WI or CE-T1WI and clinical parameters in the diagnosis of local tumor recurrence in HNSCC following definitive treatment.

Pleural Carcinoembryonic Antigen and Maximum Standardized Uptake Value as Predictive Indicators of Visceral Pleural Invasion in Clinical T1N0M0 Lung Adenocarcinoma

  • Hye Rim Na;Seok Whan Moon;Kyung Soo Kim;Mi Hyoung Moon;Kwanyong Hyun;Seung Keun Yoon
    • Journal of Chest Surgery
    • /
    • 제57권1호
    • /
    • pp.44-52
    • /
    • 2024
  • Background: Visceral pleural invasion (VPI) is a poor prognostic factor that contributes to the upstaging of early lung cancers. However, the preoperative assessment of VPI presents challenges. This study was conducted to examine intraoperative pleural carcinoembryonic antigen (pCEA) level and maximum standardized uptake value (SUVmax) as predictive markers of VPI in patients with clinical T1N0M0 lung adenocarcinoma. Methods: A retrospective review was conducted of the medical records of 613 patients who underwent intraoperative pCEA sampling and lung resection for non-small cell lung cancer. Of these, 390 individuals with clinical stage I adenocarcinoma and tumors ≤30 mm were included. Based on computed tomography findings, these patients were divided into pleural contact (n=186) and non-pleural contact (n=204) groups. A receiver operating characteristic (ROC) curve was constructed to analyze the association between pCEA and SUVmax in relation to VPI. Additionally, logistic regression analysis was performed to evaluate risk factors for VPI in each group. Results: ROC curve analysis revealed that pCEA level greater than 2.565 ng/mL (area under the curve [AUC]=0.751) and SUVmax above 4.25 (AUC=0.801) were highly predictive of VPI in patients exhibiting pleural contact. Based on multivariable analysis, pCEA (odds ratio [OR], 3.00; 95% confidence interval [CI], 1.14-7.87; p=0.026) and SUVmax (OR, 5.25; 95% CI, 1.90-14.50; p=0.001) were significant risk factors for VPI in the pleural contact group. Conclusion: In patients with clinical stage I lung adenocarcinoma exhibiting pleural contact, pCEA and SUVmax are potential predictive indicators of VPI. These markers may be helpful in planning for lung cancer surgery.

Two-Dimensional Shear Wave Elastography Predicts Liver Fibrosis in Jaundiced Infants with Suspected Biliary Atresia: A Prospective Study

  • Huadong Chen;Luyao Zhou;Bing Liao;Qinghua Cao;Hong Jiang;Wenying Zhou;Guotao Wang;Xiaoyan Xie
    • Korean Journal of Radiology
    • /
    • 제22권6호
    • /
    • pp.959-969
    • /
    • 2021
  • Objective: This study aimed to evaluate the role of preoperative two-dimensional (2D) shear wave elastography (SWE) in assessing the stages of liver fibrosis in patients with suspected biliary atresia (BA) and compared its diagnostic performance with those of serum fibrosis biomarkers. Materials and Methods: This study was approved by the ethical committee, and written informed parental consent was obtained. Two hundred and sixteen patients were prospectively enrolled between January 2012 and October 2018. The 2D SWE measurements of 69 patients have been previously reported. 2D SWE measurements, serum fibrosis biomarkers, including fibrotic markers and biochemical test results, and liver histology parameters were obtained. 2D SWE values, serum biomarkers including, aspartate aminotransferase to platelet ratio index (APRi), and other serum fibrotic markers were correlated with the stages of liver fibrosis by METAVIR. Receiver operating characteristic (ROC) curves and area under the ROC (AUROC) curve analyses were used. Results: The correlation coefficient of 2D SWE value in correlation with the stages of liver fibrosis was 0.789 (p < 0.001). The cut-off values of 2D SWE were calculated as 9.1 kPa for F1, 11.6 kPa for F2, 13.0 kPa for F3, and 15.7 kPa for F4. The AUROCs of 2D SWE in the determination of the stages of liver fibrosis ranged from 0.869 to 0.941. The sensitivity and negative predictive value of 2D SWE in the diagnosis of ≥ F3 was 93.4% and 96.0%, respectively. The diagnostic performance of 2D SWE was superior to that of APRi and other serum fibrotic markers in predicting severe fibrosis and cirrhosis (all p < 0.005) and other serum biomarkers. Multivariate analysis showed that the 2D SWE value was the only statistically significant parameter for predicting liver fibrosis. Conclusion: 2D SWE is a more effective non-invasive tool for predicting the stage of liver fibrosis in patients with suspected BA, compared with serum fibrosis biomarkers.

Quantitative Ultrasound Radiofrequency Data Analysis for the Assessment of Hepatic Steatosis in Nonalcoholic Fatty Liver Disease Using Magnetic Resonance Imaging Proton Density Fat Fraction as the Reference Standard

  • Sun Kyung Jeon;Jeong Min Lee;Ijin Joo;Sae-Jin Park
    • Korean Journal of Radiology
    • /
    • 제22권7호
    • /
    • pp.1077-1086
    • /
    • 2021
  • Objective: To investigate the diagnostic performance of quantitative ultrasound (US) parameters for the assessment of hepatic steatosis in patients with nonalcoholic fatty liver disease (NAFLD) using magnetic resonance imaging proton density fat fraction (MRI-PDFF) as the reference standard. Materials and Methods: In this single-center prospective study, 120 patients with clinically suspected NAFLD were enrolled between March 2019 and January 2020. The participants underwent US examination for radiofrequency (RF) data acquisition and chemical shift-encoded liver MRI for PDFF measurement. Using the RF data analysis, the attenuation coefficient (AC) based on tissue attenuation imaging (TAI) (AC-TAI) and scatter-distribution coefficient (SC) based on tissue scatter-distribution imaging (TSI) (SC-TSI) were measured. The correlations between the quantitative US parameters (AC and SC) and MRI-PDFF were evaluated using Pearson correlation coefficients. The diagnostic performance of AC-TAI and SC-TSI for detecting hepatic fat contents of ≥ 5% (MRI-PDFF ≥ 5%) and ≥ 10% (MRI-PDFF ≥ 10%) were assessed using receiver operating characteristic (ROC) analysis. The significant clinical or imaging factors associated with AC and SC were analyzed using linear regression analysis. Results: The participants were classified based on MRI-PDFF: < 5% (n = 38), 5-10% (n = 23), and ≥ 10% (n = 59). AC-TAI and SC-TSI were significantly correlated with MRI-PDFF (r = 0.659 and 0.727, p < 0.001 for both). For detecting hepatic fat contents of ≥ 5% and ≥ 10%, the areas under the ROC curves of AC-TAI were 0.861 (95% confidence interval [CI]: 0.786-0.918) and 0.835 (95% CI: 0.757-0.897), and those of SC-TSI were 0.964 (95% CI: 0.913-0.989) and 0.935 (95% CI: 0.875-0.972), respectively. Multivariable linear regression analysis showed that MRI-PDFF was an independent determinant of AC-TAI and SC-TSI. Conclusion: AC-TAI and SC-TSI derived from quantitative US RF data analysis yielded a good correlation with MRI-PDFF and provided good performance for detecting hepatic steatosis and assessing its severity in NAFLD.

Added Value of Chemical Exchange-Dependent Saturation Transfer MRI for the Diagnosis of Dementia

  • Jang-Hoon Oh;Bo Guem Choi;Hak Young Rhee;Jin San Lee;Kyung Mi Lee;Soonchan Park;Ah Rang Cho;Chang-Woo Ryu;Key Chung Park;Eui Jong Kim;Geon-Ho Jahng
    • Korean Journal of Radiology
    • /
    • 제22권5호
    • /
    • pp.770-781
    • /
    • 2021
  • Objective: Chemical exchange-dependent saturation transfer (CEST) MRI is sensitive for detecting solid-like proteins and may detect changes in the levels of mobile proteins and peptides in tissues. The objective of this study was to evaluate the characteristics of chemical exchange proton pools using the CEST MRI technique in patients with dementia. Materials and Methods: Our institutional review board approved this cross-sectional prospective study and informed consent was obtained from all participants. This study included 41 subjects (19 with dementia and 22 without dementia). Complete CEST data of the brain were obtained using a three-dimensional gradient and spin-echo sequence to map CEST indices, such as amide, amine, hydroxyl, and magnetization transfer ratio asymmetry (MTRasym) values, using six-pool Lorentzian fitting. Statistical analyses of CEST indices were performed to evaluate group comparisons, their correlations with gray matter volume (GMV) and Mini-Mental State Examination (MMSE) scores, and receiver operating characteristic (ROC) curves. Results: Amine signals (0.029 for non-dementia, 0.046 for dementia, p = 0.011 at hippocampus) and MTRasym values at 3 ppm (0.748 for non-dementia, 1.138 for dementia, p = 0.022 at hippocampus), and 3.5 ppm (0.463 for non-dementia, 0.875 for dementia, p = 0.029 at hippocampus) were significantly higher in the dementia group than in the non-dementia group. Most CEST indices were not significantly correlated with GMV; however, except amide, most indices were significantly correlated with the MMSE scores. The classification power of most CEST indices was lower than that of GMV but adding one of the CEST indices in GMV improved the classification between the subject groups. The largest improvement was seen in the MTRasym values at 2 ppm in the anterior cingulate (area under the ROC curve = 0.981), with a sensitivity of 100 and a specificity of 90.91. Conclusion: CEST MRI potentially allows noninvasive image alterations in the Alzheimer's disease brain without injecting isotopes for monitoring different disease states and may provide a new imaging biomarker in the future.