• Title/Summary/Keyword: Area Under the Receiver Operating Characteristic Curve (AUC)

Search Result 167, Processing Time 0.029 seconds

Pleural Carcinoembryonic Antigen and Maximum Standardized Uptake Value as Predictive Indicators of Visceral Pleural Invasion in Clinical T1N0M0 Lung Adenocarcinoma

  • Hye Rim Na;Seok Whan Moon;Kyung Soo Kim;Mi Hyoung Moon;Kwanyong Hyun;Seung Keun Yoon
    • Journal of Chest Surgery
    • /
    • v.57 no.1
    • /
    • pp.44-52
    • /
    • 2024
  • Background: Visceral pleural invasion (VPI) is a poor prognostic factor that contributes to the upstaging of early lung cancers. However, the preoperative assessment of VPI presents challenges. This study was conducted to examine intraoperative pleural carcinoembryonic antigen (pCEA) level and maximum standardized uptake value (SUVmax) as predictive markers of VPI in patients with clinical T1N0M0 lung adenocarcinoma. Methods: A retrospective review was conducted of the medical records of 613 patients who underwent intraoperative pCEA sampling and lung resection for non-small cell lung cancer. Of these, 390 individuals with clinical stage I adenocarcinoma and tumors ≤30 mm were included. Based on computed tomography findings, these patients were divided into pleural contact (n=186) and non-pleural contact (n=204) groups. A receiver operating characteristic (ROC) curve was constructed to analyze the association between pCEA and SUVmax in relation to VPI. Additionally, logistic regression analysis was performed to evaluate risk factors for VPI in each group. Results: ROC curve analysis revealed that pCEA level greater than 2.565 ng/mL (area under the curve [AUC]=0.751) and SUVmax above 4.25 (AUC=0.801) were highly predictive of VPI in patients exhibiting pleural contact. Based on multivariable analysis, pCEA (odds ratio [OR], 3.00; 95% confidence interval [CI], 1.14-7.87; p=0.026) and SUVmax (OR, 5.25; 95% CI, 1.90-14.50; p=0.001) were significant risk factors for VPI in the pleural contact group. Conclusion: In patients with clinical stage I lung adenocarcinoma exhibiting pleural contact, pCEA and SUVmax are potential predictive indicators of VPI. These markers may be helpful in planning for lung cancer surgery.

Comparison of One- and Two-Region of Interest Strain Elastography Measurements in the Differential Diagnosis of Breast Masses

  • Hee Jeong Park;Sun Mi Kim;Bo La Yun;Mijung Jang;Bohyoung Kim;Soo Hyun Lee;Hye Shin Ahn
    • Korean Journal of Radiology
    • /
    • v.21 no.4
    • /
    • pp.431-441
    • /
    • 2020
  • Objective: To compare the diagnostic performance and interobserver variability of strain ratio obtained from one or two regions of interest (ROI) on breast elastography. Materials and Methods: From April to May 2016, 140 breast masses in 140 patients who underwent conventional ultrasonography (US) with strain elastography followed by US-guided biopsy were evaluated. Three experienced breast radiologists reviewed recorded US and elastography images, measured strain ratios, and categorized them according to the American College of Radiology breast imaging reporting and data system lexicon. Strain ratio was obtained using the 1-ROI method (one ROI drawn on the target mass), and the 2-ROI method (one ROI in the target mass and another in reference fat tissue). The diagnostic performance of the three radiologists among datasets and optimal cut-off values for strain ratios were evaluated. Interobserver variability of strain ratio for each ROI method was assessed using intraclass correlation coefficient values, Bland-Altman plots, and coefficients of variation. Results: Compared to US alone, US combined with the strain ratio measured using either ROI method significantly improved specificity, positive predictive value, accuracy, and area under the receiver operating characteristic curve (AUC) (all p values < 0.05). Strain ratio obtained using the 1-ROI method showed higher interobserver agreement between the three radiologists without a significant difference in AUC for differentiating breast cancer when the optimal strain ratio cut-off value was used, compared with the 2-ROI method (AUC: 0.788 vs. 0.783, 0.693 vs. 0.715, and 0.691 vs. 0.686, respectively, all p values > 0.05). Conclusion: Strain ratios obtained using the 1-ROI method showed higher interobserver agreement without a significant difference in AUC, compared to those obtained using the 2-ROI method. Considering that the 1-ROI method can reduce performers' efforts, it could have an important role in improving the diagnostic performance of breast US by enabling consistent management of breast lesions.

Development and Testing of a Machine Learning Model Using 18F-Fluorodeoxyglucose PET/CT-Derived Metabolic Parameters to Classify Human Papillomavirus Status in Oropharyngeal Squamous Carcinoma

  • Changsoo Woo;Kwan Hyeong Jo;Beomseok Sohn;Kisung Park;Hojin Cho;Won Jun Kang;Jinna Kim;Seung-Koo Lee
    • Korean Journal of Radiology
    • /
    • v.24 no.1
    • /
    • pp.51-61
    • /
    • 2023
  • Objective: To develop and test a machine learning model for classifying human papillomavirus (HPV) status of patients with oropharyngeal squamous cell carcinoma (OPSCC) using 18F-fluorodeoxyglucose (18F-FDG) PET-derived parameters in derived parameters and an appropriate combination of machine learning methods in patients with OPSCC. Materials and Methods: This retrospective study enrolled 126 patients (118 male; mean age, 60 years) with newly diagnosed, pathologically confirmed OPSCC, that underwent 18F-FDG PET-computed tomography (CT) between January 2012 and February 2020. Patients were randomly assigned to training and internal validation sets in a 7:3 ratio. An external test set of 19 patients (16 male; mean age, 65.3 years) was recruited sequentially from two other tertiary hospitals. Model 1 used only PET parameters, Model 2 used only clinical features, and Model 3 used both PET and clinical parameters. Multiple feature transforms, feature selection, oversampling, and training models are all investigated. The external test set was used to test the three models that performed best in the internal validation set. The values for area under the receiver operating characteristic curve (AUC) were compared between models. Results: In the external test set, ExtraTrees-based Model 3, which uses two PET-derived parameters and three clinical features, with a combination of MinMaxScaler, mutual information selection, and adaptive synthetic sampling approach, showed the best performance (AUC = 0.78; 95% confidence interval, 0.46-1). Model 3 outperformed Model 1 using PET parameters alone (AUC = 0.48, p = 0.047) and Model 2 using clinical parameters alone (AUC = 0.52, p = 0.142) in predicting HPV status. Conclusion: Using oversampling and mutual information selection, an ExtraTree-based HPV status classifier was developed by combining metabolic parameters derived from 18F-FDG PET/CT and clinical parameters in OPSCC, which exhibited higher performance than the models using either PET or clinical parameters alone.

Prediction of Patient Management in COVID-19 Using Deep Learning-Based Fully Automated Extraction of Cardiothoracic CT Metrics and Laboratory Findings

  • Thomas Weikert;Saikiran Rapaka;Sasa Grbic;Thomas Re;Shikha Chaganti;David J. Winkel;Constantin Anastasopoulos;Tilo Niemann;Benedikt J. Wiggli;Jens Bremerich;Raphael Twerenbold;Gregor Sommer;Dorin Comaniciu;Alexander W. Sauter
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.994-1004
    • /
    • 2021
  • Objective: To extract pulmonary and cardiovascular metrics from chest CTs of patients with coronavirus disease 2019 (COVID-19) using a fully automated deep learning-based approach and assess their potential to predict patient management. Materials and Methods: All initial chest CTs of patients who tested positive for severe acute respiratory syndrome coronavirus 2 at our emergency department between March 25 and April 25, 2020, were identified (n = 120). Three patient management groups were defined: group 1 (outpatient), group 2 (general ward), and group 3 (intensive care unit [ICU]). Multiple pulmonary and cardiovascular metrics were extracted from the chest CT images using deep learning. Additionally, six laboratory findings indicating inflammation and cellular damage were considered. Differences in CT metrics, laboratory findings, and demographics between the patient management groups were assessed. The potential of these parameters to predict patients' needs for intensive care (yes/no) was analyzed using logistic regression and receiver operating characteristic curves. Internal and external validity were assessed using 109 independent chest CT scans. Results: While demographic parameters alone (sex and age) were not sufficient to predict ICU management status, both CT metrics alone (including both pulmonary and cardiovascular metrics; area under the curve [AUC] = 0.88; 95% confidence interval [CI] = 0.79-0.97) and laboratory findings alone (C-reactive protein, lactate dehydrogenase, white blood cell count, and albumin; AUC = 0.86; 95% CI = 0.77-0.94) were good classifiers. Excellent performance was achieved by a combination of demographic parameters, CT metrics, and laboratory findings (AUC = 0.91; 95% CI = 0.85-0.98). Application of a model that combined both pulmonary CT metrics and demographic parameters on a dataset from another hospital indicated its external validity (AUC = 0.77; 95% CI = 0.66-0.88). Conclusion: Chest CT of patients with COVID-19 contains valuable information that can be accessed using automated image analysis. These metrics are useful for the prediction of patient management.

Risk factors affecting the difficulty of fiberoptic nasotracheal intubation

  • Rhee, Seung-Hyun;Yun, Hye Joo;Kim, Jieun;Karm, Myong-Hwan;Ryoo, Seung-Hwa;Kim, Hyun Jeong;Seo, Kwang-Suk
    • Journal of Dental Anesthesia and Pain Medicine
    • /
    • v.20 no.5
    • /
    • pp.293-301
    • /
    • 2020
  • Background: The success rate of intubation under direct laryngoscopy is greatly influenced by laryngoscopic grade using the Cormack-Lehane classification. However, it is not known whether grade under direct laryngoscopy can also affects the success rate of nasotracheal intubation using a fiberoptic bronchoscpe, so this study investigated the same. In addition, we investigated other factors that influence the success rate of fiberoptic nasotracheal intubation (FNI). Methods: FNI was performed by 18 anesthesiology residents under general anesthesia in patients over 15 years of age who underwent elective oral and maxillofacial operations. In all patients, the Mallampati grade was measured. Laryngeal view grade under direct laryngoscopy, and the degree of secretion and bleeding in the oral cavity was measured and divided into 3 grades. The time required for successful FNI was measured. If the intubation time was > 5 minutes, it was evaluated as a failure and the airway was managed by another method. The failure rate was evaluated using appropriate statistical method. Receiver operating characteristic (ROC) curves and area under the curve (AUC) were also measured. Results: A total of 650 patients were included in the study, and the failure rate of FNI was 4.5%. The patient's sex, age, height, weight, Mallampati, and laryngoscopic view grade did not affect the success rate of FNI (P > 0.05). BMI, the number of FNI performed by residents (P = 0.03), secretion (P < 0.001), and bleeding (P < 0.001) grades influenced the success rate. The AUCs of bleeding and secretion were 0.864 and 0.798, respectively, but the AUC of BMI, the number of FNI performed by residents, Mallampati, and laryngoscopic view grade were 0.527, 0.616, 0.614, and 0.544, respectively. Conclusion: Unlike in intubation under direct laryngoscopy, in the case of FNI, oral secretion and nasal bleeding had a significant effect on FNI difficulty than Mallampati grade or Laryngeal view grade.

Nomogram Models for Distinguishing Intraductal Carcinoma of the Prostate From Prostatic Acinar Adenocarcinoma Based on Multiparametric Magnetic Resonance Imaging

  • Ling Yang;Xue-Ming Li;Meng-Ni Zhang;Jin Yao;Bin Song
    • Korean Journal of Radiology
    • /
    • v.24 no.7
    • /
    • pp.668-680
    • /
    • 2023
  • Objective: To compare multiparametric magnetic resonance imaging (MRI) features of intraductal carcinoma of the prostate (IDC-P) with those of prostatic acinar adenocarcinoma (PAC) and develop prediction models to distinguish IDC-P from PAC and IDC-P with a high proportion (IDC ≥ 10%, hpIDC-P) from IDC-P with a low proportion (IDC < 10%, lpIDC-P) and PAC. Materials and Methods: One hundred and six patients with hpIDC-P, 105 with lpIDC-P and 168 with PAC, who underwent pretreatment multiparametric MRI between January 2015 and December 2020 were included in this study. Imaging parameters, including invasiveness and metastasis, were evaluated and compared between the PAC and IDC-P groups as well as between the hpIDC-P and lpIDC-P subgroups. Nomograms for distinguishing IDC-P from PAC, and hpIDC-P from lpIDC-P and PAC, were made using multivariable logistic regression analysis. The discrimination performance of the models was assessed using the receiver operating characteristic area under the curve (ROC-AUC) in the sample, where the models were derived from without an independent validation sample. Results: The tumor diameter was larger and invasive and metastatic features were more common in the IDC-P than in the PAC group (P < 0.001). The distribution of extraprostatic extension (EPE) and pelvic lymphadenopathy was even greater, and the apparent diffusion coefficient (ADC) ratio was lower in the hpIDC-P than in the lpIDC-P group (P < 0.05). The ROC-AUCs of the stepwise models based solely on imaging features for distinguishing IDC-P from PAC and hpIDC-P from lpIDC-P and PAC were 0.797 (95% confidence interval, 0.750-0.843) and 0.777 (0.727-0.827), respectively. Conclusion: IDC-P was more likely to be larger, more invasive, and more metastatic, with obviously restricted diffusion. EPE, pelvic lymphadenopathy, and a lower ADC ratio were more likely to occur in hpIDC-P, and were also the most useful variables in both nomograms for predicting IDC-P and hpIDC-P.

Use of an Artificial Neural Network to Predict Risk Factors of Nosocomial Infection in Lung Cancer Patients

  • Chen, Jie;Pan, Qin-Shi;Hong, Wan-Dong;Pan, Jingye;Zhang, Wen-Hui;Xu, Gang;Wang, Yu-Min
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.13
    • /
    • pp.5349-5353
    • /
    • 2014
  • Statistical methods to analyze and predict the related risk factors of nosocomial infection in lung cancer patients are various, but the results are inconsistent. A total of 609 patients with lung cancer were enrolled to allow factor comparison using Student's t-test or the Mann-Whitney test or the Chi-square test. Variables that were significantly related to the presence of nosocomial infection were selected as candidates for input into the final ANN model. The area under the receiver operating characteristic (ROC) curve (AUC) was used to evaluate the performance of the artificial neural network (ANN) model and logistic regression (LR) model. The prevalence of nosocomial infection from lung cancer in this entire study population was 20.1% (165/609), nosocomial infections occurring in sputum specimens (85.5%), followed by blood (6.73%), urine (6.0%) and pleural effusions (1.82%). It was shown that long term hospitalization (${\geq}22days$, P= 0.000), poor clinical stage (IIIb and IV stage, P=0.002), older age (${\geq}61days$ old, P=0.023), and use the hormones were linked to nosocomial infection and the ANN model consisted of these four factors. The artificial neural network model with variables consisting of age, clinical stage, time of hospitalization, and use of hormones should be useful for predicting nosocomial infection in lung cancer cases.

Clinical Utility of Haptoglobin in Combination with CEA, NSE and CYFRA21-1 for Diagnosis of Lung Cancer

  • Wang, Bing;He, Yu-Jie;Tian, Ying-Xing;Yang, Rui-Ning;Zhu, Yue-Rong;Qiu, Hong
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.22
    • /
    • pp.9611-9614
    • /
    • 2014
  • Purpose: To investigate the clinical value in lung cancer of a combination of four serum tumor markers, haptoglobin (Hp), carcinoembryonic antigen (CEA), neuron specific enolase (NSE) as well as the cytokeratin 19 fragment (CYFRA21-1). Materials and Methods: Serum Hp (with immune-turbidimetric method), CEA, NSE, CYFRA21-1 (with chemiluminescence method) level were assessed in 193 patients with lung cancer, 87 patients with benign lung disease and 150 healthy controls. Differences of expression were compared among groups, and joint effects of these tumor markers for the diagnosis of lung cancer were analyzed. Results: Serum tumor marker levels in patients with lung cancer were obviously higher than those with benign lung disease and normal controls (p<0.01). The sensitivities of Hp, CEA, NSE and CYFRA21-1 were 43.5%, 40.9%, 23.3% and 41.5%, with specificities of 90.7%, 99.2%, 97.9% and 97.9%. Four tumor markers combined together could produce a positive detection rate of 85.0%, significantly higher than that of any single test. With squamous carcinomas, the positive detection rates with Hp and CYFRA21-1 were higher than that of other markers. In the adenocarcinoma case, the positive detection rate of CEA was higher than that of other markers. For small cell carcinomas, the positive detection rate of NSE was highest. The area under receiver operating characteristic curve ($AUC^{ROC}$) of Hp in squamous carcinoma (0.805) was higher than in adenocarcinoma (0.664) and small cell carcinoma (0.665). Conclusions: Hp can be used as a new serum tumor marker for lung cancer. Combination detection of Hp, CEA, NSE and CYFRA21-1 could significantly improve the sensitivity and specificity in diagnosis of lung cancer, and could be useful for pathological typing.

Assessment of solid components of borderline ovarian tumor and stage I carcinoma: added value of combined diffusion- and perfusion-weighted magnetic resonance imaging

  • Kim, See Hyung
    • Journal of Yeungnam Medical Science
    • /
    • v.36 no.3
    • /
    • pp.231-240
    • /
    • 2019
  • Background: We sought to determine the value of combining diffusion-weighted (DW) and perfusion-weighted (PW) sequences with a conventional magnetic resonance (MR) sequence to assess solid components of borderline ovarian tumors (BOTs) and stage I carcinomas. Methods: Conventional, DW, and PW sequences in the tumor imaging studies of 70 patients (BOTs, n=38; stage I carcinomas, n=32) who underwent surgery with pathologic correlation were assessed. Two independent radiologists calculated the parameters apparent diffusion coefficient (ADC), $K^{trans}$ (vessel permeability), and $V_e$ (cell density) for the solid components. The distribution on conventional MR sequence and mean, standard deviation, and 95% confidence interval of each DW and PW parameter were calculated. The inter-observer agreement among the two radiologists was assessed. Area under the receiver operating characteristic curve (AUC) and multivariate logistic regression were performed to compare the effectiveness of DW and PW sequences for average values and to characterize the diagnostic performance of combined DW and PW sequences. Results: There were excellent agreements for DW and PW parameters between radiologists. The distributions of ADC, $K^{trans}$, and $V_e$ values were significantly different between BOTs and stage I carcinomas, yielding AUCs of 0.58 and 0.68, 0.78 and 0.82, and 0.70 and 0.72, respectively, with ADC yielding the lowest diagnostic performance. The AUCs of the DW, PW, and combined PW and DW sequences were $0.71{\pm}0.05$, $0.80{\pm}0.05$, and $0.85{\pm}0.05$, respectively. Conclusion: Combining PW and DW sequences to a conventional sequence potentially improves the diagnostic accuracy in the differentiation of BOTs and stage I carcinomas.

Bayesian Model for the Classification of GPCR Agonists and Antagonists

  • Choi, In-Hee;Kim, Han-Jo;Jung, Ji-Hoon;Nam, Ky-Youb;Yoo, Sung-Eun;Kang, Nam-Sook;No, Kyoung-Tai
    • Bulletin of the Korean Chemical Society
    • /
    • v.31 no.8
    • /
    • pp.2163-2169
    • /
    • 2010
  • G-protein coupled receptors (GPCRs) are involved in a wide variety of physiological processes and are known to be targets for nearly 50% of drugs. The various functions of GPCRs are affected by their cognate ligands which are mainly classified as agonists and antagonists. The purpose of this study is to develop a Bayesian classification model, that can predict a compound as either human GPCR agonist or antagonist. Total 6627 compounds experimentally determined as either GPCR agonists or antagonists covering all the classes of GPCRs were gathered to comprise the dataset. This model distinguishes GPCR agonists from GPCR antagonists by using chemical fingerprint, FCFP_6. The model revealed distinctive structural characteristics between agonistic and antagonistic compounds: in general, 1) GPCR agonists were flexible and had aliphatic amines, and 2) GPCR antagonists had planar groups and aromatic amines. This model showed very good discriminative ability in general, with pretty good discriminant statistics for the training set (accuracy: 90.1%) and a good predictive ability for the test set (accuracy: 89.2%). Also, receiver operating characteristic (ROC) plot showed the area under the curve (AUC) to be 0.957, and Matthew's Correlation Coefficient (MCC) value was 0.803. The quality of our model suggests that it could aid to classify the compounds as either GPCR agonists or antagonists, especially in the early stages of the drug discovery process.