• 제목/요약/키워드: ROC(Receiver operating characteristic)

Search Result 362, Processing Time 0.026 seconds

Texture Analysis of Three-Dimensional MRI Images May Differentiate Borderline and Malignant Epithelial Ovarian Tumors

  • Rongping Ye;Shuping Weng;Yueming Li;Chuan Yan;Jianwei Chen;Yuemin Zhu;Liting Wen
    • Korean Journal of Radiology
    • /
    • v.22 no.1
    • /
    • pp.106-117
    • /
    • 2021
  • Objective: To explore the value of magnetic resonance imaging (MRI)-based whole tumor texture analysis in differentiating borderline epithelial ovarian tumors (BEOTs) from FIGO stage I/II malignant epithelial ovarian tumors (MEOTs). Materials and Methods: A total of 88 patients with histopathologically confirmed ovarian epithelial tumors after surgical resection, including 30 BEOT and 58 MEOT patients, were divided into a training group (n = 62) and a test group (n = 26). The clinical and conventional MRI features were retrospectively reviewed. The texture features of tumors, based on T2-weighted imaging, diffusion-weighted imaging, and contrast-enhanced T1-weighted imaging, were extracted using MaZda software and the three top weighted texture features were selected by using the Random Forest algorithm. A non-texture logistic regression model in the training group was built to include those clinical and conventional MRI variables with p value < 0.10. Subsequently, a combined model integrating non-texture information and texture features was built for the training group. The model, evaluated using patients in the training group, was then applied to patients in the test group. Finally, receiver operating characteristic (ROC) curves were used to assess the diagnostic performance of the models. Results: The combined model showed superior performance in categorizing BEOTs and MEOTs (sensitivity, 92.5%; specificity, 86.4%; accuracy, 90.3%; area under the ROC curve [AUC], 0.962) than the non-texture model (sensitivity, 78.3%; specificity, 84.6%; accuracy, 82.3%; AUC, 0.818). The AUCs were statistically different (p value = 0.038). In the test group, the AUCs, sensitivity, specificity, and accuracy were 0.840, 73.3%, 90.1%, and 80.8% when the non-texture model was used and 0.896, 75.0%, 94.0%, and 88.5% when the combined model was used. Conclusion: MRI-based texture features combined with clinical and conventional MRI features may assist in differentitating between BEOT and FIGO stage I/II MEOT patients.

Developing a Tool to Assess Competency to Consent to Treatment in the Mentally Ill Patient: Reliability and Validity (정신장애인의 치료동의능력 평가 도구 개발 : 신뢰도와 타당화)

  • Seo, Mi-Kyoung;Rhee, MinKyu;Kim, Seung-Hyun;Cho, Sung-Nam;Ko, Young-hun;Lee, Hyuk;Lee, Moon-Soo
    • Korean Journal of Health Psychology
    • /
    • v.14 no.3
    • /
    • pp.579-596
    • /
    • 2009
  • This study aimed to develop the Korean tool of competency to consent to psychiatric treatment and to analyze the reliability and validity of this tool. Also the developed tool's efficiency in determining whether a patient possesses treatment consent competence was checked using the Receiver Operating Characteristic curve and the relevant indices. A total of 193 patients with mental illness, who were hospitalized in a mental hospital or were in community mental health center, participated in this study. We administered a questionnaire consisting of 14 questions concerning understanding, appreciation, reasoning ability, and expression of a choice to the subjects. To investigate the validity of the tool, we conducted the K-MMSE, insight test, estimated IQ, and BPRS. The tool's reliability and usefulness were examined via Cronbach's alpha, ICC, and ROC analysis, and criterion related validation was performed. This tool showed that internal consistency and agreement between raters was relatively high(ICC .80~.98, Cronbach's alpha .56~.83)and the confirmatory factor analysis for constructive validation showed that the tool was valid. Also, estimated IQ, and MMSE were significantly correlated to understanding, appreciation, expression of a choice, and reasoning ability. However, the BPRS did not show significant correlation with any subcompetences. In ROC analysis, full scale cutoff score 18.5 was suggested. Subscale cutoff scores were understanding 4.5, appreciation 8.5, reasoning ability 3.5, and expression of a choice 0.5. These results suggest that this assessment tool is reliable, valid and efficient diagnostically. Finally, limitations and implications of this study were discussed.

Diagnostic Performance of Combined Single Photon Emission Computed Tomographic Scintimammography and Ultrasonography Based on Computer-Aided Diagnosis for Breast Cancer (유방 SPECT 및 초음파 컴퓨터진단시스템 결합의 유방암 진단성능)

  • Hwang, Kyung-Hoon;Lee, Jun-Gu;Kim, Jong-Hyo;Lee, Hyung-Ji;Om, Kyong-Sik;Lee, Byeong-Il;Choi, Duck-Joo;Choe, Won-Sick
    • Nuclear Medicine and Molecular Imaging
    • /
    • v.41 no.3
    • /
    • pp.201-208
    • /
    • 2007
  • Purpose: We investigated whether the diagnostic performance of SPECT scintimammography (SMM) can be improved by adding computer-aided diagnosis (CAD) of ultrasonography (US). Materials and methods: We reviewed breast SPECT SMM images and corresponding US images from 40 patients with breast masses (21 malignant and 19 benign tumors). The quantitative data of SPECT SMM were obtained as the uptake ratio of lesion to contralateral normal breast. The morphologic features of the breast lesions on US were extracted and quantitated using the automated CAD software program. The diagnostic performance of SPECT SMM and CAD of US alone was determined using receiver operating characteristic (ROC) curve analysis. The best discriminating parameter (D-value) combining SPECT SMM and the CAD of US was created. The sensitivity, specificity and accuracy of combined two diagnostic modalities were compared to those of a single one. Results: Both SPECT SMM and CAD of US showed a relatively good diagnostic performance (area under curve = 0.846 and 0.831, respectively). Combining the results of SPECT SMM and CAD of US resulted in improved diagnostic performance (area under curve =0.860), but there was no statistical differerence in sensitivity, specificity and accuracy between the combined method and a single modality. Conclusion: It seems that combining the results of SPECT SMM and CAD of breast US do not significantly improve the diagnostic performance for diagnosis of breast cancer, compared with that of SPECT SMM alone. However, SPECT SMM and CAD of US may complement each other in differential diagnosis of breast cancer.

Nitroglycerin-Challenged Tc-99m MIBI Quantitative Gated SPECT to Predict Functional Recovery After Coronary Artery Bypass Surgery (니트로글리세린 투여 Tc-99m-MIBI 정량 게이트 심근SPECT를 이용한 관상동맥우회로술 후 심근 기능 회복 예측)

  • Lee, Dong-Soo;Kim, Yu-Kyeong;Cheon, Gi-Jeong;Paeng, Jin-Chul;Lee, Myoung-Mook;Kim, Ki-Bong;Chung, June-Key;Lee, Myung-Chul
    • The Korean Journal of Nuclear Medicine
    • /
    • v.37 no.5
    • /
    • pp.278-287
    • /
    • 2003
  • Purpose: The performance of nitroglycerin-challenged Tc-99m-MIBI quantitative gated SPECT for the detection of viable myocardium was compared with rest/24-hour redistribution Tl-201 SPECT Materials and Methods: In 22 patients with coronary artery disease, rest Tl-20l/ dipyridamole stress Tc-99m-MIBI gated/24-hour redistribution Tl-201 SPECT were peformed, and gated SPECT was repeated on-site after sublingual administration of nitroglycerin (0.6 mg). Follow-up gated SPECT was done 3 months after coronary artery bypass graft surgery. For 20 segments per patient, perfusion at rest and 24-hour redistribution, and wall motion and thickening at baseline and nitroglycerin-challenged state were quantified. Quantitative viability markers were evaluated and compared;(1) rest thallium uptake, (2) thallium uptake on 24-hour redistribution SPECT, (3) systolic wall thickening at baseline, and (4) systolic wall thickening with nitroglycerin-challenge. Results: Among 100 revascularized dysfunctional segments, wall motion improved in 66 segments (66%) on follow-up gated myocardial SPECT after bypass surgery. On receiver operating characteristic (ROC) curve analysis, the sensitivity and specificity of rest and 24-hour delayed redistribution Tl-201 SPECT were 79%, 44% and 82%, 44%, respectively, at the optimal cutoff value of 50% of Tl-201 uptake. The sensitivity and specificity of systolic wall thickening at baseline and nitroglycerin-challenge were 49%, 50% and 64%, 65% at the optimal cutoff value of 15% of systolic wall thickening. Area under the ROC curve of nitroglycerin-challenged systolic wall thickening was significantly larger than that of baseline systolic wall thickening (p=0.004). Conclusion: Nitroglycerin-challenged quantitative gated Tc-99m-MIBI SPECT was a useful method for predicting functional recovery of dysfunctional myocardium.

Serum Tumor Marker Levels might have Little Significance in Evaluating Neoadjuvant Treatment Response in Locally Advanced Breast Cancer

  • Wang, Yu-Jie;Huang, Xiao-Yan;Mo, Miao;Li, Jian-Wei;Jia, Xiao-Qing;Shao, Zhi-Min;Shen, Zhen-Zhou;Wu, Jiong;Liu, Guang-Yu
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.11
    • /
    • pp.4603-4608
    • /
    • 2015
  • Background: To determine the potential value of serum tumor markers in predicting pCR (pathological complete response) during neoadjuvant chemotherapy. Materials and Methods: We retrospectively monitored the pro-, mid-, and post-neoadjuvant treatment serum tumor marker concentrations in patients with locally advanced breast cancer (stage II-III) who accepted pre-surgical chemotherapy or chemotherapy in combination with targeted therapy at Fudan University Shanghai Cancer Center between September 2011 and January 2014 and investigated the association of serum tumor marker levels with therapeutic effect. Core needle biopsy samples were assessed using immunohistochemistry (IHC) prior to neoadjuvant treatment to determine hormone receptor, human epidermal growth factor receptor 2(HER2), and proliferation index Ki67 values. In our study, therapeutic response was evaluated by pCR, defined as the disappearance of all invasive cancer cells from excised tissue (including primary lesion and axillary lymph nodes) after completion of chemotherapy. Analysis of variance of repeated measures and receiver operating characteristic (ROC) curves were employed for statistical analysis of the data. Results: A total of 348 patients were recruited in our study after excluding patients with incomplete clinical information. Of these, 106 patients were observed to have acquired pCR status after treatment completion, accounting for approximately 30.5% of study individuals. In addition, 147patients were determined to be Her-2 positive, among whom the pCR rate was 45.6% (69 patients). General linear model analysis (repeated measures analysis of variance) showed that the concentration of cancer antigen (CA) 15-3 increased after neoadjuvant chemotherapy in both pCR and non-pCR groups, and that there were significant differences between the two groups (P=0.008). The areas under the ROC curves (AUCs) of pre-, mid-, and post-treatment CA15-3 concentrations demonstrated low-level predictive value (AUC=0.594, 0.644, 0.621, respectively). No significant differences in carcinoembryonic antigen (CEA) or CA12-5 serum levels were observed between the pCR and non-pCR groups (P=0.196 and 0.693, respectively). No efficient AUC of CEA or CA12-5 concentrations were observed to predict patient response toward neoadjuvant treatment (both less than 0.7), nor were differences between the two groups observed at different time points. We then analyzed the Her-2 positive subset of our cohort. Significant differences in CEA concentrations were identified between the pCR and non-pCR groups (P=0.039), but not in CA15-3 or CA12-5 levels (p=0.092 and 0.89, respectively). None of the ROC curves showed underlying prognostic value, as the AUCs of these three markers were less than 0.7. The ROC-AUCs for the CA12-5 concentrations of inter-and post-neoadjuvant chemotherapy in the estrogen receptor negative HER2 positive subgroup were 0.735 and 0.767, respectively. However, the specificity and sensitivity values were at odds with each other which meant that improving either the sensitivity or specificity would impair the efficiency of the other. Conclusions: Serum tumor markers CA15-3, CA12-5, and CEA might have little clinical significance in predicting neoadjuvant treatment response in locally advanced breast cancer.

Validation of the Korean version of Center for Epidemiologic Studies Depression Scale-Revised(K-CESD-R) (한국판 역학연구 우울척도 개정판(K-CESD-R)의 표준화 연구)

  • Lee, San;Oh, Seung-Taek;Ryu, So Yeon;Jun, Jin Yong;Lee, Kounseok;Lee, Eun;Park, Jin Young;Yi, Sang-Wook;Choi, Won-Jung
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.24 no.1
    • /
    • pp.83-93
    • /
    • 2016
  • Objectives : The Center for Epidemiologic Studies Depression scale-Revised is a recently revised scale which has been reported as a valid tool for the assessment of depressive symptoms. It encompasses cardinal symptoms of depression described in the Diagnostic and Statistical Manual of Mental disorders, fourth edition. In this study, we assessed the reliability, validity and psychometric properties of the Korean version of the CESD-R(K-CESD-R). Methods : Forty-eight patients diagnosed as major depressive disorder, dysthymia, depressive disorder NOS according to the DSM-IV criteria using Mini International Neuropsychiatric Interview and 48 healthy controls were enrolled in this study. They were assessed with K-CESD-R, K-MADRS, PHQ-9, KQIDS-SR, STAI to check cross-validation. Statistical analyses were performed using calculation of Cronbach's alpha, Pearson correlation coefficient, Principal Component Analysis, ROC curve and optimal cut-off value. Results : The Cronbach's alpha of K-CESD-R was 0.98. The total score of K-CESD-R revealed significantly high correlations with those of K-MADRS, PHQ-9, KQIDS-SR(r=0.910, 0.966 and 0.920, p<0.001, respectively). Factor analysis showed two factors account for 76.29% of total variance. We suggested the optimal cut-off value of K-CESD-R as 13 according to analysis of the ROC curve which value sensitivity and specificity both equally. Conclusions : These Results showed that the K-CESD-R could be a reliable and valid scale to assess depressive symptoms. The K-CESD-R is expected as a useful and effective tool for screening and measuring depressive symptoms not only in outpatient clinic but also epidemiologic studies.

Quantitative Evaluation of Liver Fibrosis on T1 Relaxometry in Comparison with Fibroscan (Fibroscan과 비교를 통한 T1 MR Relaxometry를 이용한 간섬유화의 정량적 평가)

  • Byeong Hak Sim;Suk Hee Heo;Sang Soo Shin;Seong Beom Cho;Yong Yeon Jeong
    • Journal of the Korean Society of Radiology
    • /
    • v.81 no.2
    • /
    • pp.365-378
    • /
    • 2020
  • Purpose This study was performed to determine whether the T1 relaxation time of gadoxetic acid-enhanced liver MR imaging is useful for detecting and staging liver fibrosis in patients with chronic liver disease. Materials and Methods One hundred and three patients with suspected focal liver lesion underwent MR imaging and Fibroscan. Fibroscan was chosen as the reference standard for classifying liver fibrosis. T1 relaxation times were acquired before (preT1), 20 minutes after (postT1) contrast administration, and reduction rate of T1 relaxation time (rrT1) on transverse 3D VIBE (volumetric interpolated breath-hold examination) sequence using 3T MR imaging. The optimal cut-off values for the fibrosis staging were determined with ROC analysis. Results PreT1 and postT1 increased and rrT1 decreased constantly with increasing severity of liver fibrosis according to the METAVIR score (F0-F4). There were statistically significant differences between F2 and F3 in preT1 (F2, 836.0 ± 74.7 ms; F3, 888.6 ± 77.5 ms, p < 0.05) and between F3 and F4 in postT1 (F3, 309.0 ± 80.2 ms; F4, 406.6 ± 147.7 ms, p < 0.05) and rrT1 (F3, 65.4 ± 7.7%; F4, 57.3 ± 11.4%, p < 0.05). ROC analysis revealed that combination test (preT1 + postT1) was the best test for predicting liver fibrosis. Conclusion PreT1 and postT1 increased constantly with increasing severity of liver fibrosis. T1 mapping in gadoxetic acid-enhanced liver MR imaging could be a helpful complementary sequence to determine the liver fibrosis stage.

Assessment of Two Clinical Prediction Models for a Pulmonary Embolism in Patients with a Suspected Pulmonary Embolism (폐색전증이 의심된 환자에서 두 가지 폐색전증 진단 예측 모형의 평가)

  • Park, Jae Seok;Choi, Won-Il;Min, Bo Ram;Park, Jie Hae;Chae, Jin Nyeong;Jeon, Young June;Yu, Ho Jung;Kim, Ji-Young;Kim, Gyoung-Ju;Ko, Sung-Min
    • Tuberculosis and Respiratory Diseases
    • /
    • v.64 no.4
    • /
    • pp.266-271
    • /
    • 2008
  • Background: Estimation of the probability of a patient having an acute pulmonary embolism (PE) for patients with a suspected PE are well established in North America and Europe. However, an assessment of the prediction rules for a PE has not been clearly defined in Korea. The aim of this study is to assess the prediction rules for patients with a suspected PE in Korea. Methods: We performed a retrospective study of 210 inpatients or patients that visited the emergency ward with a suspected PE where computed tomography pulmonary angiography was performed at a single institution between January 2005 and March 2007. Simplified Wells rules and revised Geneva rules were used to estimate the clinical probability of a PE based on information from medical records. Results: Of the 210 patients with a suspected PE, 49 (19.5%) patients had an actual diagnosis of a PE. The proportion of patients classified by Wells rules and the Geneva rules had a low probability of 1% and 21%, an intermediate probability of 62.5% and 76.2%, and a high probability of 33.8% and 2.8%, respectively. The prevalence of PE patients with a low, intermediate and high probability categorized by the Wells rules and Geneva rules was 100% and 4.5% in the low range, 18.2% and 22.5% in the intermediate range, and 19.7% and 50% in the high range, respectively. Receiver operating characteristic curve analysis showed that the revised Geneva rules had a higher accuracy than the Wells rules in terms of detecting PE. Concordance between the two prediction rules was poor ($\kappa$ coefficient=0.06). Conclusion: In the present study, the two prediction rules had a different predictive accuracy for pulmonary embolisms. Applying the revised Geneva rules to inpatients and emergency ward patients suspected of having PE may allow a more effective diagnostic process than the use of the Wells rules.

Influence of Gating and Attenuation-correction for Diagnostic Performance of Usual Rest/stress Myocardial Perfusion SPECT in Coronary Artery Disease (게이트 방법과 감쇠보정이 심근 관류 SPECT의 관상동맥질환 진단 성능에 미치는 영향)

  • Lee, Dong-Soo;Yeo, Jeong-Seok;So, Young;Cheon, Gi-Jeong;Kim, Kyeong-Min;Chung, June-Key;Lee, Myung-Chul
    • The Korean Journal of Nuclear Medicine
    • /
    • v.33 no.2
    • /
    • pp.131-142
    • /
    • 1999
  • Purpose: Either gated myocardial perfusion SPECT or attenuation corrected SPECT can be used to improve specificity in the diagnosis of coronary artery disease. We investigated in this study whether gating or attenuation correction improved diagnostic performance of rest/stress perfusion SPECT in patients having intermediate pre-test likelihood of coronary artery disease. Materials and Methods: Sixty-eight patients underwent rest attenuation-corrected T1-20l/dipyridamole stress gated attenuation-corrected Tc-99m -MIBI SPECT using an ADAC vertex camera (M:F=29:39, aged $59{\pm}12$ years, coronary artery stenosis ${\geq}70%$, one vessel: 13, two vessel: 18, three vessel: 8, normal: 29). Using a five-point scale, three physicians graded the post-test likelihood of coronary artery disease for each arterial territory (1:normal, 2: possibly normal, 3:equivocal, 4. possibly abnormal, 5: abnormal). Sensitivity, specificity and area under receiver-operating-characteristic curves were compared for each operator between three methods : (A) non-attenuation-corrected SPECT; (B) gated SPECT added to (A): and (C) attenuation-corrected SPECT added to (B). Results: When grade 3 was used as the criteria for coronary artery disease, no differences in sensitivity and specificity were found between the three methods for each operator. Areas under receiver-operating-characteristic curves for diagnosis of coronary artery disease revealed no differences between each modality (p>0.05). Conclusion: In patients at intermediate risk of coronary artery disease, gated SPECT and attenuation- corrected SPECT did not improve diagnostic performance.

  • PDF

Diagnostic Value of Cyfra 21-1 in Differential Diagnosis of Pleural Effusion (흉수의 감별 전단으로 Cyfra 21-1의 진단적 가치)

  • Lee, Hak-Jun;Lee, Kwan-Ho;Shin, Kyeong-Cheol;Shin, Chang-Jin;Park, Hye-Jung;Mun, Yeung-Chul;Lee, Kyung-Hee;Chung, Jin-Hong;Hyun, Myung-Soo;Lee, Hyun-Woo
    • Tuberculosis and Respiratory Diseases
    • /
    • v.47 no.1
    • /
    • pp.50-56
    • /
    • 1999
  • Background : Pleural effusion is a common clinical problem and many clinical and laboratory evaluations, such as tumor marks, have been studied to discriminate malignant pleural fluid from benign pleural fluid. However their usefulness in the diagnosis of pleural effusion is still not established fully. We studied the diagnostic value of cyfra 21-1 in diagnosis of malignant pleural effusion. Methods: Pleural fluid was obtained from 45 patients with malignant diseases(32 lung cancer patients, 13 metastatic malignant diseases) and 47 patients with benign diseases. The level of cyfra 21-1 in the pleural fluid and serum were determined using a CYFRA 21-1 enzyme immunoassay kit(Cis-Bio International Co.). The t-test was used for comparison between two diseases groups and receiver operating characteristic(ROC) curves were constructed by calculating the sensitivities and specificities of the cyfra 21-1 at several points to determine the diagnostic accuracy of the cyfra 21-1. Results: In patients with primary lung cancer, the level of cyfra 21-1 in the pleural fluid was significantly higher than those of patients with benign diseases and had positive correlations between the level of cyfra 21-1 in the pleural fluid and serum levels. In the ROC curve analysis of the pleural fluid, the curve for primary lung cancer group was located closer to the left upper comer and the cut off value, sensitivity and specificity of the cyfra 21-1 of the primary lung cancer group was determined as 22.25ng/ml, 81.8% and 78.7% respectively. Conclusions: Our data indicates that the measurement of cyfra 21-1 level in pleural effusion has useful diagnostic value to discriminate malignant pleural effusion in primary lung cancer from benign pleural effusion.

  • PDF