• Communications for Statistical Applications and Methods
• /
• v.31 no.4
• /
• pp.365-375
• /
• 2024

Diverse methods to evaluate the prediction model of a time to event have been proposed in the context of right censored data where all subjects are subject to be susceptible. A time-dependent AUC (area under curve) measures the predictive ability of a marker based on case group and control one which are varying over time. When a substantial portion of subjects are event-free, a population consists of a susceptible group and a cured one. An uncertain curability of censored subjects makes it difficult to define both case group and control one. In this paper, our goal is to propose a time-dependent AUC for a cure rate model when a censoring distribution is related with covariates. A class of inverse probability of censoring weighted (IPCW) AUC estimators is proposed to adjust the possible sampling bias. We evaluate the finite sample performance of the suggested methods with diverse simulation schemes and the application to the melanoma dataset is presented to compare with other methods.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2019.05a
• /
• pp.367-367
• /
• 2019

최근 기후변화로 인해 국지성 호우 및 태풍의 빈도가 빈발하고 및 규모가 커지고 있으며 그로 인한 홍수피해규모는 증가하고 있다. 본 논문에서는 도시 지역의 호우로 인한 침수유발 강우량을 산정하는 기법의 정확도를 산정하는데 목적이 있으며 이를 위해 ROC(Receiver Operation Characteristic Curve) 분석을 이용하였다. 본 논문에서는 분포형 홍수해석 모형인 S-RAT 모형과 2차원 침수해석 모형 FLO-2D을 커플링하여 호우로 인한 침수해석을 실시하였으며 강우시나리오는 설계 강우 200mm의 강우를 10% 간격으로 증가시켜 강우량 대비 침수심 자료를 모의하였다. 모의한 침수심 자료를 이용하여 유역 격자를 $1km{\times}1km$ 별 강우량-침수심 관계곡선식을 제시하였으며 개발된 곡선식을 이용하여 특정 침수심(20cm)을 유발시키는 강우량(한계강우량)을 산정하였다. 정확도 산정은 ROC(Receiver Operation Characteristic Curve) 분석 방법을 이용하여 침수 유무의 적중률에 따른 민감도와 특이도를 이용하여 AUC(Area Under the Curve)의 점수로 정확도를 판단하였다. 본 논문에서는 본 논문에서 제시한 한계강우량의 정확도를 판단하기 위하여 2011년 7월의 사당역 일대 침수사례를 이용하였다. 실제 침수정보가 없어 실제 호우사상과 실제 하수관망을 고려할 수 있는 SWMM 모형을 이용하여 침수분석을 실시하였다. 분석 결과 평균 ROC는 약 0.7로 나타났으며 5 단계의 구분에서 Fair 단계로 적정 수준의 정확도를 확보한 것으로 나타났다.

• International Journal of Highway Engineering
• /
• v.20 no.2
• /
• pp.35-44
• /
• 2018

PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

• Journal of the Korean Society of Radiology
• /
• v.12 no.5
• /
• pp.677-682
• /
• 2018

This study evaluated the usefulness of the elasticity score and elasticity ratio in the differential diagnosis of benign and malignant lesion in breast elastography. We performed a retrospective analysis based on the results of core needle biopsy histology. The Mann-Whitney U test was used to confirm the difference between the 5-degree elasticity score and the Fisher's Exact test. ROC curve analysis was used to determine the elasticity score and the best cut-off value of the elasticity ratio for the prediction of malignant lesions. There was a statistically significant difference (p= .000) between the homogeneity of the elasticity score and the difference of the elasticity ratio between the benign and malignant lesion groups. On the ROC curve analysis, the elasticity score and the elasticity ratio for predicting benign and malignant lesion were determined as AUC 0.806, 0.824, cut-off value 3, 4.4 (p= .001). Therefore, the elasticity score and elasticity ratio may be useful in the differential diagnosis of breast mass.

• The Journal of the Korea Contents Association
• /
• v.16 no.2
• /
• pp.666-672
• /
• 2016

We extracted 50 LVH patients out of 30'~80's who performing ECG and echocardiography examination. We used Devereux's theory to examinate LVH with echocardiography and used Sokolow-Lyon's theory to examinate LVH with ECG. We used regression and correlation analysis by SPSS, used ROC curve analysis to decide predominance of two ways of .Age, BMI, SBP and DBP whice are the danger factors of LVH and standard value of LVH diagnosis examination seems correlated. Out of 50 LVH patients, 50 patients were diagnosed LVH by echcardiography examination and only 21 patients were diagnosed LVH by ECG examination. Also echocardiography was AUC 99%, sensitivity 96%, singularity 95%, accuracy 95.5%. And ECG was AUC 76%, sensitivity 62%, singularity 76%, accuracy 68%.By comparing accuracy between echocardiography and ECG in diagnosing LVH, we could tell echocardiography was examination with higher accuracy. Therefore, if one was diagnosed with summit on 1st examination with ECG, considering age, body mass index, systolic blood pressure and dilator blood pressure, should offer echocardiography examination.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.3
• /
• pp.107-114
• /
• 2022

In this paper, we have enhanced the risk prediction of hypertension using the feature selection method in the Korean National Health and Nutrition Examination Survey (KNHANES) database of the Korea Centers for Disease Control and Prevention. The study identified various risk factors correlated with chronic hypertension. The paper is divided into three parts. Initially, the data preprocessing step of removes missing values, and performed z-transformation. The following is the feature selection (FS) step that used a factor analysis (FA) based on the feature selection method in the dataset, and feature importance (FI) and multicollinearity analysis (MC) were compared based on FS. Finally, in the predictive analysis stage, it was applied to detect and predict the risk of hypertension. In this study, we compare the accuracy, f-score, area under the ROC curve (AUC), and mean standard error (MSE) for each model of classification. As a result of the test, the proposed MC-FA-RF model achieved the highest accuracy of 80.12%, MSE of 0.106, f-score of 83.49%, and AUC of 85.96%, respectively. These results demonstrate that the proposed MC-FA-RF method for hypertension risk predictions is outperformed other methods.

• International journal of advanced smart convergence
• /
• v.13 no.3
• /
• pp.80-88
• /
• 2024

Breast cancer remains a significant global health burden, necessitating accurate and timely detection for improved patient outcomes. Machine learning techniques have demonstrated remarkable potential in assisting breast cancer diagnosis by learning complex patterns from multi-modal patient data. This study comprehensively evaluates several popular machine learning models, including logistic regression, decision trees, random forests, support vector machines (SVMs), naive Bayes, k-nearest neighbors (KNN), XGBoost, and ensemble methods for breast cancer prediction using the Wisconsin Breast Cancer Dataset (WBCD). Through rigorous benchmarking across metrics like accuracy, precision, recall, F1-score, and area under the ROC curve (AUC), we identify the naive Bayes classifier as the top-performing model, achieving an accuracy of 0.974, F1-score of 0.979, and highest AUC of 0.988. Other strong performers include logistic regression, random forests, and XGBoost, with AUC values exceeding 0.95. Our findings showcase the significant potential of machine learning, particularly the robust naive Bayes algorithm, to provide highly accurate and reliable breast cancer screening from fine needle aspirate (FNA) samples, ultimately enabling earlier intervention and optimized treatment strategies.

• Journal of Korean Academy of Nursing
• /
• v.33 no.2
• /
• pp.162-169
• /
• 2003

Purpose: This study was to compare the predictive validity of Norton Scale(1962), Cubbin & Jackson Scale(1991), and Song & Choi Scale(1991). Method: Data were collected three times per week from 48~72hours after admission based on the four pressure sore risk assessment scales and a skin assessment tool for pressure sore on 112 intensive care unit(ICU) patients in a educational hospital Ulsan during Dec, 11, 2000 to Feb, 10, 2001. Four indices of validity and area under the curve(AUC) of receiver operating characteristic(ROC) were calculated. Result: Based on the cut off point presented by the developer, sensitivity, specificity, positive predictive value, negative predictive value were as follows : Norton Scale : 97%, 18%, 35%, 93% respectively; Cubbin & Jackson Scale : 89%, 61%, 51%, 92%, respectively; and Song & Choi Scale : 100%, 18%, 36%, 100% respectively. Area under the curves(AUC) of receiver operating characteristic(ROC) were Norton Scale .737, Cubbin & Jackson Scale .826, Song & Choi Scale .683. Conclusion: The Cubbin & Jackson Scale was found to be the most valid pressure sore risk assessment tool. Further studies on patients with chronic conditions may be helpful to validate this finding.

• Journal of Korean Critical Care Nursing
• /
• v.8 no.1
• /
• pp.71-79
• /
• 2015

Purpose: The purpose of this study was to compare the applicability of the Charlson Comorbidity Index (CCI) and Acute Physiology, Age, Chronic Health Evaluation III (APACHE III) to the prediction of the healthcare outcomes of intensive care unit (ICU) patients. Methods: This research was performed with 136 adult patients (age>18 years) who were admitted to the ICU between May and June 2012. Data were measured using the CCI score with a comorbidity index of 19 and the APACHE III score on the standard of the worst result with vital signs and laboratory results. Discrimination was evaluated using receiver operating characteristic (ROC) curves and area under an ROC curve (AUC). Calibration was performed using logistic regression. Results: The overall mortality was 25.7%. The mean CCI and APACHE III scores for survivors were found to be significantly lower than those of non-survivors. The AUC was 0.835 for the APACHE III score and remained high, at 0.688, for the CCI score. The rate of concordance according to the CCI and the APACHE III score was 69.1%. Conclusion: The route of admission, days in ICU, CCI, and APACHE III score are associated with an increased mortality risk in ICU patients.

• Journal of Korean Academy of Nursing
• /
• v.46 no.1
• /
• pp.59-68
• /
• 2016

Purpose: Increase in suicide rate for senior citizens which has become widespread in our society today. It is not a normal social phenomenon and is beyond the danger level. The contents of this study include Korean senior citizens' suicide related risk factors and warning signs, and the development of a simple Geriatric Suicide Risk Scale. Methods: This study is Methodological Research to verify reliability and validity of the Geriatric Suicide Risk Scale according to the tool development process suggested by Devellis (2012). Results: For predictive validity assessment, high suicide screening accuracy was showed with an Area under the ROC curve (AUC) of .93. For the optimal cutoff point of 11, sensitivity was 93.9%, and specificity, 75.7% which are excellence levels. Cross validity for assessment of generalization possibility showed the Area under the ROC curve (AUC) as .82 and in case of a cutoff point of 11, sensitivity was 73.7%, and specificity, 65.9%. Conclusion: When it comes to practical nursing, it is significant that the Korean Geriatric Suicide Risk Scale has high reliability and validity through adequate tool development and the tool assessment step to select degree of suicide risk of senior citizens. Also, it can be easily applied and does not take a long time to administer. Further, it can be used by health care personnel or the general public.