• Communications for Statistical Applications and Methods
• /
• v.16 no.6
• /
• pp.1005-1012
• /
• 2009

The area under the curve(AUC) is commonly used as a measure of the receiver operating characteristic(ROC) curve which displays the performance of a set of binary classifiers for all feasible ratios of the costs associated with true positive rate(TPR) and false positive rate(FPR). In the bipartite ranking problem where one has to compare two different observations and decide which one is "better", the AUC measures the quantity that ranking score of a randomly chosen sample in one class is larger than that of a randomly chosen sample in the other class and hence, the function which maximizes an AUC of bipartite ranking problem is different to the function which maximizes (minimizes) accuracy (misclassification error rate) of binary classification problem. In this paper, we develop a way to construct the unified framework for AUC maximizer including support vector machines based on maximizing large margin and logistic regression based on estimating posterior probability. Moreover, we develop an efficient algorithm for the proposed unified framework. Numerical results show that the propose unified framework can treat various methodologies successfully.

• Bulletin of the Korean Chemical Society
• /
• v.35 no.4
• /
• pp.1133-1138
• /
• 2014

Ultrahigh performance liquid chromatography-electrospray ionization-tandem mass spectrometry (UPLC-ESI- MS/MS) provides a high-speed method to screen a large number of samples for small molecules with specific properties. In this study, UPLC-ESI-MS/MS with multiple reaction monitoring (MRM) was employed to screen urinary phospholipid (PL) content for biomarkers of prostate cancer. From lists of urinary PLs structurally identified using nanoflow LC-ESI-MS/MS, 52 PL species were selected for quantitative analysis in urine samples between 22 cancer-free urologic patients as controls and 45 prostate cancer patients. Statistical treatment of data by receiver operating characteristic (ROC) analysis yielded 14 PL species that differed significantly in relative concentrations (area under curve (AUC) > 0.8) between the two groups. Among PLs present at higher levels in prostate cancer urine, phosphatidylcholines (PCs) and phosphatidylinositols (PIs) constituted the major head group PLs (3 PCs and 7 PIs). For technical reasons, PL species of low abundance may be underrepresented in data from UPLC-ESI-MS/MS performed in MRM mode. However, the proposed method enables the rapid screening of large numbers of plasma or urine samples in the search for biomarkers of human disease.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2003.05a
• /
• pp.595-598
• /
• 2003

본 논문에서는 방사선투영영상을 기존 압축방법인 JPEG 압축과 새로운 표준으로 채택중인 JPEG2000을 적용하여 압축율 및 영상의 품질을 비교 실험하였다. 기존의 의료영상압축 표준의 하나인 JPEG 압축은 압축비율이 높아짐에 따라 블륵킹 현상의 발생으로 원 영상이 회손되는 압축의 한계를 인식하고 있다. 따라서 원 영상의 보호와 압축율 증가의 두 가지 면을 만족시키기 위해 Wavelet 을 사용하는 JPEG2000을 실험 평가하여 의료영상압축에 적용하고자 한다. 실험대상으로 환자 10명 정상인 10명의 투영영상을 사용하였으며, 영상의 품질, 손상도 등을 평가하기 위해 PSNR( Peak Signal to Noise Ratio )과 판독의에 의한 ROC( Receiver Operating Characteristic )분석을 실행하였다. 실험결과, 영상의 품질, 손상도를 평가하기 위한 PSNR 은 15:1 압축에서 $46.05{\pm}1.1dB$의 값을 얻었으며, JPEG의 같은 압축비율에 비해 $1.78{\pm}0.1dB$의 값이 높음을 알 수 있었다. 종합적으로 3명의 판독의에 의해 ROC 분석을 실행한 결과 15:1의 압축비율에서 압축비율과 품질을 종합하였을 때 진단에 적합한 최적 압축비율임을 보였다.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• v.30 no.1
• /
• pp.9-16
• /
• 2019

Objectives: The purpose of this study was to analyze the discriminant validity and the clinical cut off scores of the Child Behavior Checklist 1.5-5 (CBCL 1.5-5) in the diagnosis of autism spectrum disorder (ASD) and non-ASD. Methods: In total, 104 ASD and 441 non-ASD infants were included in the study. T-test, discriminant analysis, receiver operating characteristic (ROC) curve analysis, and odds ratio analysis were performed on the data. Results: The discriminant validity was confirmed by mean differences and discriminant analysis on the subscales of Emotionally reactive, Somatic complaints, Withdrawn, Sleep problems, Attention problems, Aggressive behavior, Internalizing problems, Externalizing problems, and Total problems, along with the Diagnostic and Statistical Manual of Mental Disorders (DSM)-oriented scales between the two groups. ROC analysis showed that the following subscales significantly separated ASD from normal infants: Emotionally reactive, Somatic complaints, Withdrawn, Sleep problems, Attention problems, Aggressive behavior, Internalizing problems, Externalizing problems, Total problems, and DSM pervasive developmental problems. Moreover, the clinical cut off score criteria adopted in the Korean-CBCL 1.5-5 were shown to be valid for the subscales Withdrawn, Internalizing problems, Externalizing problems, Total problems, and DSM pervasive developmental problems. Conclusion: The subscales of Withdrawn, Internalizing problems, Externalizing problems, Total problems, and DSM pervasive developmental problems significantly discriminated infants with ASD.

• Psychiatry investigation
• /
• v.15 no.11
• /
• pp.1037-1045
• /
• 2018

Objective The present study aimed to identify risk factors for future SI and to predict individual-level risk for future or persistent SI among college students. Methods Mental health check-up data collected over 3 years were retrospectively analyzed. Students were categorized as suicidal ideators and non-ideators at baseline. Logistic regression analyses were performed separately for each group, and the predicted probability for each student was calculated. Results Students likely to exhibit future SI had higher levels of mental health problems, including depression and anxiety, and significant risk factors for future SI included depression, current SI, social phobia, alcohol problems, being female, low self-esteem, and number of close relationships and concerns. Logistic regression models that included current suicide ideators revealed acceptable area under the curve (AUC) values (0.7-0.8) in both the receiver operating characteristic (ROC) and precision recall (PR) curves for predicting future SI. Predictive models with current suicide non-ideators revealed an acceptable level of AUCs only for ROC curves. Conclusion Several factors such as low self-esteem and a focus on short-term rather than long-term outcomes may enhance the prediction of future SI. Because a certain range of SI clearly necessitates clinical attention, further studies differentiating significant from other types of SI are necessary.

• Clinical and Experimental Reproductive Medicine
• /
• v.48 no.2
• /
• pp.156-162
• /
• 2021

Objective: The aim of the present study was to evaluate the predictive capability of fasting-state measurements of glucose and insulin levels alone for abnormal glucose tolerance in women with polycystic ovary syndrome (PCOS). Methods: In total, 153 Korean women with PCOS were included in this study. The correlations between the 2-hour postload glucose (2-hr PG) level during the 75-g oral glucose tolerance test (OGTT) and other parameters were evaluated using Pearson correlation coefficients and linear regression analysis. The predictive accuracy of fasting glucose and insulin levels and other fasting-state indices for assessing insulin sensitivity derived from glucose and insulin levels for abnormal glucose tolerance was evaluated using receiver operating characteristic (ROC) curve analysis. Results: Significant correlations were observed between the 2-hr PG level and most fasting-state parameters in women with PCOS. However, the area under the ROC curve values for each fasting-state parameter for predicting abnormal glucose tolerance were all between 0.5 and 0.7 in the study participants, which falls into the "less accurate" category for prediction. Conclusion: Fasting-state measurements of glucose and insulin alone are not enough to predict abnormal glucose tolerance in women with PCOS. A standard OGTT is needed to screen for impaired glucose tolerance and type 2 diabetes mellitus in women with PCOS.

• Proceedings of the Korean Society for Bioinformatics Conference
• /
• 2004.11a
• /
• pp.272-278
• /
• 2004

Recently, Pepe et al. (2003) employed the receiver operating characteristic (ROC) approach to rank candidate genes from a microarray experiment that can be used for the biomarker development with the ultimate purpose of the population screening of a cancer, In the cancer microarray experiment based on n patients the researcher often wants to compare the tumor tissue with the normal tissue within the same individual using a common reference RNA. This design is referred to as a reference design or an indirect design. Ideally, this experiment produces n pairs of microarray data, where each pair consists of two sets of microarray data resulting from reference versus normal tissue and reference versus tumor tissue hybridizations. However, for certain individuals either normal tissue or tumor tissue is not large enough for the experimenter to extract enough RNA for conducting the microarray experiment, hence there are missing values either in the normal or tumor tissue data. Practically, we have $n_1$ pairs of complete observations, $n_2$ 'normal only' and $n_3$ 'tumor only' data for the microarray experiment with n patients, where n=$n_1$+$n_2$+$n_3$. We refer to this data set as a mixed data set, as it contains a mix of fully observed and partially observed pair data. This mixed data set was actually observed in the microarray experiment based on human tissues, where human tissues were obtained during the surgical operations of cancer patients. Pepe et al. (2003) provide the rationale of using ROC approach based on two independent samples for ranking candidate gene instead of using t or Mann -Whitney statistics. We first modify ROC approach of ranking genes to a paired data set and further extend it to a mixed data set by taking a weighted average of two ROC values obtained by the paired data set and two independent data sets.

• Safety and Health at Work
• /
• v.3 no.4
• /
• pp.287-293
• /
• 2012

Objectives: Metabolic syndrome has received attention as a risk factor for cardiovascular disease, with particular importance attached to visceral fat accumulation, which is associated with lifestyle-related diseases and is strongly correlated with waist circumference. In this study, our aim is to propose waist circumference cut-off values that can be used as a marker for fatty liver based on a sample of workers receiving health checkups in Japan. Methods: This study was conducted in a total of 21,866 workers who underwent periodic health checkups between January 2007 and December 2007. The mean age of the subjects was 47.4 years for men (standard deviation [SD]: 8.0) and 44.7 years for women (SD: 6.9). Evaluation included abdominal ultrasound and measurement of waist circumference, body mass index, fasting blood glucose, triglycerides, high-density lipoprotein cholesterol, and blood pressure. Results: Based on receiver operating characteristic curve analysis, the optimal waist circumference cut-off values were shown as 85.0 cm (sensitivity 0.72, specificity 0.69) for men and 80.0 cm (sensitivity 0.75, specificity 0.78) for women. Conclusion: Abdominal ultrasound is the most efficient means of diagnosing fatty liver, but this examination seldom occurs because the test is not routinely performed at workers' health checkups. In people found to have a high risk of fatty liver, recommendations can be made for abdominal ultrasound based on the waist circumference cut-off values obtained in this study. That is, waist circumference can be used in high risk individuals as an effective marker for early detection of fatty liver.

• Safety and Health at Work
• /
• v.1 no.1
• /
• pp.69-79
• /
• 2010

Objectives: Various cytokines induced by inhalation of coal dust may mediate inflammation and lead to tissue damage or fibrosis, such as coal workers' pneumoconiosis (CWP). Methods: To investigate the relevance of serum cytokines in CWP, the levels of serum interleukin-8 (IL-8) and tumor necrosis factor-alpha (TNF-${\alpha}$) as CWP biomarkers in 110 retired coal miners (22 controls and 88 CWP subjects) were related to cross sectional findings and 1-year progressive changes of the pneumoconiosis. Progressive changes of CWP were evaluated by paired comparison of chest radiographs. Analysis by a receiver operating characteristic curve assessed the biomarker potential of each cytokine. Results: The mean serum IL-8 level was significantly higher in CWP compared to controls and IL-8 levels correlated with the degree of CWP. The median serum TNF-${\alpha}$ level was significantly higher in subjects with progressive CWP compared to subjects without CWP progression. The area under the ROC curve for IL-8 (0.70) and TNF-${\alpha}$ (0.72) for CWP identification and progression, respectively, indicated the biomarker potential of the two cytokines. Serum cutoff values of IL-8 and TNF-${\alpha}$ were 11.63 pg/mL(sensitivity, 69%; specificity, 64%) and 4.52 pg/mL (sensitivity, 67%; specificity, 79%), respectively. Conclusion: The results suggest that high levels of serum IL-8 are associated with the presence of CWP and those of serum TNF-${\alpha}$ are associated with the progression of CWP.

• Journal of The Korean Society of Integrative Medicine
• /
• v.10 no.3
• /
• pp.107-117
• /
• 2022

Purpose : The purpose of this study was to establish a model of the predictive factors for success or failure of examinees undertaking the Korean physical therapist licensing examination (KPTLE). Additionally, we assessed the pass/fail cut-off point. Methods : We analyzed the results of 10,881 examinees who undertook the KPTLE, using data provided by the Korea Health Personnel Licensing Examination Institute. The target variable was the test result (pass or fail), and the input variables were: sex, age, test subject, and total score. Frequency analysis, chi-square test, descriptive statistics, independent t-test, correlation analysis, binary logistic regression, and receiver operating characteristic (ROC) curve analyses were performed on the data. Results : Sex and age were not significant predictors of attaining a pass (p>.05). The test subjects with the highest probability of passing were, in order, medical regulation (MR) (Odds ratio (OR)=2.91, p<.001), foundations of physical therapy (FPT) (OR=2.86, p<.001), diagnosis and evaluation for physical therapy (DEPT) (OR=2.74, p<.001), physical therapy intervention (PTI) (OR=2.66, p<.001), and practical examination (PE) (OR=1.24, p<.001). The cut-off points for each subject were: FPT, 32.50; DEPT, 29.50; PTI, 44.50; MR, 14.50; and PE, 50.50. The total score (TS) was 164.50. The sensitivity, specificity, and the classification accuracy of the prediction model was 99 %, 98 %, and 99 %, respectively, indicating high accuracy. Area under the curve (AUC) values for each subject were: FPT, .958; DEPT, .968; PTI, .984; MR, .885; PE, .962; and TS, .998, indicating a high degree of fit. Conclusion : In our study, the predictive factors for passing KPTLE were identified, and the optimal cut-off point was calculated for each subject. Logistic regression was adequate to explain the predictive model. These results will provide universities and examinees with useful information for predicting their success or failure in the KPTLE.