• Title/Summary/Keyword: ROC AUC

Search Result 292, Processing Time 0.022 seconds

Neck Circumference Criteria for Identifying Overweight and Obesity Patients in Korean Adults Aged 40 or Older (40세 이상의 한국 성인에서 과체중 및 비만환자 선별을 위한 목둘레 기준)

  • Eun-Sil Her
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.27 no.4_2
    • /
    • pp.877-883
    • /
    • 2024
  • This study targeted 15,580 Korean adults aged 40 or older from the 2019-2022 KNHA-NES and aimed to confirm neck circumference criteria for identifying overweight and obesity according to BMI standards using the reportROC package. Pearson's correlation coefficients indicated a strong positive association between neck circumference and BMI in both male (r=0.802, p<0.001) and female (r=0.762, p<0.001). The ROC analysis results to determine the neck circumference cutoff levels for overweight according to BMI (≥23.0 kg/m2 ) were 37.1 cm (AUC=0.890, accuracy=0.808) for male and 32.5 cm for female (AUC=0.863, accuracy=0.776). Neck circumference 37.8 cm (AUC=0.879, accuracy=0.784) for male and 33.1 cm (AUC=0.873, accuracy=0.786) for female were the best cutoff levels for determining the subjects with obesity by BMI (≥25.0 kg/m2 ). This study proposed a cutoff levels for neck circumference that can be used in screening tests to determine overweight and obesity, and for clinical use, additional research is needed to exclude factors affecting neck circumference.

L1-penalized AUC-optimization with a surrogate loss

  • Hyungwoo Kim;Seung Jun Shin
    • Communications for Statistical Applications and Methods
    • /
    • v.31 no.2
    • /
    • pp.203-212
    • /
    • 2024
  • The area under the ROC curve (AUC) is one of the most common criteria used to measure the overall performance of binary classifiers for a wide range of machine learning problems. In this article, we propose a L1-penalized AUC-optimization classifier that directly maximizes the AUC for high-dimensional data. Toward this, we employ the AUC-consistent surrogate loss function and combine the L1-norm penalty which enables us to estimate coefficients and select informative variables simultaneously. In addition, we develop an efficient optimization algorithm by adopting k-means clustering and proximal gradient descent which enjoys computational advantages to obtain solutions for the proposed method. Numerical simulation studies demonstrate that the proposed method shows promising performance in terms of prediction accuracy, variable selectivity, and computational costs.

Differential Diagnosis of Benign and Malignant Thyroid Nodules Using the K-TIRADS Scoring System in Thyroid Ultrasound (갑상샘 초음파 검사에서 K-TIRADS 점수화 체계를 사용한 양성과 악성 갑상샘 결절의 감별진단)

  • An, Hyun;Im, In Cheol;Lee, Hyo-Yeong
    • Journal of the Korean Society of Radiology
    • /
    • v.13 no.2
    • /
    • pp.201-207
    • /
    • 2019
  • This study has evaluated whether the method of using the combination of different risk group, according to K-TIRADS classification and K-TIRADS classification in thyroid ultrasonography is useful in a differential diagnosis of benign and malignant nodules. The subject was patients underwent thyroid ultrasonography and retrospective analysis were performed based on the results of fine needle aspiration cytology. A chi-square test was performed for the difference analysis of the score system in K-TIRADS and different risk group according to the benign and malignant of thyroid nodule. The optimized cut off value was determined by the K-TIRADS score and different risk group to predict malignant nodule through ROC curve analysis. In the differential verification result of K-TIRADS and different risk group, according to the classification of benign and malignant nodule group each showed significant difference statistically(p=.001). In the point classification according to K-TIRADS for the prediction of benign and malignant in ROC curve analysis showed AUC 0.786, Cut-off value>2(p=.001), and in the different risk group, it was decided as AUC 0.640, Cut-off value>2(p=.001). When discovering the nodule in thyroid ultrasound, it is considered that the K-TIRADAS which helps in identifying benign and malignant thyroid nodules, it is considered to be helpful in the differential diagnosis of thyroid nodules, than the classification system according to Different risk group, and when applying the classification system according to K-TIRADS, it is considered that it can reduce unnecessary fine needle aspiration cytology and could be helpful in finding the malignant nodules early.

Evaluating the Validity of the Pediatric Index of Mortality Ⅱ in the Intensive Care Units (소아중환자를 대상으로 한 PIM Ⅱ의 타당도 평가)

  • Kim, Jung-Soon;Boo, Sun-Joo
    • Journal of Korean Academy of Nursing
    • /
    • v.35 no.1
    • /
    • pp.47-55
    • /
    • 2005
  • Purpose: This study was to evaluate the validity of the Pediatric Index of Mortality Ⅱ(PIM Ⅱ). Method: The first values on PIM Ⅱ variables following ICU admission were collected from the patient's charts of 548 admissions retrospectively in three ICUs(medical, surgical, and neurosurgical) at P University Hospital and a cardiac ICU at D University Hospital in Busan from January 1, 2002 to December 31, 2003. Data was analyzed with the SPSSWIN 10.0 program for the descriptive statistics, correlation coefficient, standardized mortality ratio(SMR), validity index(sensitivity, specificity, positive predictive value, negative predictive value), and AUC of ROC curve. Result: The mortality rate was 10.9% (60 cases) and the predicted death rate was 9.5%. The correlation coefficient(r) between observed and expected death rates was .929(p<.01) and SMR was 1.15. Se, Sp, pPv, nPv, and the correct classification rate were .80, .96, .70, .98, and 94.0% respectively. In addition, areas under the curve (AUC) of the receiver operating characteristic(ROC) was 0.954 (95% CI=0.919~0.989). According to demographic characteristics, mortality was underestimated in the medical group and overestimated in the surgical group. In addition, the AUCs of ROC curve were generally high in all subgroups. Conclusion: The PIM Ⅱ showed a good, so it can be utilized for the subject hospital. better.

Development of Work-related Musculoskeletal Disorder Questionnaire Using Receiver Operating Characteristic Analysis (Receiver Operating Characteristic 분석법을 이용한 업무관련성 근골격계질환 설문지 개발)

  • Kwon, Ho-Jang;Ju, Yeong-Su;Cho, Soo-Hun;Kang, Dae-Hee;Sung, Joo-Hon;Choi, Seong-Woo;Choi, Jae-Wook;Kim, Jae-Young;Kim, Don-Gyu;Kim, Jai-Yong
    • Journal of Preventive Medicine and Public Health
    • /
    • v.32 no.3
    • /
    • pp.361-373
    • /
    • 1999
  • Objectives: Receive Operating Characteristic(ROC) curve with the area under the ROC curve(AUC) is one of the most popular indicator to evaluate the criterion validity of the measurement tool. This study was conducted to develop a standardized questionnaire to discriminate workers at high-risk of work-related musculoskeletal disorders using ROC analysis. Methods: The diagnostic results determined by rehabilitation medicine specialists in 370 persons(89 shipyard CAD workers, 113 telephone directory assistant operators, 79 women with occupation, and 89 housewives) were compared with participant's own replies to 'the questionnair on the worker's subjective physical symptoms'(Kwon, 1996). The AUC's from four models with different methods in item selection and weighting were compared with each other. These 4 models were applied to 225 persons, working in an assembly line of motor vehicle, for the purpose of AUC reliability test. Results: In a weighted model with 11 items, the AUC was 0.8155 in the primary study population, and 0.8026 in the secondary study population(p=0.3780). It was superior in the aspects of discriminability, reliability and convenience. A new questionnaire of musculoskeletal disorder could be constructed by this model. Conclusion: A more valid questionnaire with a small number of items and the quantitative weight scores useful for the relative comparisons are the main results of this study. While the absolute reference value applicable to the wide range of populations was not estimated, the basic intent of this study, developing a surveillance fool through quantitative validation of the measures, would serve for the systematic disease prevention activities.

  • PDF

A Study on Sasang Constitutional Classification Methods based on ROC-curve using the personality score (성격점수를 이용한 ROC-curve 기반 사상체질 분류 방법에 대한 연구)

  • Kim, Ho-Seok;Jang, Eun-Su;Kim, Sang-Hyuk;Yoo, Jong-Hyang;Lee, Si-Woo
    • Korean Journal of Oriental Medicine
    • /
    • v.17 no.2
    • /
    • pp.107-113
    • /
    • 2011
  • Objectives : Sasang typology is extensively studied for the Sasang constitution diagnosis objectification with various data, for example, questionaires, reference materials, etc and analyzed with the several statistical methods. In this study, we used ROC-curve (Receiver Operating Characteristic curve) analysis to diagnose Sasang constitution, which is a kind of epidemiologic research methods and is away from traditional statistical methods. Methods : We collected personality questionnaire which consists of 15 items, from 24 oriental medical clinics. We analyzed the sensitivity and specificity using ROC curve method based on the score of personality questionnaire and also investigated classification accuracy and cut-off value of Sasang constitution. Results : The AUC (area under the ROC curve) value was 0.508 (p=.5511) for Taeeumin, 0.629 (p<.0001) for Soeumin and 0.604(p<.0001) for Soyangin, respectively. so the classification accuracy for Soeumin was highest Soeumin for over 30 points and Soyangin for below 28 points respectively. Conclusions : We suggest that Taeeumin is not classified easily in the ROC-curve analysis. We may classify Soeumin and Soyangin but the accuracy of Sasang constitutional diagnosis is still low.

Classification Analysis for Unbalanced Data (불균형 자료에 대한 분류분석)

  • Kim, Dongah;Kang, Suyeon;Song, Jongwoo
    • The Korean Journal of Applied Statistics
    • /
    • v.28 no.3
    • /
    • pp.495-509
    • /
    • 2015
  • We study a classification problem of significant differences in the proportion of two groups known as the unbalanced classification problem. It is usually more difficult to classify classes accurately in unbalanced data than balanced data. Most observations are likely to be classified to the bigger group if we apply classification methods to the unbalanced data because it can minimize the misclassification loss. However, this smaller group is misclassified as the larger group problem that can cause a bigger loss in most real applications. We compare several classification methods for the unbalanced data using sampling techniques (up and down sampling). We also check the total loss of different classification methods when the asymmetric loss is applied to simulated and real data. We use the misclassification rate, G-mean, ROC and AUC (area under the curve) for the performance comparison.

Pediatric Dehydration Assessment at Triage: Prospective Study on Refilling Time

  • Caruggi, Samuele;Rossi, Martina;De Giacomo, Costantino;Luini, Chiara;Ruggiero, Nicola;Salvatoni, Alessandro;Salvatore, Silvia
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • v.21 no.4
    • /
    • pp.278-288
    • /
    • 2018
  • Purpose: Dehydration is a paediatric medical emergency but there is no single standard parameter to evaluate it at the emergency department. Our aim was to evaluate the reliability and validity of capillary refilling time as a triage parameter to assess dehydration in children. Methods: This was a prospective pilot cohort study of children who presented to two paediatric emergency departments in Italy, with symptoms of dehydration. Reliability was assessed by comparing the triage nurse's measurements with those obtained by the physician. Validity was demonstrated by using 6 parameters suggestive of dehydration. Comparison between refilling time (RT) and a validated Clinical Dehydration Score (CDS) was also considered. The scale's discriminative ability was evaluated for the outcome of starting intravenous rehydration therapy by using a receiver operating characteristic (ROC) curve. Results: Participants were 242 children. All nurses found easy to elicit the RT after being trained. Interobserver reliability was fair, with a Cohen's kappa of 0.56 (95% confidence interval [CI], 0.41 to 0.70). There was a significant correlation between RT and weight loss percentage (r-squared=-0.27; 95% CI, -0.47 to -0.04). The scale's discriminative ability yielded an area under the ROC curve (AUC) of 0.65 (95% CI, 0.57 to 0.73). We found a similarity between RT AUC and CDS-scale AUC matching the two ROC curves. Conclusion: The study showed that RT represents a fast and handy tool to recognize dehydrated children who need a prompt rehydration and may be introduced in the triage line-up.

Can Computed Tomographic Angiography Be Used to Predict Who Will Not Benefit from Endovascular Treatment in Patients with Acute Ischemic Stroke? The CTA-ABC Score

  • Kwak, Hyo-Sung;Park, Jung-Soo
    • Journal of Korean Neurosurgical Society
    • /
    • v.63 no.4
    • /
    • pp.470-476
    • /
    • 2020
  • Objective : The objective of this study was to develop a score to predict patients with acute ischemic stroke (AIS) who will not benefit from endovascular treatment (EVT) using computed tomographic angiography (CTA) parameters. Methods : The CTA-ABC score was developed from 3 scales previously described in the literature: the Alberta Stroke Program Early CT Score (0-5 points, 3; 6-10 points, 0), the clot burden score (0-3 points, 1; 4-10 points, 0), and the leptomeningeal Collateral score (0-1 points, 2; 2-3 points, 0). We evaluated the predictive value of CTA parameters associated with symptomatic intracranial hemorrhage (sICH) or malignant middle cerebral artery infarction (MMCAI) after EVT and developed the score using logistic regression coefficients. The score was then validated. Performance of the score was tested with an area under the receiver operating characteristic curve (AUC-ROC). Results : The derivation cohort consisted of 115 and the validation cohort consisted of 40 AIS patients. The AUC-ROC was 0.97 (95% confidence interval [CI], 0.94-0.99; p<0.001) in the derivation cohort. The proportions of patients with sICH and/or MMCAI in the derivation cohort were 96%, 73%, 6%, and 0% for scores of 6, 5, 1, and 0 points, respectively. In the validation group, the proportions were similar (90%, 100%, 0%, and 0%, respectively) with an AUC-ROC of 0.96 (95% CI, 0.90-1.00; p<0.001). Conclusion : Our CTA-ABC score reliably assessed risk for sICH and/or MMCAI in patients with AIS who underwent EVT. It can support clinical decision-making, especially when the need for EVT is uncertain.

Case Study of Building a Malicious Domain Detection Model Considering Human Habitual Characteristics: Focusing on LSTM-based Deep Learning Model (인간의 습관적 특성을 고려한 악성 도메인 탐지 모델 구축 사례: LSTM 기반 Deep Learning 모델 중심)

  • Jung Ju Won
    • Convergence Security Journal
    • /
    • v.23 no.5
    • /
    • pp.65-72
    • /
    • 2023
  • This paper proposes a method for detecting malicious domains considering human habitual characteristics by building a Deep Learning model based on LSTM (Long Short-Term Memory). DGA (Domain Generation Algorithm) malicious domains exploit human habitual errors, resulting in severe security threats. The objective is to swiftly and accurately respond to changes in malicious domains and their evasion techniques through typosquatting to minimize security threats. The LSTM-based Deep Learning model automatically analyzes and categorizes generated domains as malicious or benign based on malware-specific features. As a result of evaluating the model's performance based on ROC curve and AUC accuracy, it demonstrated 99.21% superior detection accuracy. Not only can this model detect malicious domains in real-time, but it also holds potential applications across various cyber security domains. This paper proposes and explores a novel approach aimed at safeguarding users and fostering a secure cyber environment against cyber attacks.