• Title/Summary/Keyword: ROC(Receiver operating characteristic)

Search Result 362, Processing Time 0.025 seconds

Comparison of nomogram construction methods using chronic obstructive pulmonary disease (만성 폐쇄성 폐질환을 이용한 노모그램 구축과 비교)

  • Seo, Ju-Hyun;Lee, Jea-Young
    • The Korean Journal of Applied Statistics
    • /
    • v.31 no.3
    • /
    • pp.329-342
    • /
    • 2018
  • Nomogram is a statistical tool that visualizes the risk factors of the disease and then helps to understand the untrained people. This study used risk factors of chronic obstructive pulmonary disease (COPD) and compared with logistic regression model and naïve Bayesian classifier model. Data were analyzed using the Korean National Health and Nutrition Examination Survey 6th (2013-2015). First, we used 6 risk factors about COPD. We constructed nomogram using logistic regression model and naïve Bayesian classifier model. We also compared the nomograms constructed using the two methods to find out which method is more appropriate. The receiver operating characteristic curve and the calibration plot were used to verify each nomograms.

Voice Quality of Dysarthric Speakers in Connected Speech (연결발화에서 마비말화자의 음질 특성)

  • Seo, Inhyo;Seong, Cheoljae
    • Phonetics and Speech Sciences
    • /
    • v.5 no.4
    • /
    • pp.33-41
    • /
    • 2013
  • This study investigated the perceptual and cepstral/spectral characteristics of phonation and their relationships in dysarthria in connected speech. Twenty-two participants were divided into two groups; the eleven dysarthric speakers were paired with matching age and gender healthy control participants. A perceptual evaluation was performed by three speech pathologists using the GRBAS scale to measure the cepstrual/spectral characteristics of phonation between the two groups' connected speech. Correlations showed dysarthric speakers scored significantly worse (with a higher rating) with severities in G (overall dysphonia grade), B (breathiness), and S (strain), while the smoothed prominence of the cepstral peak (CPPs) was significantly lower. The CPPs were significantly correlated with the perceptual ratings, including G, B, and S. The utility of CPPs is supported by its high relationship with perceptually rated dysphonia severity in dysarthric speakers. The receiver operating characteristic (ROC) analysis showed that the threshold of 5.08 dB for the CPPs achieved a good classification for dysarthria, with 63.6% sensitivity and the perfect specificity (100%). Those results indicate the CPPs reliably distinguished between healthy controls and dysarthric speakers. However, the CPP frequency (CPP F0) and low-high spectral ratio (L/H ratio) were not significantly different between the two groups.

Reconsideration of F1 Score as a Performance Measure in Mass Spectrometry-based Metabolomics

  • Jeong, Jaesik;Kim, Han Sol;Kim, Shin June
    • Journal of Integrative Natural Science
    • /
    • v.11 no.3
    • /
    • pp.161-164
    • /
    • 2018
  • Over the past decade, mass spectrometry-based metabolomics, especially two dimensional gas chromatography mass spectrometry (GCxGC/TOF-MS), has become a key analytical tool for metabolomics data because of its sensitivity and ability to analyze complex biological or biochemical sample. However, the need to reduce variations within/between experiments has been reported and methodological developments to overcome such problem has long been a critical issue. Along with methodological developments, developing reasonable performance measure has also been studied. Following four numerical measures have been typically used for comparison: sensitivity, specificity, receiver operating characteristic (ROC) curves, and positive predictive value (PPV). However, more recently, such measures are replaced with F1 score in many fields including metabolomics area without any carefulness of its validity. Thus, we want to investigate the validity of F1 score on two examples, with the goal of raising the awareness in choosing appropriate performance comparison measure. We noticed that F1 score itself, as a performance measure, was not good enough. Accordingly, we suggest that F1 score be supplemented with other performance measure such as specificity to improve its validity.

The Importance of a Borrower's Track Record on Repayment Performance: Evidence in P2P Lending Market

  • KIM, Dongwoo
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.7 no.7
    • /
    • pp.85-93
    • /
    • 2020
  • In peer-to-peer (P2P) loan markets, as most lenders are unskilled and inexperienced ordinary individuals, it is important to know the characteristics of borrowers that significantly impact their repayment performance. This study investigates the effects and importance of borrowers' past repayment performance track record within the platform to identify its predictive power. To this end, I analyze the detailed loan repayment data from two leading P2P lending platforms in Korea using a Cox proportional hazard, multiple linear regression, and logit models. Furthermore, the predictive power of the factors proxied by borrowers' track records are evaluated through the receiver operating characteristic (ROC) curves. As a result, it is found that the borrowers' past track record within the platform have the most important impact on the repayment performance of their current loans. In addition, this study also reveals that the borrowers' track record is much more predictive of their repayment performance than any other factor. The findings of this study emphasize that individual lenders must take into account the quality of borrowers' past transaction history when making a funding decision, and that platform operators should actively share the borrowers' past records within the markets with lenders.

Comparison of JPEG and wavelet compression on intraoral digital radiographic images (구내디지털방사선영상의 JPEG와 wavelet 압축방법 비교)

  • Kim Eun-Kyung
    • Imaging Science in Dentistry
    • /
    • v.34 no.3
    • /
    • pp.117-122
    • /
    • 2004
  • Purpose : To determine the proper image compression method and ratio without image quality degradation in intraoral digital radiographic images, comparing the discrete cosine transform (DCT)-based JPEG with the wavelet-based JPEG 2000 algorithm. Materials and Methods : Thirty extracted sound teeth and thirty extracted teeth with occlusal caries were used for this study. Twenty plaster blocks were made with three teeth each. They were radiographically exposed using CDR sensors (Schick Inc., Long Island, USA). Digital images were compressed to JPEG format, using Adobe Photoshop v.7.0 and JPEG 2000 format using Jasper program with compression ratios of 5 : 1,9 : 1, 14 : 1,28 : 1 each. To evaluate the lesion detectability, receiver operating characteristic (ROC) analysis was performed by the three oral and maxillofacial radiologists. To evaluate the image quality, all the compressed images were assessed subjectively using 5 grades, in comparison to the original uncompressed images. Results: Compressed images up to compression ratio of 14 : 1 in JPEG and 28 : 1 in JPEG 2000 showed nearly the same the lesion detectability as the original images. In the subjective assessment of image quality, images up to compression ratio of 9 : 1 in JPEG and 14 : 1 in JPEG 2000 showed minute mean paired differences from the original Images. Conclusion : The results showed that the clinically acceptable compression ratios were up to 9 : 1 for JPEG and 14 : 1 for JPEG 2000. The wavelet-based JPEG 2000 is a better compression method, comparing to DCT-based JPEG for intraoral digital radiographic images.

  • PDF

Comparison of the Autism Diagnostic Observation Schedule and Childhood Autism Rating Scale in the Diagnosis of Autism Spectrum Disorder: A Preliminary Study

  • Park, Hyung Seo;Yi, So Young;Yoon, Sun Ah;Hong, Soon-Beom
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.29 no.4
    • /
    • pp.172-177
    • /
    • 2018
  • Objectives: We examined the agreement between the Autism Diagnostic Observation Schedule (ADOS) and the Childhood Autism Rating Scale (CARS) in the diagnosis of autism spectrum disorder. Methods: The ADOS and CARS scores of 78 children were retrospectively collected from a chart review. A correlation analysis was performed to examine the concurrent validity between the two measures. Using the receiver operating characteristic (ROC) curve, we determined the optimal cut-off score of the CARS for identifying autism spectrum disorder. Results: The CARS score was significantly correlated with the ADOS score (r=0.808, p<0.001). Taking ADOS as the ideal standard, the optimal cut-off scores of CARS for identifying autism and autism spectrum were 30 and 24.5, respectively. Conclusion: We determined the optimal cut-off scores of CARS for screening and diagnosing autism spectrum disorder.

An Improved Texture Feature Extraction Method for Recognizing Emphysema in CT Images

  • Peng, Shao-Hu;Nam, Hyun-Do
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.24 no.11
    • /
    • pp.30-41
    • /
    • 2010
  • In this study we propose a new texture feature extraction method based on an estimation of the brightness and structural uniformity of CT images representing the important characteristics for emphysema recognition. The Center-Symmetric Local Binary Pattern (CS-LBP) is first used to combine gray level in order to describe the brightness uniformity characteristics of the CT image. Then the gradient orientation difference is proposed to generate another CS-LBP code combining with gray level to represent the structural uniformity characteristics of the CT image. The usage of the gray level, CS-LBP and gradient orientation differences enables the proposed method to extract rich and distinctive information from the CT images in multiple directions. Experimental results showed that the performance of the proposed method is more stable with respect to sensitivity and specificity when compared with the SGLDM, GLRLM and GLDM. The proposed method outperformed these three conventional methods (SGLDM, GLRLM, and GLDM) 7.85[%], 22.87[%], and 16.67[%] respectively, according to the diagnosis of average accuracy, demonstrated by the Receiver Operating Characteristic (ROC) curves.

Application of Compressive Sensing and Statistical Analysis to Condition Monitoring of Rotating Machine (압축센싱과 통계학적 기법을 적용한 회전체 시스템의 상태진단)

  • Lee, Myung Jun;Jeon, Jun Young;Park, Gyuhae;Kang, To;Han, Soon Woo
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.26 no.6_spc
    • /
    • pp.651-659
    • /
    • 2016
  • Condition monitoring (CM) encounters a large data problem due to sensors that measure vibration data with a continuous, and sometimes, high sampling rate. In this study, compressive sensing approaches for condition monitoring are proposed to demonstrate the efficiency in handling a large amount of data and to improve the damage detection capability of the current condition monitoring process. Compressive sensing is a novel sensing/sampling paradigm that takes much fewer samples compared to traditional sampling methods. For the experiments a built-in rotating system was used and all data were compressively sampled to obtain compressed data. Optimal signal features were then selected without the reconstruction process and were used to detect and classify damage. The experimental results show that the proposed method could improve the data processing speed and the accuracy of condition monitoring of rotating systems.

Sentiment Analysis From Images - Comparative Study of SAI-G and SAI-C Models' Performances Using AutoML Vision Service from Google Cloud and Clarifai Platform

  • Marcu, Daniela;Danubianu, Mirela
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.9
    • /
    • pp.179-184
    • /
    • 2021
  • In our study we performed a sentiments analysis from the images. For this purpose, we used 153 images that contain: people, animals, buildings, landscapes, cakes and objects that we divided into two categories: images that suggesting a positive or a negative emotion. In order to classify the images using the two categories, we created two models. The SAI-G model was created with Google's AutoML Vision service. The SAI-C model was created on the Clarifai platform. The data were labeled in a preprocessing stage, and for the SAI-C model we created the concepts POSITIVE (POZITIV) AND NEGATIVE (NEGATIV). In order to evaluate the performances of the two models, we used a series of evaluation metrics such as: Precision, Recall, ROC (Receiver Operating Characteristic) curve, Precision-Recall curve, Confusion Matrix, Accuracy Score and Average precision. Precision and Recall for the SAI-G model is 0.875, at a confidence threshold of 0.5, while for the SAI-C model we obtained much lower scores, respectively Precision = 0.727 and Recall = 0.571 for the same confidence threshold. The results indicate a lower classification performance of the SAI-C model compared to the SAI-G model. The exception is the value of Precision for the POSITIVE concept, which is 1,000.

Comparison of Predictive Value of Obesity and Lipid Related Variables for Metabolic Syndrome and Insulin Resistance in Obese Adults

  • Shin, Kyung A
    • Biomedical Science Letters
    • /
    • v.25 no.3
    • /
    • pp.256-266
    • /
    • 2019
  • In this study, obese adults were compared for their ability to predict obesity and lipid related variables and their optimal cutoff values to predict metabolic syndrome and insulin resistance. In this study, 9,256 adults aged 20 years or older and less than 80 years old, who were in the Gyeonggi region from January 2014 to December 2016 and who were examined at a general hospital, were enrolled. The diagnostic criteria for obesity were WHO (World Health Organization), and BMI $25kg/m^2$ or more presented in the Asia-Pacific region. Metabolic syndrome was diagnosed based on the criteria of American Heart Association / National Heart, Lung, and Blood Institute (AHA / NHLBI). According to the results of receiver operating characteristic curve (ROC) analysis, Triglyceride / HDL-cholesterol (TG / HDL-C), Triglyceride and Glucose (TyG) index, lipid accumulation product (LAP) and visceral adiposity index (VAI) showed high predictive power for diagnosing metabolic syndrome. The diagnostic accuracy of LAP (AUC: 0.854) for males and VAI (0.888) for females was the highest. The optimal cutoff value of LAP was 42.71 for male and 35.44 for female, and the cutoff value of VAI was 1.92 for male and 2.15 for female. In addition, WHtR (waist to height ratio), TyG index, and LAP were used as predictors of insulin resistance in obese adults. Therefore, LAP and VAI were superior to other indicators in predicting metabolic syndrome in obese adults.