• 제목/요약/키워드: ROC(Receiver operating characteristic)

검색결과 362건 처리시간 0.024초

만성 폐쇄성 폐질환을 이용한 노모그램 구축과 비교 (Comparison of nomogram construction methods using chronic obstructive pulmonary disease)

  • 서주현;이제영
    • 응용통계연구
    • /
    • 제31권3호
    • /
    • pp.329-342
    • /
    • 2018
  • 노모그램은 질병의 위험 요인과 예측 확률을 쉽게 이해할 수 있도록 시각적으로 표현하는 통계적 도구이다. 본 논문은 만성 폐쇄성 폐질환(chronic obstructive pulmonary disease)의 위험 요인을 이용하여 로지스틱 회귀모형과 순수 베이지안 분류기 모형의 노모그램을 구축하고 이를 비교하였다. 분석 데이터는 국민건강영양조사 6기(2013-2015)를 이용하여 진행하였다. 총 6개의 위험 요인을 이용하였다. 그리고 로지스틱 회귀모형, 순수 베이지안 분류기 모형과 각각의 구축 방법을 이용하여 만성 폐쇄성 폐질환의 노모그램을 제시하였다. 또한, 구축된 두 노모그램을 비교하여 유용성을 살펴보았다. 마지막으로 ROC curve와 Calibration plot을 통하여 각 노모그램을 검증하였다.

연결발화에서 마비말화자의 음질 특성 (Voice Quality of Dysarthric Speakers in Connected Speech)

  • 서인효;성철재
    • 말소리와 음성과학
    • /
    • 제5권4호
    • /
    • pp.33-41
    • /
    • 2013
  • This study investigated the perceptual and cepstral/spectral characteristics of phonation and their relationships in dysarthria in connected speech. Twenty-two participants were divided into two groups; the eleven dysarthric speakers were paired with matching age and gender healthy control participants. A perceptual evaluation was performed by three speech pathologists using the GRBAS scale to measure the cepstrual/spectral characteristics of phonation between the two groups' connected speech. Correlations showed dysarthric speakers scored significantly worse (with a higher rating) with severities in G (overall dysphonia grade), B (breathiness), and S (strain), while the smoothed prominence of the cepstral peak (CPPs) was significantly lower. The CPPs were significantly correlated with the perceptual ratings, including G, B, and S. The utility of CPPs is supported by its high relationship with perceptually rated dysphonia severity in dysarthric speakers. The receiver operating characteristic (ROC) analysis showed that the threshold of 5.08 dB for the CPPs achieved a good classification for dysarthria, with 63.6% sensitivity and the perfect specificity (100%). Those results indicate the CPPs reliably distinguished between healthy controls and dysarthric speakers. However, the CPP frequency (CPP F0) and low-high spectral ratio (L/H ratio) were not significantly different between the two groups.

Reconsideration of F1 Score as a Performance Measure in Mass Spectrometry-based Metabolomics

  • Jeong, Jaesik;Kim, Han Sol;Kim, Shin June
    • 통합자연과학논문집
    • /
    • 제11권3호
    • /
    • pp.161-164
    • /
    • 2018
  • Over the past decade, mass spectrometry-based metabolomics, especially two dimensional gas chromatography mass spectrometry (GCxGC/TOF-MS), has become a key analytical tool for metabolomics data because of its sensitivity and ability to analyze complex biological or biochemical sample. However, the need to reduce variations within/between experiments has been reported and methodological developments to overcome such problem has long been a critical issue. Along with methodological developments, developing reasonable performance measure has also been studied. Following four numerical measures have been typically used for comparison: sensitivity, specificity, receiver operating characteristic (ROC) curves, and positive predictive value (PPV). However, more recently, such measures are replaced with F1 score in many fields including metabolomics area without any carefulness of its validity. Thus, we want to investigate the validity of F1 score on two examples, with the goal of raising the awareness in choosing appropriate performance comparison measure. We noticed that F1 score itself, as a performance measure, was not good enough. Accordingly, we suggest that F1 score be supplemented with other performance measure such as specificity to improve its validity.

The Importance of a Borrower's Track Record on Repayment Performance: Evidence in P2P Lending Market

  • KIM, Dongwoo
    • The Journal of Asian Finance, Economics and Business
    • /
    • 제7권7호
    • /
    • pp.85-93
    • /
    • 2020
  • In peer-to-peer (P2P) loan markets, as most lenders are unskilled and inexperienced ordinary individuals, it is important to know the characteristics of borrowers that significantly impact their repayment performance. This study investigates the effects and importance of borrowers' past repayment performance track record within the platform to identify its predictive power. To this end, I analyze the detailed loan repayment data from two leading P2P lending platforms in Korea using a Cox proportional hazard, multiple linear regression, and logit models. Furthermore, the predictive power of the factors proxied by borrowers' track records are evaluated through the receiver operating characteristic (ROC) curves. As a result, it is found that the borrowers' past track record within the platform have the most important impact on the repayment performance of their current loans. In addition, this study also reveals that the borrowers' track record is much more predictive of their repayment performance than any other factor. The findings of this study emphasize that individual lenders must take into account the quality of borrowers' past transaction history when making a funding decision, and that platform operators should actively share the borrowers' past records within the markets with lenders.

구내디지털방사선영상의 JPEG와 wavelet 압축방법 비교 (Comparison of JPEG and wavelet compression on intraoral digital radiographic images)

  • 김은경
    • Imaging Science in Dentistry
    • /
    • 제34권3호
    • /
    • pp.117-122
    • /
    • 2004
  • Purpose : To determine the proper image compression method and ratio without image quality degradation in intraoral digital radiographic images, comparing the discrete cosine transform (DCT)-based JPEG with the wavelet-based JPEG 2000 algorithm. Materials and Methods : Thirty extracted sound teeth and thirty extracted teeth with occlusal caries were used for this study. Twenty plaster blocks were made with three teeth each. They were radiographically exposed using CDR sensors (Schick Inc., Long Island, USA). Digital images were compressed to JPEG format, using Adobe Photoshop v.7.0 and JPEG 2000 format using Jasper program with compression ratios of 5 : 1,9 : 1, 14 : 1,28 : 1 each. To evaluate the lesion detectability, receiver operating characteristic (ROC) analysis was performed by the three oral and maxillofacial radiologists. To evaluate the image quality, all the compressed images were assessed subjectively using 5 grades, in comparison to the original uncompressed images. Results: Compressed images up to compression ratio of 14 : 1 in JPEG and 28 : 1 in JPEG 2000 showed nearly the same the lesion detectability as the original images. In the subjective assessment of image quality, images up to compression ratio of 9 : 1 in JPEG and 14 : 1 in JPEG 2000 showed minute mean paired differences from the original Images. Conclusion : The results showed that the clinically acceptable compression ratios were up to 9 : 1 for JPEG and 14 : 1 for JPEG 2000. The wavelet-based JPEG 2000 is a better compression method, comparing to DCT-based JPEG for intraoral digital radiographic images.

  • PDF

Comparison of the Autism Diagnostic Observation Schedule and Childhood Autism Rating Scale in the Diagnosis of Autism Spectrum Disorder: A Preliminary Study

  • Park, Hyung Seo;Yi, So Young;Yoon, Sun Ah;Hong, Soon-Beom
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • 제29권4호
    • /
    • pp.172-177
    • /
    • 2018
  • Objectives: We examined the agreement between the Autism Diagnostic Observation Schedule (ADOS) and the Childhood Autism Rating Scale (CARS) in the diagnosis of autism spectrum disorder. Methods: The ADOS and CARS scores of 78 children were retrospectively collected from a chart review. A correlation analysis was performed to examine the concurrent validity between the two measures. Using the receiver operating characteristic (ROC) curve, we determined the optimal cut-off score of the CARS for identifying autism spectrum disorder. Results: The CARS score was significantly correlated with the ADOS score (r=0.808, p<0.001). Taking ADOS as the ideal standard, the optimal cut-off scores of CARS for identifying autism and autism spectrum were 30 and 24.5, respectively. Conclusion: We determined the optimal cut-off scores of CARS for screening and diagnosing autism spectrum disorder.

An Improved Texture Feature Extraction Method for Recognizing Emphysema in CT Images

  • Peng, Shao-Hu;Nam, Hyun-Do
    • 조명전기설비학회논문지
    • /
    • 제24권11호
    • /
    • pp.30-41
    • /
    • 2010
  • In this study we propose a new texture feature extraction method based on an estimation of the brightness and structural uniformity of CT images representing the important characteristics for emphysema recognition. The Center-Symmetric Local Binary Pattern (CS-LBP) is first used to combine gray level in order to describe the brightness uniformity characteristics of the CT image. Then the gradient orientation difference is proposed to generate another CS-LBP code combining with gray level to represent the structural uniformity characteristics of the CT image. The usage of the gray level, CS-LBP and gradient orientation differences enables the proposed method to extract rich and distinctive information from the CT images in multiple directions. Experimental results showed that the performance of the proposed method is more stable with respect to sensitivity and specificity when compared with the SGLDM, GLRLM and GLDM. The proposed method outperformed these three conventional methods (SGLDM, GLRLM, and GLDM) 7.85[%], 22.87[%], and 16.67[%] respectively, according to the diagnosis of average accuracy, demonstrated by the Receiver Operating Characteristic (ROC) curves.

압축센싱과 통계학적 기법을 적용한 회전체 시스템의 상태진단 (Application of Compressive Sensing and Statistical Analysis to Condition Monitoring of Rotating Machine)

  • 이명준;전준영;박규해;강토;한순우
    • 한국소음진동공학회논문집
    • /
    • 제26권6_spc호
    • /
    • pp.651-659
    • /
    • 2016
  • Condition monitoring (CM) encounters a large data problem due to sensors that measure vibration data with a continuous, and sometimes, high sampling rate. In this study, compressive sensing approaches for condition monitoring are proposed to demonstrate the efficiency in handling a large amount of data and to improve the damage detection capability of the current condition monitoring process. Compressive sensing is a novel sensing/sampling paradigm that takes much fewer samples compared to traditional sampling methods. For the experiments a built-in rotating system was used and all data were compressively sampled to obtain compressed data. Optimal signal features were then selected without the reconstruction process and were used to detect and classify damage. The experimental results show that the proposed method could improve the data processing speed and the accuracy of condition monitoring of rotating systems.

Sentiment Analysis From Images - Comparative Study of SAI-G and SAI-C Models' Performances Using AutoML Vision Service from Google Cloud and Clarifai Platform

  • Marcu, Daniela;Danubianu, Mirela
    • International Journal of Computer Science & Network Security
    • /
    • 제21권9호
    • /
    • pp.179-184
    • /
    • 2021
  • In our study we performed a sentiments analysis from the images. For this purpose, we used 153 images that contain: people, animals, buildings, landscapes, cakes and objects that we divided into two categories: images that suggesting a positive or a negative emotion. In order to classify the images using the two categories, we created two models. The SAI-G model was created with Google's AutoML Vision service. The SAI-C model was created on the Clarifai platform. The data were labeled in a preprocessing stage, and for the SAI-C model we created the concepts POSITIVE (POZITIV) AND NEGATIVE (NEGATIV). In order to evaluate the performances of the two models, we used a series of evaluation metrics such as: Precision, Recall, ROC (Receiver Operating Characteristic) curve, Precision-Recall curve, Confusion Matrix, Accuracy Score and Average precision. Precision and Recall for the SAI-G model is 0.875, at a confidence threshold of 0.5, while for the SAI-C model we obtained much lower scores, respectively Precision = 0.727 and Recall = 0.571 for the same confidence threshold. The results indicate a lower classification performance of the SAI-C model compared to the SAI-G model. The exception is the value of Precision for the POSITIVE concept, which is 1,000.

Comparison of Predictive Value of Obesity and Lipid Related Variables for Metabolic Syndrome and Insulin Resistance in Obese Adults

  • Shin, Kyung A
    • 대한의생명과학회지
    • /
    • 제25권3호
    • /
    • pp.256-266
    • /
    • 2019
  • In this study, obese adults were compared for their ability to predict obesity and lipid related variables and their optimal cutoff values to predict metabolic syndrome and insulin resistance. In this study, 9,256 adults aged 20 years or older and less than 80 years old, who were in the Gyeonggi region from January 2014 to December 2016 and who were examined at a general hospital, were enrolled. The diagnostic criteria for obesity were WHO (World Health Organization), and BMI $25kg/m^2$ or more presented in the Asia-Pacific region. Metabolic syndrome was diagnosed based on the criteria of American Heart Association / National Heart, Lung, and Blood Institute (AHA / NHLBI). According to the results of receiver operating characteristic curve (ROC) analysis, Triglyceride / HDL-cholesterol (TG / HDL-C), Triglyceride and Glucose (TyG) index, lipid accumulation product (LAP) and visceral adiposity index (VAI) showed high predictive power for diagnosing metabolic syndrome. The diagnostic accuracy of LAP (AUC: 0.854) for males and VAI (0.888) for females was the highest. The optimal cutoff value of LAP was 42.71 for male and 35.44 for female, and the cutoff value of VAI was 1.92 for male and 2.15 for female. In addition, WHtR (waist to height ratio), TyG index, and LAP were used as predictors of insulin resistance in obese adults. Therefore, LAP and VAI were superior to other indicators in predicting metabolic syndrome in obese adults.