• Title/Summary/Keyword: Receiver Operating Characteristic

Search Result 668, Processing Time 0.027 seconds

Comparison of the Berg Balance and Fullerton Advanced Balance Scale for Predicting Falls in Patients With Chronic Stroke (만성 뇌졸중 환자의 낙상 예측을 위한 버그균형 척도와 플러턴 어드밴스드 균형 척도의 비교)

  • Kim, In-seop;Nam, Taek-gil;Kim, Gyoung-mo;Kim, Jun-seop;Kim, So-jeong;Kang, Jeong-ha
    • Physical Therapy Korea
    • /
    • v.25 no.1
    • /
    • pp.39-46
    • /
    • 2018
  • Background: The Berg Balance Scale (BBS) and the Fullerton Advanced Balance (FAB) scale have been used to assess balance function in patients with chronic stroke. These clinical balance scales provide information about potential risk factors for falls. Objects: The purpose of this study was to investigate the incidence of and risk factors of falls and compare the predictive values of the BBS and FAB scale relative to fall risk in patients with stroke through receiver operating characteristic analysis. Methods: Sixty-three patients with stroke (faller=34, non-faller=29) who could walk independently for 10 meters participated in this study. The BBS and FAB scale were administered. Then, we verified the cut-off score, sensitivity, specificity, and the area of under the curve. Results: In this study, the BBS and FAB scale did not predict fall risk in patients with stroke in the receiver operator characteristic curve analysis. A cut-off score of 37.5 points provided sensitivity of .47 and specificity of .35 on the BBS, and a cut-off score of 20.5 points provided sensitivity of .44 and specificity of .45 on the FAB scale. Conclusion: The BBS and FAB scale were not useful screening tools for predicting fall risk in patients with stroke in this study, but those who scored 37.5 or lower on the BBS and 20.5 or lower on the FAB scale had a high risk for falls.

Positive and negative predictive values by the TOC curve

  • Hong, Chong Sun;Choi, So Yeon
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.2
    • /
    • pp.211-224
    • /
    • 2020
  • Sensitivity and specificity are popular measures described by the receiver operating characteristic (ROC) curve. There are also two other measures such as the positive predictive value (PPV) and negative predictive value (NPV); however, the PPV and NPV cannot be represented by the ROC curve. Based on the total operating characteristic (TOC) curve suggested by Pontius and Si (International Journal of Geographical Information Science, 97, 570-583, 2014), explanatory methods are proposed to geometrically describe the PPV and NPV by the TOC curve. It is found that the PPV can be regarded as the slope of the right-angled triangle connecting the origin to a certain point on the TOC curve, while 1 - NPV can be represented as the slope of the right-angled triangle connecting a certain point to the top right corner of the TOC curve. When the neutral zone exists, the PPV and 1-NPV can be described as the slopes of two other right-angled triangles of the TOC curve. Therefore, both the PPV and NPV can be estimated using the TOC curve, whether or not the neutral zone is present.

Optimization of Classifier Performance at Local Operating Range: A Case Study in Fraud Detection

  • Park Lae-Jeong;Moon Jung-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.3
    • /
    • pp.263-267
    • /
    • 2005
  • Building classifiers for financial real-world classification problems is often plagued by severely overlapping and highly skewed class distribution. New performance measures such as receiver operating characteristic (ROC) curve and area under ROC curve (AUC) have been recently introduced in evaluating and building classifiers for those kind of problems. They are, however, in-effective to evaluation of classifier's discrimination performance in a particular class of the classification problems that interests lie in only a local operating range of the classifier, In this paper, a new method is proposed that enables us to directly improve classifier's discrimination performance at a desired local operating range by defining and optimizing a partial area under ROC curve or domain-specific curve, which is difficult to achieve with conventional classification accuracy based learning methods. The effectiveness of the proposed approach is demonstrated in terms of fraud detection capability in a real-world fraud detection problem compared with the MSE-based approach.

A Development of Wireless Sensor Networks for Collaborative Sensor Fusion Based Speaker Gender Classification (협동 센서 융합 기반 화자 성별 분류를 위한 무선 센서네트워크 개발)

  • Kwon, Ho-Min
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.12 no.2
    • /
    • pp.113-118
    • /
    • 2011
  • In this paper, we develop a speaker gender classification technique using collaborative sensor fusion for use in a wireless sensor network. The distributed sensor nodes remove the unwanted input data using the BER(Band Energy Ration) based voice activity detection, process only the relevant data, and transmit the hard labeled decisions to the fusion center where a global decision fusion is carried out. This takes advantages of power consumption and network resource management. The Bayesian sensor fusion and the global weighting decision fusion methods are proposed to achieve the gender classification. As the number of the sensor nodes varies, the Bayesian sensor fusion yields the best classification accuracy using the optimal operating points of the ROC(Receiver Operating Characteristic) curves_ For the weights used in the global decision fusion, the BER and MCL(Mutual Confidence Level) are employed to effectively combined at the fusion center. The simulation results show that as the number of the sensor nodes increases, the classification accuracy was even more improved in the low SNR(Signal to Noise Ration) condition.

Online anomaly detection algorithm based on deep support vector data description using incremental centroid update (점진적 중심 갱신을 이용한 deep support vector data description 기반의 온라인 비정상 탐지 알고리즘)

  • Lee, Kibae;Ko, Guhn Hyeok;Lee, Chong Hyun
    • The Journal of the Acoustical Society of Korea
    • /
    • v.41 no.2
    • /
    • pp.199-209
    • /
    • 2022
  • Typical anomaly detection algorithms are trained by using prior data. Thus the batch learning based algorithms cause inevitable performance degradation when characteristics of newly incoming normal data change over time. We propose an online anomaly detection algorithm which can consider the gradual characteristic changes of incoming normal data. The proposed algorithm based on one-class classification model includes both offline and online learning procedures. In offline learning procedure, the algorithm learns the prior data to be close to centroid of the latent space and then updates the centroid of the latent space incrementally by new incoming data. In the online learning, the algorithm continues learning by using the updated centroid. Through experiments using public underwater acoustic data, the proposed online anomaly detection algorithm takes only approximately 2 % additional learning time for the incremental centroid update and learning. Nevertheless, the proposed algorithm shows 19.10 % improvement in Area Under the receiver operating characteristic Curve (AUC) performance compared to the offline learning model when new incoming normal data comes.

Receiver Operating Characteristic (의학적 진단에서 ROC 곡선의 활용)

  • 박선일
    • Journal of the korean veterinary medical association
    • /
    • v.36 no.2
    • /
    • pp.121-134
    • /
    • 2000
  • 의학적 진단에서 검사결과가 연속형으로 측정되는 예는 매우 많다. 예를 들어 ELISA검사, 혈청화학적 검사, 방사선 검사 (이 경우에는 음성, 의양성, 양성등의 척도로 표현될 수 있음) 등에서는 적절한 기준을 설정한 후 이 기준점을 근거로 양성과 음성으로 판정하게 된다. 여기에서 한 가지 문제는 기준점 설정에 있다. 소위 정상 혹은 참고범위 (normal or reference range)가 분명히 있는 경우라고 실제 판정에 있어서는 질별이 없음에도 불구하고 검사결과 질병이 있는 것으로 판정할 오류 (혹은 그 반대)가 분명히 존재한다. 본 논문에서는 이러한 상황에서 접근할 수 있는 한가지 방법인 ROC 곡선에 대하여 설명하고자 한다.

  • PDF

ACCURACY CURVES: AN ALTERNATIVE GRAPHICAL REPRESENTATION OF PROBABILITY DATA

  • Detrano Robert
    • 대한예방의학회:학술대회논문집
    • /
    • 1994.02b
    • /
    • pp.150-153
    • /
    • 1994
  • Receiver operating characteristic (ROC) curves have been frequently used to compare probability models applied to medical problems. Though the curves are a measure of the discriminatory power of a model. they do not reflect the model's accuracy. A supplementary accuracy curve is derived which will be coincident with the ROC curve if the model is reliable. will be above the ROC curve if the model's probabilities are too high or below if they are too low. A clinical example of this new graphical presentation is given.

  • PDF

Comparison of the Pediatric Balance Scale and Fullerton Advanced Balance Scale for Predicting Falls in Children With Cerebral Palsy

  • Kim, Gyoung-mo
    • Physical Therapy Korea
    • /
    • v.23 no.4
    • /
    • pp.63-70
    • /
    • 2016
  • Background: The Pediatric Balance Scale (PBS) and the Fullerton Advanced Balance (FAB) scale were used to assess balance function in patients with balance problem. These multidimensional clinical balance scales provide information about potential risk factors for falls. Objects: The purpose of this study was to investigate and compare the predictive properties of the PBS and FAB scales relative to fall risk in children with cerebral palsy (CP) using a receiver operating characteristic analysis. Methods: In total, 49 children with CP (boy=21, girl=28) who were diagnosed with level 1 or 2 according to the Gross Motor Function Classification System participated in this study. The PBS and FAB were performed, and verified cut-off score, sensitivity, specificity, and the area of under the curve (AUC). Results: In this study, the PBS scale was as a predictive measure of fall risk, but the FAB was not significant in children with CP. A cut-off score of 45.5 points provided optimal sensitivity of .90 and specificity of .69 on the PBS, and a cut-off score of 21.5 points provided optimal sensitivity of .90 and specificity of .62 on the FAB. Both scales showed moderately accurate of AUC with .79 and .76, respectively. Conclusion: The PBS is a useful screening tool for predicting fall risk in children with cerebral palsy, and those who score 45.5 or lower indicate a high risk for falls and are in need of balance intervention.