• 제목/요약/키워드: ROC(Receiver operating characteristic)

검색결과 362건 처리시간 0.026초

Optimization of Predictors of Ewing Sarcoma Cause-specific Survival: A Population Study

  • Cheung, Min Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제15권10호
    • /
    • pp.4143-4145
    • /
    • 2014
  • Background: This study used receiver operating characteristic curve to analyze Surveillance, Epidemiology and End Results (SEER) Ewing sarcoma (ES) outcome data. The aim of this study was to identify and optimize ES-specific survival prediction models and sources of survival disparities. Materials and Methods: This study analyzed socio-economic, staging and treatment factors available in the SEER database for ES. 1844 patients diagnosed between 1973-2009 were used for this study. For the risk modeling, each factor was fitted by a Generalized Linear Model to predict the outcome (bone and joint specific death, yes/no). The area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. Results: The mean follow up time (S.D.) was 74.48 (89.66) months. 36% of the patients were female. The mean (S.D.) age was 18.7 (12) years. The SEER staging has the highest ROC (S.D.) area of 0.616 (0.032) among the factors tested. We simplified the 4-layered risk levels (local, regional, distant, un-staged) to a simpler non-metastatic (I and II) versus metastatic (III) versus un-staged model. The ROC area (S.D.) of the 3-tiered model was 0.612 (0.008). Several other biologic factors were also predictive of ES-specific survival, but not the socio-economic factors tested here. Conclusions: ROC analysis measured and optimized the performance of ES survival prediction models. Optimized models will provide a more efficient way to stratify patients for clinical trials.

Q-Q, P-P 플롯의 변동 통계량에 대한 ROC 분석

  • 이제영;이성원
    • Communications for Statistical Applications and Methods
    • /
    • 제5권1호
    • /
    • pp.205-215
    • /
    • 1998
  • 정규분포에 관한 검정에 있어서 P-P 플롯과 Q-Q 플롯의 가시적인 변동을 이용한 통계량을 제시하고 이 통계량들과 Shapiro-Wilk의 W 통계량과의 비교를 정확도(accuracy)의 측면을 고려하여 실시하였다. 또한, 의학이나 임상에서 척도의 우수성을 검정하기 위해 많이 사용하는 Receiver Operating Characteristic (ROC) 분석 기법을 이용하여 제시된 통계량들에 관한 Power와 Accuracy는 물론 Best Cut-Off 측면에서의 효율성을 검정하였다.

  • PDF

Receiver Operating Characteristic Analysis by Data Mining

  • 이성원;이제영
    • 한국통계학회:학술대회논문집
    • /
    • 한국통계학회 2001년도 추계학술발표회 논문집
    • /
    • pp.195-197
    • /
    • 2001
  • Data Mining is used to discover patterns and relationships in huge amounts of data. Researchers in many different fields have shown great interest in data mining analysis. Using the classification technique of data mining analysis, the available model for Receiver Operating Characteristic(ROC) method is presented. We present that this may help analyze result of data mining techniques.

  • PDF

Determination of cut-off value by receiver operating characteristic curve of norquetiapine and 9-hydroxyrisperidone concentrations in urine measured by LC-MS/MS

  • Kim, Seon Yeong;Shin, Dong Won;Kim, Jin Young
    • 분석과학
    • /
    • 제34권2호
    • /
    • pp.78-86
    • /
    • 2021
  • The objective of this study was to investigate urinary cut-off concentrations of quetiapine and risperidone for distinction between normal and abnormal/non-takers who were being placed on probation. Liquid chromatography-tandem mass spectrometric (LC-MS/MS) method was employed for determination of antipsychotic drugs in urine from mentally disordered probationers. The optimal cut-off values of antipsychotic drugs were calculated using receiver operating characteristic (ROC) curve analysis. The sensitivity and specificity of the method for the detection of antipsychotic drugs in urine were subsequently evaluated. The area under the ROC curve (AUC) was 0.927 for norquetiapine and 0.791 for 9-hydroxyrisperidone, respectively. These antipsychotic drugs are classified readily in the ROC curve analysis. The cut-off values for distinguishing regular and irregular/non-takers were 39.1 ng/mL for norquetiapine and 67.9 ng/mL for 9-hydroxyrisperidone, respectively. The results of this study suggest the cut-off values of quetiapine and risperidone were highly useful to distinguish regular takers from irregular/non-takers.

ACCURACY CURVES: AN ALTERNATIVE GRAPHICAL REPRESENTATION OF PROBABILITY DATA

  • Detrano Robert
    • 대한예방의학회:학술대회논문집
    • /
    • 대한예방의학회 1994년도 교수 연수회(역학)
    • /
    • pp.150-153
    • /
    • 1994
  • Receiver operating characteristic (ROC) curves have been frequently used to compare probability models applied to medical problems. Though the curves are a measure of the discriminatory power of a model. they do not reflect the model's accuracy. A supplementary accuracy curve is derived which will be coincident with the ROC curve if the model is reliable. will be above the ROC curve if the model's probabilities are too high or below if they are too low. A clinical example of this new graphical presentation is given.

  • PDF

주의력의 신경심리학 (Neuropsychology of Attention)

  • 김창윤;김성윤
    • 수면정신생리
    • /
    • 제6권1호
    • /
    • pp.26-31
    • /
    • 1999
  • "Attention" is not defined sufficiently. This term incorporates several dimensions or complex information processes such as alertness, spatial distribution, focused attention, sustained attention, divided attention and supervisory attentional control. In practice, however, various aspects of attention cannot be assessed separately with a single test. Moreover, a particular test is never assessing attention only, because the several intervening variables may influence the attentional component. Therefore, one can only assess a certain aspect of human behavior with special interest for its attentional component. This paper attempted to clarify various concepts of attention, reviewed signal detection theories with receiver operating characteristic(ROC) curves, and listed practical methods for assessment of attention.

  • PDF

Optimization of Classifier Performance at Local Operating Range: A Case Study in Fraud Detection

  • Park Lae-Jeong;Moon Jung-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제5권3호
    • /
    • pp.263-267
    • /
    • 2005
  • Building classifiers for financial real-world classification problems is often plagued by severely overlapping and highly skewed class distribution. New performance measures such as receiver operating characteristic (ROC) curve and area under ROC curve (AUC) have been recently introduced in evaluating and building classifiers for those kind of problems. They are, however, in-effective to evaluation of classifier's discrimination performance in a particular class of the classification problems that interests lie in only a local operating range of the classifier, In this paper, a new method is proposed that enables us to directly improve classifier's discrimination performance at a desired local operating range by defining and optimizing a partial area under ROC curve or domain-specific curve, which is difficult to achieve with conventional classification accuracy based learning methods. The effectiveness of the proposed approach is demonstrated in terms of fraud detection capability in a real-world fraud detection problem compared with the MSE-based approach.

ROC(receiver operating characteristics) 해석 (Interpretation of Receiver Operating Characteristics (ROC))

  • 김재덕
    • Imaging Science in Dentistry
    • /
    • 제30권3호
    • /
    • pp.155-158
    • /
    • 2000
  • 1. 일반방사선사진과 칼라화한 방사선사진의 비교에서 각각 필름에서 진단을 시행할 때 ROC해석법에서는 true positive fraction (TPF), false positive fraction (FPF)를 매개변수로 하고 있으므로 우선 두가지 필름형태에 대해 각각 따로 다음과 같이 평가한다. 2. 판정기준 병변없다 A, 거의 없다 B, 모르겠다 C, 거의 있다 D, 있다 E 먼저 일반방사선사진에서 실제로 병소가 총있는 것이 50, 총없는 것이 50인데 위 판정기준 각각에 대해(equation omitted) 3. 곡선만들기 a.횡축은 FPF 종축은 TPF로 한 그래프를 plot를 한다. sensitivity 17/50 specificity 26/50 accuracy 43/100 b. 곡선만들기 프로그램을 이용하여 곡선을 만들시에는 TPF를 a에 입력하고 PFP를 b에 입력한다. 이 plot을 그릴 수 있는 프로그램은 http://www.members.tripod.co.kr/jdakim 또는 http://www.chosun.ac.kr/∼jdakim의 홈페이지내 공개자료실에서 다운 받으실 수 있습니다. (equation omitted) 이 프로그램에서 입력할 a, b의 값은 (equation omitted) 위와같이 입력하여 얻어진 일반방사선사진에서의 판독 결과 얻어진 곡선이 그래프에서 곡선이 된다. 이와 같은 커브를 컬러화한 사진 판독에서 똑같이 시행하여 ROC곡선(윗곡선)을 만든 다음 두 곡선을 비교하여 아래면적이 더 큰 쪽이 병소 판독에 우수하다고 결론짓는다.

  • PDF

ROC와 CAP 곡선에서의 최적 분류점 (Optimal Threshold from ROC and CAP Curves)

  • 홍종선;최진수
    • 응용통계연구
    • /
    • 제22권5호
    • /
    • pp.911-921
    • /
    • 2009
  • 신용평가 연구에서 부도와 정상차주에 대한 판별력을 평가하는 방법으로 Receiver Operating Characteristic(ROC)와 Cumulative Accuracy Profile(CAP) 곡선을 사용한다. ROC 곡선에서 최적의 분류정확도를 갖는 분류점과 CAP 곡선에서 최대의 이익을 나타내는 분류점은 일반적인 정확도의 개념으로 정의된 동일한 성과를 가진 접선을 사용하여 구한다. 본 연구에서는 정확도의 대안적인 측도로 진실율을 제안하고, 이 진실율을 이용하여 ROC와 CAP 곡선에서 대안적인 최적의 분류점을 구한다. 대부분 실제 차주의 모집단에서 부도차주는 정상차주보다 훨씬 수가 적다. 이러한 경우에 진실율은 정확도보다 비용함수의 측면에서 더욱 효율적일 수 있다. 진실율을 이용하여 최적의 분류정확도를 나타내는 분류점과 최대의 이익을 의미하는 분류점에 대응하는 스코어는 동일하다는 것을 보였으며, 이 스코어는 부도와 정상 차주의 분포함수의 동일성을 검정하는 Kolmogorov-Smirnov 통계량에 대응하는 스코어와도 일치하는 것을 발견하였다.

ROC 분석을 이용한 수질자동측정소 실시간 남조류 측정의 정확성 평가 및 경보기준 설정 (Accuracy Evaluation and Alert Level Setting for Real-time Cyanobacteria Measurement Using Receiver Operating Characteristic Curve Analysis)

  • 송상환;박종환;강태우;김영석;김지현;강태구
    • 한국물환경학회지
    • /
    • 제33권2호
    • /
    • pp.130-139
    • /
    • 2017
  • With the need to evaluate accuracy of real-time measurement of cyanobacterial fluorescence to determine cyanobacterial blooms, this research examined 357 paired data (2013-2016) comprising both microscopic toxic cyanobacterial cell counts and concurrent real-time cyanobacterial concentrations at 2 sites (YS1 and YS2) in Yeongsan river. The increase in real-time cyanobacterial concentration was closely associated with the exceedance of 5,000 cyanobacterial cells/ml (odds ratio [OR] 1.07, 95% confidence interval [CI] 1.03-1.12) and 10,000 cells/ml (OR 1.08, 95% CI 1.04-1.12) at YS2 site. The area under the receiver operating characteristic (ROC) curve for the real-time cyanobacterial measurement at the YS2 site was 0.93, which indicates the measurement provides a high accurate detection of cyanobacterial blooms. On the ROC curve, the early alert levels of real-time cyanobacteria ranging $16-23{\mu}g$ chl-a/L would produce acceptable sensitivity of 79% and specificities greater than 90%. The real-time fluorescence measurement was found to be an accurate indicator of cyanobacteria and can serve as a tool for detecting toxic cyanobacterial bloom events in Youngsan river.