• The Korean Journal of Applied Statistics
• /
• v.32 no.4
• /
• pp.593-605
• /
• 2019

Significant literature exists on the area under the ROC curve (AUC) and the volume under the ROC surface (VUS) which are statistical measures of the discriminant power of classification models. Whereas the partial AUC is restricted on the false positive rate, the two-way partial AUC is restricted on both the false positive rate and true positive rate, which could be more efficient and accurate than partial AUC. The two-way partial AUC was suggested as more efficient and accurate than the partial AUC. Partial VUS as well as the three-way partial VUS were also developed for the ROC surface. A proposed AUC is expressed in this paper with probability and integration using two truncated distribution functions restricted on both the false positive rate and true positive rate. It is also found that this AUC has a relation with the two-way partial AUC. The three-way partial VUS for the ROC surface is also related to the VUS using truncated distribution functions. These AUC and VUS are represented and estimated in terms of Mann-Whitney statistics. Their parametric and non-parametric estimation methods are explored based on normal distributions and random samples.

• The Korean Journal of Applied Statistics
• /
• v.34 no.2
• /
• pp.225-238
• /
• 2021

The ROC, TOC, and TROC curves, which are visually descriptive methods of exploring the performance of the binary classification model, are implemented with TP, TN, FP, FN which consist of the confusion matrix, as well as their ratios TPR, TNR, FPR, FNR. In this study, we consider two types odds and then propose an odds curve representing these odds. And show the relationship between the odds curve and ROC curve. Based on the odds curve, we propose not only two statistics that measure the discriminant power of the odds curve but also the criteria for validation ratings of the odds curve. According to the shape of the odds curves, two classification distributions can be estimated and a criterion for validation ratings can be determined. The odds curve can be meaningfully used like other visual methods, and two kinds of measures for the discriminant power can be also applied together as an alternative criterion.

• Journal of radiological science and technology
• /
• v.32 no.2
• /
• pp.147-151
• /
• 2009

In general, the discrete confidence judgments that use five-step assessment method have been used to assess the medical images by ROC. TPF or FPF can be computed easily with this independent reading test. However, during experiments, it happens frequently that adequate distribution for observers is required to smoothly estimate the ROC curve. In addition, data becomes invalid for distribution of the created categories. To solve such problems or to apply the ROC interpretation to data that is not obtained from the experimental observation, the continuous confidence judgements (CCJ) has been proposed, which implements ROC interpretation using continuously-distributed experimental results without category classification has been used. As the use of CCJ to assess medical images was barely reported in Korea, we applied it to the assessment of chest digital images in this study. The results showed that a smooth ROC curve was obtained conveniently by the commercialized program and the characteristic value was measured easily. Therefore, it is recommended that this method can be applied to the assessment of digital medical images.

• Journal of Veterinary Clinics
• /
• v.19 no.3
• /
• pp.312-315
• /
• 2002

Diagnostic tests often require the determination of cut-off values that discriminate uninfected from infected individuals. The receiver operating characteristic (ROC) curve has been frequently used to attain this purpose and gives a representation of diagnostic accuracy (sensitivity and specificity) of a prediction model when varying the cut-point of a decision rule on a whole spectrum. We have written and tested a visual basic application program in EXCEL for maximum likelihood estimation of a binormal ROC curve, which also computes univariate statistics of a diagnostic test employed. Examples applying for computed tomographic images in radiology and methicillin-resistant Staphylococcus aureus research are given to illustrate this approach. This stand-alone module is available from the first author on request.

• Journal of radiological science and technology
• /
• v.40 no.2
• /
• pp.237-243
• /
• 2017

This study evaluated the applicability of computer-aided diagnosis by retrospective analysis of GLCM algorithm based on cytopathological diagnosis of normal and malignant nodules in thyroid ultrasound images. In the experiment, the recognition rate and ROC curve of thyroid malignant nodule were analyzed using 6 parameters of GLCM algorithm. Experimental results showed 97% energy, 93% contrast, 92% correlation, 92% homogeneity, 100% entropy and 100% variance. Statistical analysis showed that the area under the curve of each parameter was more than 0.947 (p = 0.001) in the ROC curve, which was significant in the recognition of thyroid malignant nodules. In the GLCM, the cut-off value of each parameter can be used to predict the disease through analysis of quantitative computer-aided diagnosis.

• Journal of radiological science and technology
• /
• v.36 no.4
• /
• pp.319-326
• /
• 2013

The purpose of this study is to evaluate usefulness of Hybrid image and Inverse image about detection of tumor shadow in chest radiography using ROC analysis. Original images of 60 cases are selected from Standards digital image date base issued by the Japanese Society of Radiological Technology. Through computer language of C, Inverse images of 60 cases and Hybrid image of 30 cases are made. The continues reading experiment was conducted. In the case of inverse image were observed by 5 radiographer and 2 radiologist. In the case of In case of Hybrid image were observed by 3 student radiographer and 2 experienced radiographer. ROC curve are constructed using ROCKIT Program made by Metz. In Inverse image, a Az of average ROC curve was increases from 0.742 of original image to 0.775 of inverse image. In normal cases, the effect of the detrimental is same to that of the beneficial, however In abnormal cases, the beneficial effect is greater than detrimental effect. However in Hybrid image, a Az of average ROC curve was decreases from 0.5253 of original image to 0.4868 of Hybrid image. In Normal cases, the effect of the detrimental is greater than that of the Beneficial, however In abnormal cases, the Beneficial effect is greater than detrimental effect. The inverse image can be more positively considered for the detecting of tumor than the hybrid image.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2019.05a
• /
• pp.367-367
• /
• 2019

최근 기후변화로 인해 국지성 호우 및 태풍의 빈도가 빈발하고 및 규모가 커지고 있으며 그로 인한 홍수피해규모는 증가하고 있다. 본 논문에서는 도시 지역의 호우로 인한 침수유발 강우량을 산정하는 기법의 정확도를 산정하는데 목적이 있으며 이를 위해 ROC(Receiver Operation Characteristic Curve) 분석을 이용하였다. 본 논문에서는 분포형 홍수해석 모형인 S-RAT 모형과 2차원 침수해석 모형 FLO-2D을 커플링하여 호우로 인한 침수해석을 실시하였으며 강우시나리오는 설계 강우 200mm의 강우를 10% 간격으로 증가시켜 강우량 대비 침수심 자료를 모의하였다. 모의한 침수심 자료를 이용하여 유역 격자를 $1km{\times}1km$ 별 강우량-침수심 관계곡선식을 제시하였으며 개발된 곡선식을 이용하여 특정 침수심(20cm)을 유발시키는 강우량(한계강우량)을 산정하였다. 정확도 산정은 ROC(Receiver Operation Characteristic Curve) 분석 방법을 이용하여 침수 유무의 적중률에 따른 민감도와 특이도를 이용하여 AUC(Area Under the Curve)의 점수로 정확도를 판단하였다. 본 논문에서는 본 논문에서 제시한 한계강우량의 정확도를 판단하기 위하여 2011년 7월의 사당역 일대 침수사례를 이용하였다. 실제 침수정보가 없어 실제 호우사상과 실제 하수관망을 고려할 수 있는 SWMM 모형을 이용하여 침수분석을 실시하였다. 분석 결과 평균 ROC는 약 0.7로 나타났으며 5 단계의 구분에서 Fair 단계로 적정 수준의 정확도를 확보한 것으로 나타났다.

• Communications for Statistical Applications and Methods
• /
• v.17 no.6
• /
• pp.755-765
• /
• 2010

For classification problems on mixture distribution, a threshold based on cost functions is optimal from the viewpoint of a minimum expected cost. Assuming that there is no cost information, we propose cost ratios in the expected cost corresponding to thresholds where the total accuracy and the true rate are maximized to explain the relation of these cost ratios minimizing the expected cost. Other cost ratios are also proposed by comparing the normalized expected costs when classification accuracy is maximized. The values of these cost ratios are located between two cost ratios for the expected costs based on classification accuracies, and converge to that of the minimum expected cost. This work suggests two cost ratios: one is minimized by the expected cost and the normalized expected cost, and the other in the expected cost and the normalized expected cost functions that are maximized classification accuracies. We discuss their compatibility based on the relation of these cost ratios.

• Journal of the Korean Data and Information Science Society
• /
• v.26 no.6
• /
• pp.1367-1375
• /
• 2015

Consider the linear growth models for longitudinal data analysis. Several kind of linear growth models are selected such as time-effect and random-effect models as well as a dummy variable included model. In this work, simulation data are generated with normality assumption, and both binormal ROC curve and AUC are obtained and compared for various linear growth models. It is found that ROC curves have different shapes and AUC increase slowly, as values of the covariance increase and the time passes for random-effect models. On the other hand, AUC increases very fast as values of covariance decrease. When the covariance has positive value, we explored that the variances of random-effect models increase and the increment of AUC is smaller than that of AUC for time-effect models. And the increment of AUC for time-effect models is larger than the increment for random-effect models.

• Journal of the korean veterinary medical association
• /
• v.36 no.2
• /
• pp.121-134
• /
• 2000

의학적 진단에서 검사결과가 연속형으로 측정되는 예는 매우 많다. 예를 들어 ELISA검사, 혈청화학적 검사, 방사선 검사 (이 경우에는 음성, 의양성, 양성등의 척도로 표현될 수 있음) 등에서는 적절한 기준을 설정한 후 이 기준점을 근거로 양성과 음성으로 판정하게 된다. 여기에서 한 가지 문제는 기준점 설정에 있다. 소위 정상 혹은 참고범위 (normal or reference range)가 분명히 있는 경우라고 실제 판정에 있어서는 질별이 없음에도 불구하고 검사결과 질병이 있는 것으로 판정할 오류 (혹은 그 반대)가 분명히 존재한다. 본 논문에서는 이러한 상황에서 접근할 수 있는 한가지 방법인 ROC 곡선에 대하여 설명하고자 한다.