• The Korean Journal of Applied Statistics
• /
• v.27 no.5
• /
• pp.773-786
• /
• 2014

We propose the multiplication of false rates (MFR) which is a classification accuracy criteria and an area type of rectangle from ROC curve. Optimal threshold obtained using MFR is compared with other criteria in terms of classification performance. Their optimal thresholds for various distribution functions are also found; consequently, some properties and advantages of MFR are discussed by comparing FNR and FPR corresponding to optimal thresholds. Based on general cost function, cost ratios of optimal thresholds are computed using various classification criteria. The cost ratios for cost curves are observed so that the advantages of MFR are explored. Furthermore, the de nition of MFR is extended to multi-dimensional ROC analysis and the relations of classification criteria are also discussed.

• Analytical Science and Technology
• /
• v.34 no.2
• /
• pp.78-86
• /
• 2021

The objective of this study was to investigate urinary cut-off concentrations of quetiapine and risperidone for distinction between normal and abnormal/non-takers who were being placed on probation. Liquid chromatography-tandem mass spectrometric (LC-MS/MS) method was employed for determination of antipsychotic drugs in urine from mentally disordered probationers. The optimal cut-off values of antipsychotic drugs were calculated using receiver operating characteristic (ROC) curve analysis. The sensitivity and specificity of the method for the detection of antipsychotic drugs in urine were subsequently evaluated. The area under the ROC curve (AUC) was 0.927 for norquetiapine and 0.791 for 9-hydroxyrisperidone, respectively. These antipsychotic drugs are classified readily in the ROC curve analysis. The cut-off values for distinguishing regular and irregular/non-takers were 39.1 ng/mL for norquetiapine and 67.9 ng/mL for 9-hydroxyrisperidone, respectively. The results of this study suggest the cut-off values of quetiapine and risperidone were highly useful to distinguish regular takers from irregular/non-takers.

• Journal of Korea Water Resources Association
• /
• v.49 no.10
• /
• pp.877-885
• /
• 2016

In this study, the Standard Precipitation Index(SPI), meteorological drought index, was used to evaluate the temporal and spatial assessment of drought forecasting results for all cross Korea. For the drought forecasting, the Multi Layer Perceptron-Artificial Neural Network (MLP-ANN) was selected and the drought forecasting was performed according to different forecasting lead time for SPI (3) and SPI (6). The precipitation data observed in 59 gaging stations of Korea Meteorological Adminstration (KMA) from 1976~2015. For the performance evaluation of the drought forecasting, the binary classification confusion matrix, such as evaluating the status of drought occurrence based on threshold, was constituted. Then Receiver Operating Characteristics (ROC) score and F score according to conditional probability are computed. As a result of ROC analysis on forecasting performance, drought forecasting performance, of applying the MLP-ANN model, shows satisfactory forecasting results. Consequently, two-month and five-month leading forecasts were possible for SPI (3) and SPI (6), respectively.

• The Korean Journal of Nuclear Medicine
• /
• v.22 no.1
• /
• pp.39-45
• /
• 1988

To evaluate diagnostic accuracy of liver scintigraphy we analysed liver scans of 143 normal and 258 patients with various liver diseases. Three ROC curves for SOL, liver cirrhosis and diffuse liver disease were fitted using rating methods and areas under the ROC curves and their standard errors were calculated by the trapezoidal rule and the variance of the Wilcoxon statistic suggested by McNeil. We compared these results with that of National Institute of Radiological Science in Japan. 1) The sensitivity of liver scintigraphy was 74.2% in SOL, 71.8% in liver cirrhosis and 34.0% in diffuse liver disease. The specificity was 96.0% in SOL, 94.2% in liver cirrhosis and 87.6% in diffuse liver diasease. 2) ROC curves of SOL and liver cirrhosis approached the upper left-hand corner closer than that of diffuse liver disease. Area (${\pm}$ standard error). under the ROC curve was $0.868{\pm}0.024$ in SOL and $0.867{\pm}0.028$ in liver cirrhosis. These were significantly higher than $0.658{\pm}0.043$ in diffuse liver disease. 3) There was no interobserver difference in terms of ROC curves. But low sensitivty and high specificity of authors' SOL diagnosis suggested we used more strict decision threshold.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2020.06a
• /
• pp.145-145
• /
• 2020

가뭄은 과거부터 현재까지 국내뿐만 아니라 국외에서도 지속적으로 발생하고 있으며 가뭄피해를 줄이기 위하여 많은 연구가 과거에 수행되었고 현재까지도 진행되고 있다.(강동호 외 2명, 2019명) 가뭄은 일반적으로 강수량의 부족이 원인이 되어 나타나며 홍수와 달리 장기간에 걸쳐 광범위한 지역에 피해가 나타나는 특징이 있다. 그렇기에 가뭄은 감시 및 예측에 대한 어려움이 존재하며 우리나라에서도 가뭄으로 인해 수자원 공급 긴장상태를 경험하는 빈도가 점차 증가하고 있는 추세이다.(유지영 외 3명, 2016) 적조현상은 특정 조류의 폭발적인 증식으로 해수가 붉은 빛을 띄며 용존산소량을 부족하게 만들어 해양 생태계를 파괴하는 현상이다. 적조현상은 1990년대 이후 대규모 적조가 발생하여 1995년에는 적조로 인해 약 764억의 손실이 발생한 사례가 있다.(연합뉴스, 2019.09) 이후에도 적조현상은 점점 광역화, 장기화, 고밀도화 되면서 연평균 110억 이상의 피해를 지속적으로 주고 있다. 본 연구에서는 대상 지역을 대한민국 완도로 설정 하였다. 섬이라는 지역의 특성 상 가뭄이 발생하면 식수원의 공급이 어렵고 평시에도 물을 아끼기 위한 노력이 끊이지 않는 곳이다. 실제로 완도는 우리나라에서 가장 많은 피해이력이 있는 지역이다. 또 2016년 완도에서는 적조로 인해 전복이 집단 폐사하며 358억의 피해를 입은 사례가 있다.(중앙일보, 2016.09) 그렇기에 완도지역을 대상 지역으로 하여 비강우의 장기화 등의 이유로 나타나는 가뭄을 기상학적 가뭄지수 SPI를 활용하여 분석하고 ROC 분석을 통해 수온의 상승 시 나타나는 적조현상과의 관계를 분석함으로서 적조현상이 발생하는 한 척도로 가뭄의 발생 및 장기화를 생각 할 수 있는지 판단하고자 한다.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.37 no.4
• /
• pp.669-680
• /
• 2017

This study evaluated the consistency of the standard flow to forecast low-flow based on various drought indices. The data used in this study were streamflow data at the Gurye2 station located in the Seomjin River and the Angang station located in the Hyeongsan River, as well as rainfall data of nearby weather stations (Namwon and Pohang). Using streamflow data, the streamflow accumulation drought index (SADI) was developed in this study to represent the hydrological drought condition. For SADI calculations, the threshold of drought was determined by a Change-Point analysis of the flow pattern and a reduction factor was estimated based on the kernel density function. Standardized runoff index (SRI) and standardized precipitation index (SPI) were also calculated to compared with the SADI. SRI and SPI were calculated for the 30-, 90-, 180-, and 270-day period and then an ROC curve analysis was performed to determine the appropriate time-period which has the highest consistency with the standard flow. The result of ROC curve analysis indicated that for the Seomjin River-Gurye2 station SADI_C3, SRI30, SADI_C1, SADI_C2, and SPI90 were confirmed in oder of having high consistency with standard flow under the attention stage and for the Hyeongsan River-Angang station, SADI_C3, SADI_C1, SPI270, SRI30, and SADI_C2 have order of high consistency with standard flow under the attention stage.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.1C
• /
• pp.109-117
• /
• 2012

Studying the major wars of the past seventy years, the most fundamental change is the transition of weapon systems to one of convergence and cutting edge / state of the arts technology. Such transition is creating a need for drastic reforms of the weapon systems development process especially in areas of / in regards to effective utilization of IT, reduction of development period, precise establishing of operational concept and, management of required operational capability(ROC). In particular, establishing an accurate operational concept for a new weapon system and efficient management of ROC based on this operational concept is a prerequisite for a low-cost and high-efficiency weapon systems development and in the end, a successful construction of military forces. This paper examines the current management procedure of the ROC of the Korean military and proposes improvements to the procedure while taking into consideration issues of elicitation, analysis and validation of requirements engineering.

• Journal of Korea Water Resources Association
• /
• v.44 no.8
• /
• pp.639-652
• /
• 2011

In this study, the suitability of drought indices was analyzed using the quantified drought records from official reports, newspapers and drought indices estimated using precipitation and air temperature data of 69 weather stations from 1973 to 2009. Test statistics of the suitability of meteorological drought indices were evaluated using the ROC analysis. Results demonstrated that PN shows the best relationships with drought records. SPI3 and Deciles Distribution Ratio also show good relationships with drought records and their variability according to the administrative divisions is relatively small. Results of the analysis of the spatial and temporal variability of drought and the accuracy of the drought indices can be used to evaluate the accuracy of drought indices in drought monitoring and prediction, and to select the best index in drought management.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.45 no.6
• /
• pp.179-186
• /
• 2008

In this paper we analyse the effects of Bayesian algorithm in teaming class imbalance problems and compare the performance evaluation methods. The teaming performance of the Bayesian algorithm is evaluated over the class imbalance problems generated by priori data distribution, imbalance data rate and discrimination complexity. The experimental results are calculated by the AUC(Area Under the Curve) values of both ROC(Receiver Operator Characteristic) and PR(Precision-Recall) evaluation measures and compared according to imbalance data rate and discrimination complexity. In comparison and analysis, the Bayesian algorithm suffers from the imbalance rate, as the same result in the reported researches, and the data overlapping caused by discrimination complexity is the another factor that hampers the learning performance. As the discrimination complexity and class imbalance rate of the problems increase, the learning performance of the AUC of a PR measure is much more variant than that of the AUC of a ROC measure. But the performances of both measures are similar with the low discrimination complexity and class imbalance rate of the problems. The experimental results show 4hat the AUC of a PR measure is more proper in evaluating the learning of class imbalance problem and furthermore gets the benefit in designing the optimal learning model considering a misclassification cost.

• Journal of the Korean Data and Information Science Society
• /
• v.28 no.2
• /
• pp.349-359
• /
• 2017

In this paper, we conducted survival analyses by fitting the Cox proportional hazards model to stage III proximal colon cancer data obtained from the Surveillance, Epidemiology, and End Results program of the National Cancer Institute. We investigated the effect of covariates on the hazard function for death from proximal colon cancer in stage III with surgery performed and estimated the survival probability for a patient with specific covariates. We showed that the proportional hazards assumption is satisfied for covariates that were used to analyses, using a test based on the Schoenfeld residuals and plots of the Schoenfeld residuals and $log[-log\{{\hat{S}}(t)\}]$. We evaluated the model calibration and discriminatory accuracy by calibration plot and time-dependent area under the ROC curve, which were calculated using 10-fold cross validation.