• Title/Summary/Keyword: ROC

Search Result 1,035, Processing Time 0.025 seconds

Alternative Optimal Threshold Criteria: MFR (대안적인 분류기준: 오분류율곱)

  • Hong, Chong Sun;Kim, Hyomin Alex;Kim, Dong Kyu
    • The Korean Journal of Applied Statistics
    • /
    • v.27 no.5
    • /
    • pp.773-786
    • /
    • 2014
  • We propose the multiplication of false rates (MFR) which is a classification accuracy criteria and an area type of rectangle from ROC curve. Optimal threshold obtained using MFR is compared with other criteria in terms of classification performance. Their optimal thresholds for various distribution functions are also found; consequently, some properties and advantages of MFR are discussed by comparing FNR and FPR corresponding to optimal thresholds. Based on general cost function, cost ratios of optimal thresholds are computed using various classification criteria. The cost ratios for cost curves are observed so that the advantages of MFR are explored. Furthermore, the de nition of MFR is extended to multi-dimensional ROC analysis and the relations of classification criteria are also discussed.

Image saliency detection based on geodesic-like and boundary contrast maps

  • Guo, Yingchun;Liu, Yi;Ma, Runxin
    • ETRI Journal
    • /
    • v.41 no.6
    • /
    • pp.797-810
    • /
    • 2019
  • Image saliency detection is the basis of perceptual image processing, which is significant to subsequent image processing methods. Most saliency detection methods can detect only a single object with a high-contrast background, but they have no effect on the extraction of a salient object from images with complex low-contrast backgrounds. With the prior knowledge, this paper proposes a method for detecting salient objects by combining the boundary contrast map and the geodesics-like maps. This method can highlight the foreground uniformly and extract the salient objects efficiently in images with low-contrast backgrounds. The classical receiver operating characteristics (ROC) curve, which compares the salient map with the ground truth map, does not reflect the human perception. An ROC curve with distance (distance receiver operating characteristic, DROC) is proposed in this paper, which takes the ROC curve closer to the human subjective perception. Experiments on three benchmark datasets and three low-contrast image datasets, with four evaluation methods including DROC, show that on comparing the eight state-of-the-art approaches, the proposed approach performs well.

Determination of cut-off value by receiver operating characteristic curve of norquetiapine and 9-hydroxyrisperidone concentrations in urine measured by LC-MS/MS

  • Kim, Seon Yeong;Shin, Dong Won;Kim, Jin Young
    • Analytical Science and Technology
    • /
    • v.34 no.2
    • /
    • pp.78-86
    • /
    • 2021
  • The objective of this study was to investigate urinary cut-off concentrations of quetiapine and risperidone for distinction between normal and abnormal/non-takers who were being placed on probation. Liquid chromatography-tandem mass spectrometric (LC-MS/MS) method was employed for determination of antipsychotic drugs in urine from mentally disordered probationers. The optimal cut-off values of antipsychotic drugs were calculated using receiver operating characteristic (ROC) curve analysis. The sensitivity and specificity of the method for the detection of antipsychotic drugs in urine were subsequently evaluated. The area under the ROC curve (AUC) was 0.927 for norquetiapine and 0.791 for 9-hydroxyrisperidone, respectively. These antipsychotic drugs are classified readily in the ROC curve analysis. The cut-off values for distinguishing regular and irregular/non-takers were 39.1 ng/mL for norquetiapine and 67.9 ng/mL for 9-hydroxyrisperidone, respectively. The results of this study suggest the cut-off values of quetiapine and risperidone were highly useful to distinguish regular takers from irregular/non-takers.

Bayesian hierarchical model for the estimation of proper receiver operating characteristic curves using stochastic ordering

  • Jang, Eun Jin;Kim, Dal Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.26 no.2
    • /
    • pp.205-216
    • /
    • 2019
  • Diagnostic tests in medical fields detect or diagnose a disease with results measured by continuous or discrete ordinal data. The performance of a diagnostic test is summarized using the receiver operating characteristic (ROC) curve and the area under the curve (AUC). The diagnostic test is considered clinically useful if the outcomes in actually-positive cases are higher than actually-negative cases and the ROC curve is concave. In this study, we apply the stochastic ordering method in a Bayesian hierarchical model to estimate the proper ROC curve and AUC when the diagnostic test results are measured in discrete ordinal data. We compare the conventional binormal model and binormal model under stochastic ordering. The simulation results and real data analysis for breast cancer indicate that the binormal model under stochastic ordering can be used to estimate the proper ROC curve with a small bias even though the sample sizes were small or the sample size of actually-negative cases varied from actually-positive cases. Therefore, it is appropriate to consider the binormal model under stochastic ordering in the presence of large differences for a sample size between actually-negative and actually-positive groups.

Drought Monitoring Accuracy Evaluation through ROC Analysis for Satellite Image based Drought Indices (ROC 분석에 의한 위성기반 가뭄지수의 모니터링 정확도 평가)

  • Park, Seo Yeon;Seo, Chan Yang;Hong, Hyun Pyo;Lee, Joo Heon
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2017.05a
    • /
    • pp.149-149
    • /
    • 2017
  • 최근 지구온난화에 따른 기후변화로 인하여 전 세계적으로 가뭄, 홍수 등의 극한 기후사상이 발생하고 있다. 그 중 가뭄의 발생은 다른 수문학적 재해와는 다르게 장기간에 걸쳐서 발생하고 그 피해 범위가 광범위하게 나타난다. 또한, 기후변화를 고려한 다양한 기후예측모델의 예측 결과는 가뭄 재해가 앞으로 더 심각해질 수 있다는 전망을 하고 있다는 점에서 그 심각성이 더욱 대두되고 있다. 이러한 가뭄을 효과적으로 감시하고 평가할 수 있는 방안이 필요로 하게 되며, 기존의 가뭄지수(drought index)의 단점을 보완할 수 있는 수단으로 높은 활용성을 갖고 있는 위성영상자료를 활용한 효과적인 가뭄모니터링 기술의 개발이 요구되고 있다. 본 연구에서는 가뭄을 시 공간적으로 모니터링하기 위해서 위성자료를 활용하였으며, Terra/Aqua 위성의 MODIS 영상자료 와 TRMM 및 GPM 위성의 강우자료를 활용하여 가뭄을 감시할 수 있는 가뭄지수 인 VHI(Vegetation Health Index), DSI(Drought Severity Index), Water Balance Method를 산정하였다. 산정된 지수의 정확도를 정량적으로 평가하기 위하여 가뭄 피해조사 결과에 의한 2001년 및 2014-2015년 농업적/수문학적 가뭄피해지역과 위성기반 가뭄지수에 의한 가뭄모니터링 결과 간의 ROC 분석을 통해 위성자료 기반 가뭄감시의 적용 가능성을 평가하였다. 본 연구의 결과를 통하여 위성영상 자료를 통하여 산정되는 가뭄지수의 기상학적/농업적/수문학적 가뭄감시 기능 및 적용성이 정량적으로 평가될 수 있을 것으로 판단된다.

  • PDF

Receiver Operating Characteristic Curve Analysis of SEER Medulloblastoma and Primitive Neuroectodermal Tumor (PNET) Outcome Data: Identification and Optimization of Predictive Models

  • Cheung, Min Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.16
    • /
    • pp.6781-6785
    • /
    • 2014
  • Purpose: This study used receiver operating characteristic curves to analyze Surveillance, Epidemiology and End Results (SEER) medulloblastoma (MB) and primitive neuroectodermal tumor (PNET) outcome data. The aim of this study was to identify and optimize predictive outcome models. Materials and Methods: Patients diagnosed from 1973 to 2009 were selected for analysis of socio-economic, staging and treatment factors available in the SEER database for MB and PNET. For the risk modeling, each factor was fitted by a generalized linear model to predict the outcome (brain cancer specific death, yes/no). The area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. A Monte Carlo algorithm was used to estimate the modeling errors. Results: There were 3,702 patients included in this study. The mean follow up time (S.D.) was 73.7 (86.2) months. Some 40% of the patients were female and the mean (S.D.) age was 16.5 (16.6) years. There were more adult MB/PNET patients listed from SEER data than pediatric and young adult patients. Only 12% of patients were staged. The SEER staging has the highest ROC (S.D.) area of 0.55 (0.05) among the factors tested. We simplified the 3-layered risk levels (local, regional, distant) to a simpler non-metastatic (I and II) versus metastatic (III) model. The ROC area (S.D.) of the 2-tiered model was 0.57 (0.04). Conclusions: ROC analysis optimized the most predictive SEER staging model. The high under staging rate may have prevented patients from selecting definitive radiotherapy after surgery.

Application of Concurrent Engineering for Conceptual design of a Future Main Battle Tank (차세대 주력전차의 개념설계를 위한 동시공학의 적용)

  • 김진우;소한균
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.2 no.1
    • /
    • pp.38-60
    • /
    • 1999
  • The main objective of this study is systemization of the technique of ROC quantification and optimization of baseline design by applying CE principle to the acquisition process of a weapon system. QFD and TOA techniques can be employed to a good working example of the conceptual design of a future main battle tank. In this paper, Product Planning Phase, the first phase of four QFD phases, is deployed in terms of eight steps including customer requirements and final product control characteristics. TOA is carried out considering only combat weight. In order to perform combat weight analysis and performance TOA, Preliminary Configuration Synthesis Methodology is used. Preliminary Configuration Synthesis Methodology employs the method of least squares and described linear equations of weight interrelation equation for each component of tank. As a result of QFD based upon the ROC, it was cleared that armor piercing power, main armament, type of ammunition, cruising range, combat weight, armor protection, power loading, threat detection and cost are primary factors influencing design and that combat weight is the most dominant one. The results of TOA based on the combat weight constraint show that 5100 lb reduction was required to satisfy the ROC. The baseline design of a future main battle tank is illustrated with assumption that all phases of QFD are employed to development and production process of subsystems, components, and parts of main battle tank. TOA is applied in iterative process between initial baseline design and ROC. The detailed design of each component is illustrated for a future main battle tank.

  • PDF

A Study on the Diagnostic Detection Ability of the Artificial Proximal Caries by Digora$\textregistered$ (Digora$\textregistered$ 영상시스템을 이용한 인접면 인공 치아우식병소의 진단능에 관한 연구)

  • Oh Kyung-Ran;Choi Eui-Hwan;Kim Jae-Duk
    • Journal of Korean Academy of Oral and Maxillofacial Radiology
    • /
    • v.28 no.2
    • /
    • pp.415-433
    • /
    • 1998
  • Digora system is an intraoral indirect digital radiography system utilizing storage phosphor image plate. It has wide dynamic range which allows it to decrease the patient s exposure time and may increase diagnostic ability through image processing (such as edge enhancement, grey scale conversion, brightness change, and contrast enhancement). And also, it can transmit and storage image information. The purpose of this study was to evaluate the diagnostic ability of artificial proximal caries between Conventional radiograph and Digora images(unenhanced image, brightness & contrast controlled image, and edge enhanced image). ROC(Receiver Operating Characteristic) analysis, paired t-tests, and F-tests were done for the statistical evaluation of detectability. The following results were acquired: 1. In Grade I lesions, the mean ROC areas of Conventional radiograph, Digora unenhanced image, Digora controlled image, and Digora edge enhanced image were 0.953, 0.933, 0.965, 0.978 (p>0.05). 2. In Grade II lesions, the mean ROC areas of Conventional radiograph, Digora unenhanced image, Digora controlled image, and Digora edge enhanced image were 0.969, 0.964, 0.988, 0.994. Among theses areas, there was just statistical significance between Diagnostic abilities of Digora edge enhanced image and Conventional radiograph (p<0.05). 3. In the Interobserver variability, the ROC curve areas of Digora edge enhanced image was lowermost in these areas, regardless of the Carious lesion depths. In conclusion, intraoral indirect digital system, Digora system, has the potential possibility as an alternative of Conventional radiograph in the diagnosis of proximal caries.

  • PDF

Computer Aided Diagnosis Applications for the Differential Diagnosis of Infarction: Apply on Brain CT Image (뇌경색 감별진단을 위한 컴퓨터보조진단 응용: Brain CT Images 적용)

  • Park, Hyong-Hu;Cho, Mun-Joo;Im, In-Chul;Lee, Jin-Soo
    • Journal of the Korean Society of Radiology
    • /
    • v.10 no.8
    • /
    • pp.645-652
    • /
    • 2016
  • In this study, based on the analysis of texture feature values of statistical properties. And we examined the normal and the applicability of the computer-aided diagnosis of cerebral infarction in the brain computed tomography images. The experiment was analyzed to evaluate the ROC curve recognition rate of disease using six parameters representing the feature values of the texture. As a result, it showed average mean 88%, variance 92%, relative smoothness 94%, uniformity of 88%, a high disease recognition rate of entropy 84%. However, it showed a slightly lower disease recognition rate and 58% for skewness. In the analysis using ROC curve, the area under the curve for each parameter indicates 0.886 (p = 0.0001) or more, resulted in a meaningful recognition of the disease. Further, to determine the cut-off values for each parameter are determined to be the prediction of disease through the computer-aided diagnosis.

A Management Procedure of Required Operational Capability for 'Low-cost and High-efficiency' Weapon Systems Development ('저비용 고효율'의 무기체계 개발을 위한 군 작전요구성능 관리절차 개선 방안)

  • Lee, Ok-Kyu;Kang, Seok-Joong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.1C
    • /
    • pp.109-117
    • /
    • 2012
  • Studying the major wars of the past seventy years, the most fundamental change is the transition of weapon systems to one of convergence and cutting edge / state of the arts technology. Such transition is creating a need for drastic reforms of the weapon systems development process especially in areas of / in regards to effective utilization of IT, reduction of development period, precise establishing of operational concept and, management of required operational capability(ROC). In particular, establishing an accurate operational concept for a new weapon system and efficient management of ROC based on this operational concept is a prerequisite for a low-cost and high-efficiency weapon systems development and in the end, a successful construction of military forces. This paper examines the current management procedure of the ROC of the Korean military and proposes improvements to the procedure while taking into consideration issues of elicitation, analysis and validation of requirements engineering.