• Title/Summary/Keyword: ROC

Search Result 1,035, Processing Time 0.026 seconds

Estimating the AUC of the MROC curve in the presence of measurement errors

  • G, Siva;R, Vishnu Vardhan;Kamath, Asha
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.5
    • /
    • pp.533-545
    • /
    • 2022
  • Collection of data on several variables, especially in the field of medicine, results in the problem of measurement errors. The presence of such measurement errors may influence the outcomes or estimates of the parameter in the model. In classification scenario, the presence of measurement errors will affect the intrinsic cum summary measures of Receiver Operating Characteristic (ROC) curve. In the context of ROC curve, only a few researchers have attempted to study the problem of measurement errors in estimating the area under their respective ROC curves in the framework of univariate setup. In this paper, we work on the estimation of area under the multivariate ROC curve in the presence of measurement errors. The proposed work is supported with a real dataset and simulation studies. Results show that the proposed bias-corrected estimator helps in correcting the AUC with minimum bias and minimum mean square error.

A Comparison of the Interval Estimations for the Difference in Paired Areas under the ROC Curves (대응표본에서 AUC차이에 대한 신뢰구간 추정에 관한 고찰)

  • Kim, Hee-Young
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.275-292
    • /
    • 2010
  • Receiver operating characteristic(ROC) curves can be used to assess the accuracy of tests measured on ordinal or continuous scales. The most commonly used measure for the overall diagnostic accuracy of diagnostic tests is the area under the ROC curve(AUC). When two ROC curves are constructed based on two tests performed on the same individuals, statistical analysis on differences between AUCs must take into account the correlated nature of the data. This article focuses on confidence interval estimation of the difference between paired AUCs. We compare nonparametric, maximum likelihood, bootstrap and generalized pivotal quantity methods, and conduct a monte carlo simulation to investigate the probability coverage and expected length of the four methods.

Accuracy Evaluation of Critical Rainfall for Inundation Using ROC Method (ROC 기법을 이용한 침수유발 한계강우량 정확도 산정)

  • Chu, Kyung Su;Lee, Seok Ho;kang, Dong Ho;Kim, Byung Sik
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2019.05a
    • /
    • pp.367-367
    • /
    • 2019
  • 최근 기후변화로 인해 국지성 호우 및 태풍의 빈도가 빈발하고 및 규모가 커지고 있으며 그로 인한 홍수피해규모는 증가하고 있다. 본 논문에서는 도시 지역의 호우로 인한 침수유발 강우량을 산정하는 기법의 정확도를 산정하는데 목적이 있으며 이를 위해 ROC(Receiver Operation Characteristic Curve) 분석을 이용하였다. 본 논문에서는 분포형 홍수해석 모형인 S-RAT 모형과 2차원 침수해석 모형 FLO-2D을 커플링하여 호우로 인한 침수해석을 실시하였으며 강우시나리오는 설계 강우 200mm의 강우를 10% 간격으로 증가시켜 강우량 대비 침수심 자료를 모의하였다. 모의한 침수심 자료를 이용하여 유역 격자를 $1km{\times}1km$ 별 강우량-침수심 관계곡선식을 제시하였으며 개발된 곡선식을 이용하여 특정 침수심(20cm)을 유발시키는 강우량(한계강우량)을 산정하였다. 정확도 산정은 ROC(Receiver Operation Characteristic Curve) 분석 방법을 이용하여 침수 유무의 적중률에 따른 민감도와 특이도를 이용하여 AUC(Area Under the Curve)의 점수로 정확도를 판단하였다. 본 논문에서는 본 논문에서 제시한 한계강우량의 정확도를 판단하기 위하여 2011년 7월의 사당역 일대 침수사례를 이용하였다. 실제 침수정보가 없어 실제 호우사상과 실제 하수관망을 고려할 수 있는 SWMM 모형을 이용하여 침수분석을 실시하였다. 분석 결과 평균 ROC는 약 0.7로 나타났으며 5 단계의 구분에서 Fair 단계로 적정 수준의 정확도를 확보한 것으로 나타났다.

  • PDF

The Evaluation of CR and DDR chest image using ROC analysis (ROC평가 방법을 이용한 CR과 DDR 흉부 영상의 비교)

  • Park, Yeon-Ok;Jung, Eun-Kyung;Park, Yeon-Jung;Nam, So-Ra;Jung, Ji-Young;Kim, Hee-Joung
    • Journal of the Korean Society of Radiology
    • /
    • v.1 no.1
    • /
    • pp.25-30
    • /
    • 2007
  • ROC(Receiver Operating Characteristic)curve is the method that estimate detected insignificant signal from the human's sense of sight, it has been raised excellent results. In this study, we evaluate image quality and equipment character by obtaining a chest image from CR(Computed Radiography) and DDR(Direct Digital radiography) using the human chest phantom, The parameter of exposure for obtaining chest image was 120 kVp/3.2 mAs and the SID(Source to Image Distance) was 180cm. The images were obtained by CR(AGFA MD 4.0 General plate, JAPAN) and DDR(HOLOGIC nDirect Ray, USA). Using some pieces of Aluminum and stone for expressing regions, then attached them on the heart, lung and thoracic vertebrae of the phantom. 29 persons hold radiology degrees were participated in ROC analysis. As a result of the ROC analysis, TPF(true positive fraction) and FPF(false positive fraction) of DDR and CR are 0.552 and 0.474 and 0.629 and 0.405, respectively. By using the results, the ROC curve of CR has higher image quality than DDR. According to the theory, DDR has the higher image quality than CR in chest X-ray image. But, CR has the higher image quality than DDR. quality of DDR inserted the enhance board. The results confirmed that image post-processing is important element decipherment of clinical.

  • PDF

Evaluation of Short-Term Drought Using Daily Standardized Precipitation Index and ROC Analysis (일 단위 SPI와 ROC 분석을 이용한 단기가뭄의 평가)

  • Yoo, Ji Young;Song, Hoyong;Kim, Tae-Woong;Ahn, Jae-Hyun
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.33 no.5
    • /
    • pp.1851-1860
    • /
    • 2013
  • The Standardized Precipitation Index (SPI) is widely applied to evaluate for meteorological droughts. However, the SPI is limited to capture a drought event with a short duration, expecially shorter than one month. In this study, we proposed a daily SPI (DSPI) as a way to overcome the limitation of the monthly SPI for drought monitoring. In order to objectively assess the ability of the drought reproduction of the DSPI, we performed a receiver operating characteristic (ROC) analysis using the quantified drought records from official reports, newspapers, etc. The results of ROC analysis showed that the DSPI has an ability to reproduce short-term drought compared with other indices. It also showed that the main cause of historical droughts was the shortage of rainfall accumulated during the time period less than 90 days compared with the rainfall of normal years.

ROC evaluation for MLP ANN drought forecasting model (MLP ANN 가뭄 예측 모형에 대한 ROC 평가)

  • Jeong, Min-Su;Kim, Jong-Suk;Jang, Ho-Won;Lee, Joo-Heon
    • Journal of Korea Water Resources Association
    • /
    • v.49 no.10
    • /
    • pp.877-885
    • /
    • 2016
  • In this study, the Standard Precipitation Index(SPI), meteorological drought index, was used to evaluate the temporal and spatial assessment of drought forecasting results for all cross Korea. For the drought forecasting, the Multi Layer Perceptron-Artificial Neural Network (MLP-ANN) was selected and the drought forecasting was performed according to different forecasting lead time for SPI (3) and SPI (6). The precipitation data observed in 59 gaging stations of Korea Meteorological Adminstration (KMA) from 1976~2015. For the performance evaluation of the drought forecasting, the binary classification confusion matrix, such as evaluating the status of drought occurrence based on threshold, was constituted. Then Receiver Operating Characteristics (ROC) score and F score according to conditional probability are computed. As a result of ROC analysis on forecasting performance, drought forecasting performance, of applying the MLP-ANN model, shows satisfactory forecasting results. Consequently, two-month and five-month leading forecasts were possible for SPI (3) and SPI (6), respectively.

Molecular Cloning and Characterization of a Flavanone-3-hydroxylase Gene from Rubus occidentalis L.

  • Lee, Seung Sik;Lee, Eun Mi;An, Byung Chull;Barampuram, Shyamkumar;Kim, Jae-Sung;Cho, Jae-Young;Lee, In-Chul;Chung, Byung Yeoup
    • Journal of Radiation Industry
    • /
    • v.2 no.3
    • /
    • pp.121-128
    • /
    • 2008
  • Flavanone-3-hydroxylase (F3H) is one of the key enzymes for the biosynthesis of flavonals, anthocyanins, catechins and proanthocyanins. F3H catalyzes the $3{\beta}$-hydroxylation of (2S)-flavonones to form (2R, 3R)-dihydroflavonols. In this report, we isolated a full-length cDNA of RocF3H from black raspberry (Rubus occidentalis L.) using a reverse transcriptase-PCR and rapid amplification of the cDNA ends (RACE)-PCR. The full-length cDNA of RocF3H contains a 1,098 bp open reading frame (ORF) encoding a 365 amino acid protein with a calculated molecular weight of about 41.1 kDa and isoelectric point (pI) of 5.45. The genomic DNA analysis revealed that the RocF3H gene had three exons and two introns. Comparison of the deduced amino acid sequence of the RocF3H with other F3Hs revealed that the protein is highly homologous with various plant species. The conserved amino acids ligating the ferrous iron and the residues participating in the 2-oxoglutarate binding (R-X-S) were found in RocF3H at the similar positions to other F3Hs. Southern blot analysis indicated that RocF3H exist a multi-gene family. The isolation of RocF3H gene will be helpful to further study the role of F3H gene in the biosynthesis of flavonoids in R. occidnetalis.

Accuracy evaluation of threshold rainfall impacting pedestrian using ROC (ROC를 이용한 보행에 영향을 미치는 한계강우량의 정확도 평가)

  • Choo, Kyungsu;Kang, Dongho;Kim, Byungsik
    • Journal of Korea Water Resources Association
    • /
    • v.53 no.12
    • /
    • pp.1173-1181
    • /
    • 2020
  • Recently, as local heavy rains occur frequently in a short period of time, economic and social impacts are increasing beyond the simple primary damage. In advanced meteorologically advanced countries, realistic and reliable impact forecasts are conducted by analyzing socio-economic impacts, not information transmission as simple weather forecasts. In this paper, the degree of flooding was derived using the Spatial Runoff Assessment Tool (S-RAT) and FLO-2D models to calculate the threshold rainfall that can affect human walking, and the threshold rainfall of the concept of Grid to Grid (G2G) was calculated. In addition, although it was used a lot in the medical field in the past, a quantitative accuracy analysis was performed through the ROC analysis technique, which is widely used in natural phenomena such as drought or flood and machine learning. As a result of the analysis, the results of the time period similar to that of the actual and simulated immersion were obtained, and as a result of the ROC (Receiver Operating Characteristic) curve, the adequacy of the fair stage was secured with more than 0.7.

ROC Analysis of Diagnostie Performance in Liver Scan (간스캔의 ROC분석에 의한 진단적 평가)

  • Lee, Myung-Chul;Moon, Dae-Hyuk;Koh, Chang-Soon;Matumoto, Toru;Tateno, Yukio
    • The Korean Journal of Nuclear Medicine
    • /
    • v.22 no.1
    • /
    • pp.39-45
    • /
    • 1988
  • To evaluate diagnostic accuracy of liver scintigraphy we analysed liver scans of 143 normal and 258 patients with various liver diseases. Three ROC curves for SOL, liver cirrhosis and diffuse liver disease were fitted using rating methods and areas under the ROC curves and their standard errors were calculated by the trapezoidal rule and the variance of the Wilcoxon statistic suggested by McNeil. We compared these results with that of National Institute of Radiological Science in Japan. 1) The sensitivity of liver scintigraphy was 74.2% in SOL, 71.8% in liver cirrhosis and 34.0% in diffuse liver disease. The specificity was 96.0% in SOL, 94.2% in liver cirrhosis and 87.6% in diffuse liver diasease. 2) ROC curves of SOL and liver cirrhosis approached the upper left-hand corner closer than that of diffuse liver disease. Area (${\pm}$ standard error). under the ROC curve was $0.868{\pm}0.024$ in SOL and $0.867{\pm}0.028$ in liver cirrhosis. These were significantly higher than $0.658{\pm}0.043$ in diffuse liver disease. 3) There was no interobserver difference in terms of ROC curves. But low sensitivty and high specificity of authors' SOL diagnosis suggested we used more strict decision threshold.

  • PDF

Roc10, a Rice HD-Zip transcription factor gene, modulates lignin biosynthesis for drought tolerance

  • Bang, Seung Woon;Lee, Dong-Keun;Jung, Harin;Chung, Pil Joong;Kim, Youn Shic;Choi, Yang Do;Suh, Joo-Won;Kim, Ju-Kon
    • Proceedings of the Korean Society of Crop Science Conference
    • /
    • 2017.06a
    • /
    • pp.159-159
    • /
    • 2017
  • Drought, a common environmental constraint, induces a range of physiological, biochemical and molecular changes in plants, and can cause severe reductions in crop yield. Consequently, understanding the molecular mechanisms of drought tolerance is an important step towards crop biotechnology. Here, we report that the rice (Oryza sativa) homeodomain-leucine zipper class IV transcription factor gene, ${\underline{R}ice}$ ${\underline{o}utermost}$ ${\underline{c}ell-specific}$ gene 10 (Roc10), enhances drought tolerance and grain yield by increasing lignin accumulation in ground tissues. Overexpression of Roc10 in rice significantly increased drought tolerance at the vegetative stages of growth and promoted both more effective photosynthesis and a reduction in water loss rate, compared with non-transgenic controls or RNAi transgenic plants. Importantly, Roc10 overexpressing plants had a higher drought tolerance at the reproductive stage of growth and a higher grain yield compared with the controls under field-drought conditions. Roc10 is mainly expressed in outer cell layers including the epidermis and the vasculature of the shoots, which coincides with areas of cell wall lignification. Roc10 overexpression elevated the expression levels of lignin biosynthetic genes in shoots, with a concomitant increase in the accumulation of lignin, while the overexpression and RNAi lines showed opposite patterns of lignin accumulation. We identified downstream target genes of Roc10 by performing RNA-seq and chromatin immunoprecipitation (ChIP)-seq analyses of shoot tissues. Roc10 was found to directly bind to the promoter of PEROXIDASEN/PEROXIDASE38, a key gene in lignin biosynthesis. Together, our findings suggest that Roc10 confers drought stress tolerance by promoting lignin biosynthesis in ground tissues.

  • PDF