• Title/Summary/Keyword: ROC Curve

Search Result 593, Processing Time 0.024 seconds

Application of Computer-Aided Diagnosis for the Differential Diagnosis of Fatty Liver in Computed Tomography Image (전산화단층촬영 영상에서 지방간의 감별진단을 위한 컴퓨터보조진단의 응용)

  • Park, Hyong-Hu;Lee, Jin-Soo
    • Journal of the Korean Society of Radiology
    • /
    • v.10 no.6
    • /
    • pp.443-450
    • /
    • 2016
  • In this study, we are using a computer tomography image of the abdomen, as an experimental linear research for the image of the fatty liver patients texture features analysis and computer-aided diagnosis system of implementation using the ROC curve analysis, from the computer tomography image. We tried to provide an objective and reliable diagnostic information of fatty liver to the doctor. Experiments are usually a fatty liver, via the wavelet transform of the abdominal computed tomography images are configured with the experimental image section, shows the results of statistical analysis on six parameters indicating a feature value of the texture. As a result, the entropy, average luminance, strain rate is shown a relatively high recognition rate of 90% or more, the control also, flatness, uniformity showed relatively low recognition rate of about 70%. ROC curve analysis of six parameters are all shown to 0.900 (p = 0.0001) or more, showed meaningful results in the recognition of the disease. Also, to determine the cut-off value for the prediction of disease six parameters. These results are applicable from future abdominal computed tomography images as a preliminary diagnostic article of diseases automatic detection and eventual diagnosis.

Interpretation of Receiver Operating Characteristics (ROC) (ROC(receiver operating characteristics) 해석)

  • Kim Jae-Duk
    • Imaging Science in Dentistry
    • /
    • v.30 no.3
    • /
    • pp.155-158
    • /
    • 2000
  • The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

  • PDF

The Evaluation of CR and DDR chest image using ROC analysis (ROC평가 방법을 이용한 CR과 DDR 흉부 영상의 비교)

  • Park, Yeon-Ok;Jung, Eun-Kyung;Park, Yeon-Jung;Nam, So-Ra;Jung, Ji-Young;Kim, Hee-Joung
    • Journal of the Korean Society of Radiology
    • /
    • v.1 no.1
    • /
    • pp.25-30
    • /
    • 2007
  • ROC(Receiver Operating Characteristic)curve is the method that estimate detected insignificant signal from the human's sense of sight, it has been raised excellent results. In this study, we evaluate image quality and equipment character by obtaining a chest image from CR(Computed Radiography) and DDR(Direct Digital radiography) using the human chest phantom, The parameter of exposure for obtaining chest image was 120 kVp/3.2 mAs and the SID(Source to Image Distance) was 180cm. The images were obtained by CR(AGFA MD 4.0 General plate, JAPAN) and DDR(HOLOGIC nDirect Ray, USA). Using some pieces of Aluminum and stone for expressing regions, then attached them on the heart, lung and thoracic vertebrae of the phantom. 29 persons hold radiology degrees were participated in ROC analysis. As a result of the ROC analysis, TPF(true positive fraction) and FPF(false positive fraction) of DDR and CR are 0.552 and 0.474 and 0.629 and 0.405, respectively. By using the results, the ROC curve of CR has higher image quality than DDR. According to the theory, DDR has the higher image quality than CR in chest X-ray image. But, CR has the higher image quality than DDR. quality of DDR inserted the enhance board. The results confirmed that image post-processing is important element decipherment of clinical.

  • PDF

Odds curve and optimal threshold (오즈 곡선과 최적분류점)

  • Hong, Chong Sun;Oh, Tae Gyu;Oh, Se Hyeon
    • The Korean Journal of Applied Statistics
    • /
    • v.34 no.5
    • /
    • pp.807-822
    • /
    • 2021
  • Various accuracy measures that can be explained on the odds curve are discussed, and an alternative accuracy measure, the maximum square, is proposed based on the characteristics of the odds curve. Thresholds corresponding to these accuracy measures are obtained by considering various probability distribution functions and an illustrative example. Their characteristics are discussed while comparing many kinds of statistics measuring thresholds. Therefore, we can conclude that optimal thresholds could be explored from the odds curve, similar to the ROC curve, and that the maximum square measure can be used as a good accuracy measure that can improve the performance of the binary classification model.

AUC and VUS using truncated distributions (절단함수를 이용한 AUC와 VUS)

  • Hong, Chong Sun;Hong, Seong Hyuk
    • The Korean Journal of Applied Statistics
    • /
    • v.32 no.4
    • /
    • pp.593-605
    • /
    • 2019
  • Significant literature exists on the area under the ROC curve (AUC) and the volume under the ROC surface (VUS) which are statistical measures of the discriminant power of classification models. Whereas the partial AUC is restricted on the false positive rate, the two-way partial AUC is restricted on both the false positive rate and true positive rate, which could be more efficient and accurate than partial AUC. The two-way partial AUC was suggested as more efficient and accurate than the partial AUC. Partial VUS as well as the three-way partial VUS were also developed for the ROC surface. A proposed AUC is expressed in this paper with probability and integration using two truncated distribution functions restricted on both the false positive rate and true positive rate. It is also found that this AUC has a relation with the two-way partial AUC. The three-way partial VUS for the ROC surface is also related to the VUS using truncated distribution functions. These AUC and VUS are represented and estimated in terms of Mann-Whitney statistics. Their parametric and non-parametric estimation methods are explored based on normal distributions and random samples.

VUS and HUM Represented with Mann-Whitney Statistic

  • Hong, Chong Sun;Cho, Min Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.22 no.3
    • /
    • pp.223-232
    • /
    • 2015
  • The area under the ROC curve (AUC), the volume under the ROC surface (VUS) and the hypervolume under the ROC manifold (HUM) are defined and interpreted with probability that measures the discriminant power of classification models. AUC, VUS and HUM are expressed with the summation and integration notations for discrete and continuous random variables, respectively. AUC for discrete two random samples is represented as the nonparametric Mann-Whitney statistic. In this work, we define conditional Mann-Whitney statistics to compare more than two discrete random samples as well as propose that VUS and HUM are represented as functions of the conditional Mann-Whitney statistics. Three and four discrete random samples with some tie values are generated. Values of VUS and HUM are obtained using the proposed statistic. The values of VUS and HUM are identical with those obtained by definition; therefore, both VUS and HUM could be represented with conditional Mann-Whitney statistics proposed in this paper.

Receiver Operating Characteristic Curve Analysis of SEER Medulloblastoma and Primitive Neuroectodermal Tumor (PNET) Outcome Data: Identification and Optimization of Predictive Models

  • Cheung, Min Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.16
    • /
    • pp.6781-6785
    • /
    • 2014
  • Purpose: This study used receiver operating characteristic curves to analyze Surveillance, Epidemiology and End Results (SEER) medulloblastoma (MB) and primitive neuroectodermal tumor (PNET) outcome data. The aim of this study was to identify and optimize predictive outcome models. Materials and Methods: Patients diagnosed from 1973 to 2009 were selected for analysis of socio-economic, staging and treatment factors available in the SEER database for MB and PNET. For the risk modeling, each factor was fitted by a generalized linear model to predict the outcome (brain cancer specific death, yes/no). The area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. A Monte Carlo algorithm was used to estimate the modeling errors. Results: There were 3,702 patients included in this study. The mean follow up time (S.D.) was 73.7 (86.2) months. Some 40% of the patients were female and the mean (S.D.) age was 16.5 (16.6) years. There were more adult MB/PNET patients listed from SEER data than pediatric and young adult patients. Only 12% of patients were staged. The SEER staging has the highest ROC (S.D.) area of 0.55 (0.05) among the factors tested. We simplified the 3-layered risk levels (local, regional, distant) to a simpler non-metastatic (I and II) versus metastatic (III) model. The ROC area (S.D.) of the 2-tiered model was 0.57 (0.04). Conclusions: ROC analysis optimized the most predictive SEER staging model. The high under staging rate may have prevented patients from selecting definitive radiotherapy after surgery.

A Study on the Diagnostic Detection Ability of the Artificial Proximal Caries by Digora$\textregistered$ (Digora$\textregistered$ 영상시스템을 이용한 인접면 인공 치아우식병소의 진단능에 관한 연구)

  • Oh Kyung-Ran;Choi Eui-Hwan;Kim Jae-Duk
    • Journal of Korean Academy of Oral and Maxillofacial Radiology
    • /
    • v.28 no.2
    • /
    • pp.415-433
    • /
    • 1998
  • Digora system is an intraoral indirect digital radiography system utilizing storage phosphor image plate. It has wide dynamic range which allows it to decrease the patient s exposure time and may increase diagnostic ability through image processing (such as edge enhancement, grey scale conversion, brightness change, and contrast enhancement). And also, it can transmit and storage image information. The purpose of this study was to evaluate the diagnostic ability of artificial proximal caries between Conventional radiograph and Digora images(unenhanced image, brightness & contrast controlled image, and edge enhanced image). ROC(Receiver Operating Characteristic) analysis, paired t-tests, and F-tests were done for the statistical evaluation of detectability. The following results were acquired: 1. In Grade I lesions, the mean ROC areas of Conventional radiograph, Digora unenhanced image, Digora controlled image, and Digora edge enhanced image were 0.953, 0.933, 0.965, 0.978 (p>0.05). 2. In Grade II lesions, the mean ROC areas of Conventional radiograph, Digora unenhanced image, Digora controlled image, and Digora edge enhanced image were 0.969, 0.964, 0.988, 0.994. Among theses areas, there was just statistical significance between Diagnostic abilities of Digora edge enhanced image and Conventional radiograph (p<0.05). 3. In the Interobserver variability, the ROC curve areas of Digora edge enhanced image was lowermost in these areas, regardless of the Carious lesion depths. In conclusion, intraoral indirect digital system, Digora system, has the potential possibility as an alternative of Conventional radiograph in the diagnosis of proximal caries.

  • PDF

Analysis of Riding Quality Acceptability and Characteristics of Expressway Users and Evaluation of MRI Thresholds using Receiver Operating Characteristic curves (고속도로 이용자의 승차감 평가특성 및 만족도 분석과 ROC 곡선을 이용한 평탄성 관리기준 적정성 검토)

  • Lee, Jaehoon;Sohn, Ducksu;Ryu, SungWoo;Kim, Youngwon;Park, Junyoung
    • International Journal of Highway Engineering
    • /
    • v.20 no.2
    • /
    • pp.35-44
    • /
    • 2018
  • PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

Application of Joint Detection of AFP, CA19-9, CA125 and CEA in Identification and Diagnosis of Cholangiocarcinoma

  • Li, Yong;Li, Da-Jiang;Chen, Jian;Liu, Wei;Li, Jian-Wei;Jiang, Peng;Zhao, Xin;Guo, Fei;Li, Xiao-Wu;Wang, Shu-Guang
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.8
    • /
    • pp.3451-3455
    • /
    • 2015
  • Objective: To explore the application of joint detection of serum AFP, CA19-9, CA125 and CEA in identification and diagnosis of cholangiocarcinoma (CC). Materials and Methods: The levels of serum AFP, CA19-9, CA125 and CEA of both 30 patients with CC and 30 patients with hepatocellular carcinoma (HCC) were assessed. Receiver operating characteristic (ROC) curves were used to evaluate the diagnostic effects of single and joint detection of those 4 kinds of tumor markers for CC. Results: The levels of serum CA19-9, CA125 and CEA in CC patients were higher than that in HCC patients,whereas that of serum AFP was significantly lower s. The area under ROC curve of single detection of serum AFP, CA19-9, CA125 and CEA were 0.05, 0.86, 0.84 and 0.83, with the optimal cutoff values of 15.4 ng/ml, 125.1 U/ml, 95.7 U/ml and 25.9 ng/ml, correspondingly, and the percentage correct single diagnosis was <79%. With joint detection, the diagnostic effect of combined AFP, CA19-9, CA125 and CEA was the highest, with an area under the ROC curve of 0.94 (95%CI 0.88~0.99). Conclusions: Single detection of serum CA19-9, CA125 and EA is not meaningful. The sensitivity, specificity, the rate of correct diagnosis and the area under ROC curve of joint detection of AFP, CA19-9, CA125 and CEA are highest, indicating that the joint detection of these 4 tumor markers is of great importance in the diagnosis of CC.