• Title/Summary/Keyword: Receiver Operating-Characteristics (ROC) Analysis

Search Result 57, Processing Time 0.024 seconds

Computer-Aided Detection of Clustered Microcalcifications using Texture Analysis and Neural Network in Digitized X-ray Mammograms (X-선 유방영상에서 텍스처 분석과 신경망을 이용한 군집성 미세석회화의 컴퓨터 보조검출)

  • 김종국;박정미
    • Journal of Biomedical Engineering Research
    • /
    • v.19 no.1
    • /
    • pp.1-8
    • /
    • 1998
  • Clustered microcalcifications on X-ray mammograms are an important sign for early detection of breast cancer. This paper proposes a computer-aided diagnosis method for the detection of clustered microcalcifications and marking their locations on digitized mammograms. The proposed detection method consists of the region of interest (ROI) selection, the film-artifact removal, the surrounding texture analysis method for the detection of clustered microcalcifications, which is based on the second-order histogram in two nested surrounding regions on the current pixel. This paper also describes the effectiveness of the proposed film-artifact removal filter in terms of the classification performance with the receiver operating-characteristics(ROC) analysis. A three-layer backpropagation neural network is employed as a classifier. The appropriate marking for the locations of clustered microcalcifications can be used to alert radiologists to locations of suspicious lesions.

  • PDF

Interpretation of Receiver Operating Characteristics (ROC) (ROC(receiver operating characteristics) 해석)

  • Kim Jae-Duk
    • Imaging Science in Dentistry
    • /
    • v.30 no.3
    • /
    • pp.155-158
    • /
    • 2000
  • The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

  • PDF

ROC evaluation for MLP ANN drought forecasting model (MLP ANN 가뭄 예측 모형에 대한 ROC 평가)

  • Jeong, Min-Su;Kim, Jong-Suk;Jang, Ho-Won;Lee, Joo-Heon
    • Journal of Korea Water Resources Association
    • /
    • v.49 no.10
    • /
    • pp.877-885
    • /
    • 2016
  • In this study, the Standard Precipitation Index(SPI), meteorological drought index, was used to evaluate the temporal and spatial assessment of drought forecasting results for all cross Korea. For the drought forecasting, the Multi Layer Perceptron-Artificial Neural Network (MLP-ANN) was selected and the drought forecasting was performed according to different forecasting lead time for SPI (3) and SPI (6). The precipitation data observed in 59 gaging stations of Korea Meteorological Adminstration (KMA) from 1976~2015. For the performance evaluation of the drought forecasting, the binary classification confusion matrix, such as evaluating the status of drought occurrence based on threshold, was constituted. Then Receiver Operating Characteristics (ROC) score and F score according to conditional probability are computed. As a result of ROC analysis on forecasting performance, drought forecasting performance, of applying the MLP-ANN model, shows satisfactory forecasting results. Consequently, two-month and five-month leading forecasts were possible for SPI (3) and SPI (6), respectively.

Drought Hazard Assessment using MODIS-based Evaporative Stress Index (ESI) and ROC Analysis (MODIS 위성영상 기반 ESI와 ROC 분석을 이용한 가뭄위험평가)

  • Yoon, Dong-Hyun;Nam, Won-Ho;Lee, Hee-Jin;Hong, Eun-Mi;Kim, Taegon
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.62 no.3
    • /
    • pp.51-61
    • /
    • 2020
  • Drought events are not clear when those start and end compared with other natural disasters. Because drought events have different timing and severity of damage depending on the region, various studies are being conducted using satellite images to identify regional drought occurrence differences. In this study, we investigated the applicability of drought assessment using the Evaporative Stress Index (ESI) based on Moderate Resolution Imaging Spectroradiometer (MODIS) satellite images. The ESI is an indicator of agricultural drought that describes anomalies in actual and reference evapotranspiration (ET) ratios that are retrieved using remotely sensed inputs of Land Surface Temperature (LST) and Leaf Area Index (LAI). However, these approaches have a limited spatial resolution when mapping detailed vegetation stress caused by drought, and drought hazard in the actual crop cultivation areas due to the small crop cultivation in South Korea. For these reasons, the development of a drought index that provides detailed higher resolution ESI, a 500 m resolution image is essential to improve the country's drought monitoring capabilities. The newly calculated ESI was verified through the existing 5 km resolution ESI and historical records for drought impacts. This study evaluates the performance of the recently developed 500 m resolution ESI for severe and extreme drought events that occurred in South Korea in 2001, 2009, 2014, and 2017. As a result, the two ES Is showed high correlation and tendency using Receiver Operating Characteristics (ROC) analysis. In addition, it will provide the necessary information on the spatial resolution to evaluate regional drought hazard assessment and and the small-scale cultivation area across South Korea.

Shape-Based Classification of Clustered Microcalcifications in Digitized Mammograms

  • Kim, J.K.;Park, J.M.;Song, K.S.;Park, H.W.
    • Journal of Biomedical Engineering Research
    • /
    • v.21 no.2
    • /
    • pp.137-144
    • /
    • 2000
  • Clustered microcalcifications in X-ray mammograms are an important sign for the diagnosis of breast cancer. A shape-based method, which is based on the morphological features of clustered microcalcifications, is proposed for classifying clustered microcalcifications into benign or malignant categories. To verify the effectiveness of the proposed shape features, clinical mammograms were used to compare the classification performance of the proposed shape features with those of conventional textural features, such as the spatial gray-leve dependence method and the wavelet-based method. Image features extracted from these methods were used as inputs to a three-layer backpropagation neural network classifier. The classification performance of features extracted by each method was studied by using receiver operating-characteristics analysis. The proposed shape features were shown to be superior to the conventional textural features with respect to classification accuracy.

  • PDF

Fault Prediction Using Statistical and Machine Learning Methods for Improving Software Quality

  • Malhotra, Ruchika;Jain, Ankita
    • Journal of Information Processing Systems
    • /
    • v.8 no.2
    • /
    • pp.241-262
    • /
    • 2012
  • An understanding of quality attributes is relevant for the software organization to deliver high software reliability. An empirical assessment of metrics to predict the quality attributes is essential in order to gain insight about the quality of software in the early phases of software development and to ensure corrective actions. In this paper, we predict a model to estimate fault proneness using Object Oriented CK metrics and QMOOD metrics. We apply one statistical method and six machine learning methods to predict the models. The proposed models are validated using dataset collected from Open Source software. The results are analyzed using Area Under the Curve (AUC) obtained from Receiver Operating Characteristics (ROC) analysis. The results show that the model predicted using the random forest and bagging methods outperformed all the other models. Hence, based on these results it is reasonable to claim that quality models have a significant relevance with Object Oriented metrics and that machine learning methods have a comparable performance with statistical methods.

Performance Analysis and Design of a WCDMA Mobile Station's Multi-path Searcher for Down-link with Multiple Transmit Antennas (다수의 송신 안테나가 있는 하향 링크에서 W-CDMA 단말기 다중 경로 검색기의 설계 및 성능분석)

  • Kim Young Ju;Won Seung Hwan;Kim En Ki;Lee Insung
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.43 no.1 s.343
    • /
    • pp.95-102
    • /
    • 2006
  • In this paper, we present the performance analysis and design of a multi-path searcher operating over Rayleigh fading channels when multiple transmit antennas are employed in the down-link of W-CDMA system. The simulation results for the receiver operating characteristics (ROC) for 1, 2, and 4 transmit antennas are presented to corroborate the theoretical analyses. We also propose a procedure to find the optimum parameters of double-dwell serial searcher according to the number of the multiple transmit antennas. Our analyses and simulations indicate that post-detection integration is not necessary when the number of transmit antennas is more than two. Finally, we found that increasing transmit diversity order does not necessarily improve the detection performance when the received pilot signal strength is relatively low. Therefore, this gives us a practical criterion on increasing transmit diversity order.

Performance Analysis and Design of a Mobile Station′s Multi-path Searcher for W-CDMA Down-link with Multiple Transmit Antennas (W-CDMA 下向 링크에서 다수의 송신 안테나가 있는 경우 단말기 다중 경로 검색기의 설계 및 성능 분석)

  • Won Seung hwan;Kim Young ju
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.10C
    • /
    • pp.1355-1362
    • /
    • 2004
  • In this paper, we present the performance analysis of a multi-path searcher operating over Rayleigh fading channels when multiple transmit antennas are employed in the down-link of W-CDMA system. The simulation results for the receiver operating characteristics (ROC) for 1, 2, and 4 transmit antennas are presented to corroborate the theoretical analyses. We also propose a procedure to find the optimum parameters of double-dwell serial searcher according to the number of the multiple transmit antennas. Our analyses and simulations indicate that post-detection integration is not necessary when the number of transmit antennas is more than two. Finally, we found that increasing transmit diversity order does not necessarily improve the detection performance when the received pilot signal strength is relatively low. Therefore, this gives us a practical criterion on increasing transmit diversity order.

Analysis of Riding Quality Acceptability and Characteristics of Expressway Users and Evaluation of MRI Thresholds using Receiver Operating Characteristic curves (고속도로 이용자의 승차감 평가특성 및 만족도 분석과 ROC 곡선을 이용한 평탄성 관리기준 적정성 검토)

  • Lee, Jaehoon;Sohn, Ducksu;Ryu, SungWoo;Kim, Youngwon;Park, Junyoung
    • International Journal of Highway Engineering
    • /
    • v.20 no.2
    • /
    • pp.35-44
    • /
    • 2018
  • PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

Logistic regression analysis of newspaper readers characteristics affecting regular subscription (종이신문 열독자의 특성이 정기구독 여부에 미치는 영향에 대한 로지스틱 회귀분석)

  • Lee, Seyoung;Kim, Jaehee
    • The Korean Journal of Applied Statistics
    • /
    • v.32 no.5
    • /
    • pp.653-669
    • /
    • 2019
  • The development of new media has gradually decreased the use of newspapers, which had previously occupied the largest share of media. Subscriptions have declined gradually and fell to 14 percent in 2016. This study explores the effects of Newspaper reader's characteristics on regular newspaper subscriptions. The data used for analysis was provided by the Korean Press Foundation and Media Audience Awareness Survey Data in 2016 and 2017. We considered gender, age, education, income, number of days of reading, reading time and amount of reading as the characteristics of the reader. Multiple logistic regression was fitted and interpreted to see what characteristics affect regular subscription.