• Title/Summary/Keyword: receiver operating characteristics (ROC)

Search Result 99, Processing Time 0.027 seconds

Fault Prediction Using Statistical and Machine Learning Methods for Improving Software Quality

  • Malhotra, Ruchika;Jain, Ankita
    • Journal of Information Processing Systems
    • /
    • v.8 no.2
    • /
    • pp.241-262
    • /
    • 2012
  • An understanding of quality attributes is relevant for the software organization to deliver high software reliability. An empirical assessment of metrics to predict the quality attributes is essential in order to gain insight about the quality of software in the early phases of software development and to ensure corrective actions. In this paper, we predict a model to estimate fault proneness using Object Oriented CK metrics and QMOOD metrics. We apply one statistical method and six machine learning methods to predict the models. The proposed models are validated using dataset collected from Open Source software. The results are analyzed using Area Under the Curve (AUC) obtained from Receiver Operating Characteristics (ROC) analysis. The results show that the model predicted using the random forest and bagging methods outperformed all the other models. Hence, based on these results it is reasonable to claim that quality models have a significant relevance with Object Oriented metrics and that machine learning methods have a comparable performance with statistical methods.

Analysis of Riding Quality Acceptability and Characteristics of Expressway Users and Evaluation of MRI Thresholds using Receiver Operating Characteristic curves (고속도로 이용자의 승차감 평가특성 및 만족도 분석과 ROC 곡선을 이용한 평탄성 관리기준 적정성 검토)

  • Lee, Jaehoon;Sohn, Ducksu;Ryu, SungWoo;Kim, Youngwon;Park, Junyoung
    • International Journal of Highway Engineering
    • /
    • v.20 no.2
    • /
    • pp.35-44
    • /
    • 2018
  • PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

Performance Analysis and Design of a WCDMA Mobile Station's Multi-path Searcher for Down-link with Multiple Transmit Antennas (다수의 송신 안테나가 있는 하향 링크에서 W-CDMA 단말기 다중 경로 검색기의 설계 및 성능분석)

  • Kim Young Ju;Won Seung Hwan;Kim En Ki;Lee Insung
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.43 no.1 s.343
    • /
    • pp.95-102
    • /
    • 2006
  • In this paper, we present the performance analysis and design of a multi-path searcher operating over Rayleigh fading channels when multiple transmit antennas are employed in the down-link of W-CDMA system. The simulation results for the receiver operating characteristics (ROC) for 1, 2, and 4 transmit antennas are presented to corroborate the theoretical analyses. We also propose a procedure to find the optimum parameters of double-dwell serial searcher according to the number of the multiple transmit antennas. Our analyses and simulations indicate that post-detection integration is not necessary when the number of transmit antennas is more than two. Finally, we found that increasing transmit diversity order does not necessarily improve the detection performance when the received pilot signal strength is relatively low. Therefore, this gives us a practical criterion on increasing transmit diversity order.

Performance Analysis and Design of a Mobile Station′s Multi-path Searcher for W-CDMA Down-link with Multiple Transmit Antennas (W-CDMA 下向 링크에서 다수의 송신 안테나가 있는 경우 단말기 다중 경로 검색기의 설계 및 성능 분석)

  • Won Seung hwan;Kim Young ju
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.10C
    • /
    • pp.1355-1362
    • /
    • 2004
  • In this paper, we present the performance analysis of a multi-path searcher operating over Rayleigh fading channels when multiple transmit antennas are employed in the down-link of W-CDMA system. The simulation results for the receiver operating characteristics (ROC) for 1, 2, and 4 transmit antennas are presented to corroborate the theoretical analyses. We also propose a procedure to find the optimum parameters of double-dwell serial searcher according to the number of the multiple transmit antennas. Our analyses and simulations indicate that post-detection integration is not necessary when the number of transmit antennas is more than two. Finally, we found that increasing transmit diversity order does not necessarily improve the detection performance when the received pilot signal strength is relatively low. Therefore, this gives us a practical criterion on increasing transmit diversity order.

Small Target Detection Using Cross Product Based on Temporal Profile in Infrared Image Sequences (적외선 영상 시퀀스에서 시간적 프로파일 기반의 외적을 사용한 소형 표적 검출)

  • Kim, Byoung-Ik;Bea, Tea-Wuk;Kim, Young-Choon;Ahn, Sang-Ho;Kim, Duk-Gyoo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.1C
    • /
    • pp.8-16
    • /
    • 2010
  • This paper presents a new small target detection method using the cross product of the temporal pixels based on the temporal profile in infrared (IR) image sequences. The temporal characteristics of small targets and the various backgrounds are different. A new algorithm classifies target pixels and the background pixels through the hypothesis testing using the cross product of pixels on the temporal profile and predicts the temporal backgrounds based on the results. The small targets are detected by subtracting the predicted temporal background profile from the original temporal profile. For the performance comparison between the proposed algorithm and the conventional algorithms, the receiver operating characteristics (ROC) curves is computed in experiment. Experimental results show that the proposed algorithm has better discrimination and a lower false alarm rate than the conventional methods.

Face Verification System Using Optimum Nonlinear Composite Filter (최적화된 비선형 합성필터를 이용한 얼굴인증 시스템)

  • Lee, Ju-Min;Yeom, Seok-Won;Hong, Seung-Hyun
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.46 no.3
    • /
    • pp.44-51
    • /
    • 2009
  • This paper addresses a face verification method using the nonlinear composite filter. This face verification process can be simple and speedy because it does not require any reprocessing such as face detection, alignment or cropping. The optimum nonlinear composite filter is derived by minimizing the output energy due to additive noise and an input scene while maintaining the outputs of training images constant. The filter is equipped with the discrimination capability and the robustness to additive noise by minimizing the outputs of the input scene and the noise, respectively. We build the nonlinear composite filter with two training images and compare the filter with the conventional synthetic discriminant function (SDF) filter. The receiver operating characteristics (ROC) curves are presented as a metric for the performance evaluation. According to the experimental results the optimum nonlinear composite filter is shown to be a robust scheme for face verification in low resolution and noise environments.

Small Target Detection Using 3-dimensional Bilateral Filter (3차원 양방향 필터를 이용한 소형 표적 검출)

  • Bae, Tae-Wuk
    • Journal of Korea Multimedia Society
    • /
    • v.16 no.6
    • /
    • pp.746-755
    • /
    • 2013
  • This paper presents a three dimensional bilateral filter detecting target trajectory, extracting spatial target information using two dimensional bilateral filter and temporal target information using one dimensional bilateral filter. In order to discriminate edge pixel with flat background and target region spatially and temporally, spatial and temporal variance are used for an image and temporal profile. With this procedure, background and background profile are predicted without original target through two dimensional and one dimensional bilateral filter. Finally, using spatially predicted background and temporally predicted background profile, small target can be detected. For comparison of existing target detection methods and the proposed method, the receiver operating characteristics (ROC) is used in experimental results. Experimental results show that the proposed method has superior target detection rate and lower false alarm rate.

Logistic regression analysis of newspaper readers characteristics affecting regular subscription (종이신문 열독자의 특성이 정기구독 여부에 미치는 영향에 대한 로지스틱 회귀분석)

  • Lee, Seyoung;Kim, Jaehee
    • The Korean Journal of Applied Statistics
    • /
    • v.32 no.5
    • /
    • pp.653-669
    • /
    • 2019
  • The development of new media has gradually decreased the use of newspapers, which had previously occupied the largest share of media. Subscriptions have declined gradually and fell to 14 percent in 2016. This study explores the effects of Newspaper reader's characteristics on regular newspaper subscriptions. The data used for analysis was provided by the Korean Press Foundation and Media Audience Awareness Survey Data in 2016 and 2017. We considered gender, age, education, income, number of days of reading, reading time and amount of reading as the characteristics of the reader. Multiple logistic regression was fitted and interpreted to see what characteristics affect regular subscription.

Evaluating the Validity of the Pediatric Index of Mortality Ⅱ in the Intensive Care Units (소아중환자를 대상으로 한 PIM Ⅱ의 타당도 평가)

  • Kim, Jung-Soon;Boo, Sun-Joo
    • Journal of Korean Academy of Nursing
    • /
    • v.35 no.1
    • /
    • pp.47-55
    • /
    • 2005
  • Purpose: This study was to evaluate the validity of the Pediatric Index of Mortality Ⅱ(PIM Ⅱ). Method: The first values on PIM Ⅱ variables following ICU admission were collected from the patient's charts of 548 admissions retrospectively in three ICUs(medical, surgical, and neurosurgical) at P University Hospital and a cardiac ICU at D University Hospital in Busan from January 1, 2002 to December 31, 2003. Data was analyzed with the SPSSWIN 10.0 program for the descriptive statistics, correlation coefficient, standardized mortality ratio(SMR), validity index(sensitivity, specificity, positive predictive value, negative predictive value), and AUC of ROC curve. Result: The mortality rate was 10.9% (60 cases) and the predicted death rate was 9.5%. The correlation coefficient(r) between observed and expected death rates was .929(p<.01) and SMR was 1.15. Se, Sp, pPv, nPv, and the correct classification rate were .80, .96, .70, .98, and 94.0% respectively. In addition, areas under the curve (AUC) of the receiver operating characteristic(ROC) was 0.954 (95% CI=0.919~0.989). According to demographic characteristics, mortality was underestimated in the medical group and overestimated in the surgical group. In addition, the AUCs of ROC curve were generally high in all subgroups. Conclusion: The PIM Ⅱ showed a good, so it can be utilized for the subject hospital. better.

Psychometric Properties of Korean Minimal Insomnia Screening Scale (불면증 최소스크리닝척도의 심리측정적 특성과 적합성 검증)

  • Kim, Inja;Kim, Sungjae;Kim, Beomjong;Choi, Heejung
    • Journal of Korean Academy of Nursing
    • /
    • v.42 no.6
    • /
    • pp.853-860
    • /
    • 2012
  • Purpose: The purposes of this study were to develop a Minimal Insomnia Screening Scale for Korean adults (KMISS) and to evaluate psychometric properties and discriminant ability of the developed scale. Methods: Data from a cross-sectional survey of 959 Korean adults were analyzed to develop the summated insomnia scale, which was evaluated in terms of reliability, validity, and discriminant ability by receiver operating characteristics (ROC) curve analysis. Results: Item-total correlations ranged between .71-.79 and Cronbach's ${\alpha}$ was .87. Adequate validity was also evident. ROC-curve analysis showed area under ROC was .87 (95% CI: .84-.90) and identified the optimal cut-off score as ${\leq}20$ (sensitivity, .83; specificity, .75; positive/negative predictive values, .40/.95). Using this cut-off score, the prevalence of insomnia in the study sample was 26.3% and most frequent among women and the oldest group. Conclusion: Data supports the psychometric properties of KMISS as a possible insomnia screening instrument. KMISS also shows promise as a convenient ultra-short screening measure of insomnia for adults and epidemiological studies in community health care settings.