Journal of KIISE:Computing Practices and Letters (한국정보과학회논문지:컴퓨팅의 실제 및 레터)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

A Comparative Experiment of Software Defect Prediction Models using Object Oriented Metrics

객체지향 메트릭을 이용한 결함 예측 모형의 실험적 비교

  • 김윤규 (부산대학교 컴퓨터공학과) ;
  • 김태연 (부산대학교 컴퓨터공학과) ;
  • 채흥석 (부산대학교 컴퓨터공학과)
  • Published : 2009.08.15
Download PDF
⟨ Previous Next ⟩

Abstract

To support an efficient management of software verification and validation activities, many defect prediction models have been proposed based on object oriented metrics. They usually adopt logistic regression analysis, And, they state that the correctness of prediction is about 60${\sim}$70%, We performed a similar experiment with Eclipse 3.3 to check their prediction effectiveness, However, the result shows that correctness is about 40% which is much lower than the original results. We also found that univariate logistic regression analysis produces better results than multivariate logistic regression analysis.

검증과 확인을 통한 소프트웨어의 효율적인 관리를 지원하기 위하여 객체지향 메트릭 기반의 결함 예측 모형이 많이 제안되고 있다. 제안된 모형은 주로 로지스틱 회귀분석으로 개발하였다. 그리고 개발된 모형의 결함 예측 정확도는 60${\sim}$70%이었다. 본 논문에서는 기존 결함 예측 모형의 효과를 확인하기 위하여 이클립스 3.3을 대상으로 개발된 모형과 유사한 방법으로 실험을 하였다. 실험 결과 모형의 정확성은 약 40%이었다. 이는 주장된 예측력보다 많이 낮은 수치이었다. 또한 단순 로지스틱 회귀분석이 다중 로지스틱 회귀분석보다 높은 예측력을 보였다.

Keywords

References

  1. K. EL Eman, W. Melo and J.C. Machado, “The Prediction of Faulty Classes Using Object-Ori-ented Design Metrics,” Journal of Systems and Soft-ware, vol.56, no.1, pp.63-75, 2001 https://doi.org/10.1016/S0164-1212(00)00086-8
  2. S.R. Chidamber, C.F. Kemerer, "A Metrics Suite for Object Oriented Design," IEEE Transactions on Software Engineering, vol.20, no.6. pp.476-493, 1994 https://doi.org/10.1109/32.295895
  3. H. M. Olague, L. H. Etzkorn, S. Gholston et al., “Empirical Validation of Three Software Metrics Suites to Predict Fault-Proneness of Object-Oriented Classes Developed Using Highly Iterative or Agile Software Development Processes,” IEEE Transactions on Software Engineering, vol.33, no.6, pp.402-419, 2007 https://doi.org/10.1109/TSE.2007.1015
  4. Z. Yuming, and L. Hareton, “Empirical Analysis of Object-Oriented Design Metrics for Predicting High and Low Severity Faults,” IEEE Transactions on Software Engineering, vol.32, no.10, pp.771-789, 2006 https://doi.org/10.1109/TSE.2006.102
  5. T. Gyimothy, R. Ferenc, and I. Siket, “Empirical validation of object-oriented metrics on open source software for fault prediction,” IEEE Transactions on Software Engineering, vol.31, no.10, pp.897-910, 2005 https://doi.org/10.1109/TSE.2005.112
  6. L. C. Briand, W. L. Melo, and J. Wust, “Asses-sing the applicability of fault-proneness models across object-oriented software projects,” IEEE Transactions on Software Engineering, vol.28 no.7, pp706-720, 2002 https://doi.org/10.1109/TSE.2002.1019484
  7. T. M. Khoshgoftaar, and N. Seliya, “Fault Predic-tion Modeling for Software Quality Estimation: Comparing Commonly Used Techniques,” Empirical Software Engineering, vol.8, no.3, pp.255-283, 2003 https://doi.org/10.1023/A:1024424811345