The KIPS Transactions:PartD (정보처리학회논문지D)

Korea Information Processing Society (한국정보처리학회)
권호 표지

A Study on Test Coverage for Software Reliability Evaluation

소프트웨어 신뢰도 평가를 위한 테스트 적용범위에 대한 연구

  • 박중양 (경상대학교 수학·통계정보학부 통계정보학전공) ;
  • 박재흥 (경상대학교 컴퓨터과학과) ;
  • 박수진 (경상대학교 대학원 전자계산학과)
  • Published : 2001.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

Recently a new approach to evaluation of software reliability, one of important attributes of a software system, during testing has been devised. This approach utilizes test coverage information. The coverage-based software reliability growth models recently appeared in the literature are first reviewed and classified into two classes. Inherent problems of each of the two classes are then discussed and their validity is empirically investigated. In addition, a new mean value function in coverage and a heuristic procedure for selecting the best coverage are proposed.

소프트웨어 신뢰도는 소프트웨어 시스템의 매우 중요한 특성으로 테스팅 하는 동안 소프트웨어 신뢰도를 평가하기 위해 테스트 적용범위 정보를 이용하는 방법이 최근 시도되고 있다. 본 논문은 최근 문헌에 나타난 테스트 적용범위를 이용하는 소프트웨어 신뢰도 성장모델들을 검토하여 이들을 2개 부류로 분류한 다음 각각의 문제점을 논의하고 현실적 타당성을 검토한다. 더불어, 새로운 평균치 함수와 적절한 적용범위를 선택하기 위한 절차를 제안한다.

Keywords

References

  1. M. H. Chen, J. R. Horgan, A. P. Mathur, and V. J. Rego, 'A Time/Structure Based Model for Estimating Software Reliability Estimation,' Technical Report SERC-TR-117-P, Purdue University, Dec. 1992
  2. M. H. Chen, M. R. Lyu and W. E. Wong, 'An Empirical Study of the Correlation Between Code Coverage and Reliability Estimation,' Proceedings of the 3rd IEEE Inter-national Symposium on Software Metrics, Berlin, Germeny, March 1996 https://doi.org/10.1109/METRIC.1996.492450
  3. M. H. Chen, M. R. Lyu and W. E. Wong, 'Incorporating Code Coverage in the Reliability Estimation for Fault-Tolerant Software,' Proceedings of the 16th IEEE Sympo-sium on Reliable Distributed System, pp.45-52, Durham, NC, Oct. 1997 https://doi.org/10.1109/RELDIS.1997.632796
  4. A. L. Goel, 'Software Reliability Model : Assumptions, Limi-tations, and Applicability,' IEEE Transactions on Software Engineering, Vol.SE-11, No.12, pp.1411-1423, 1985
  5. S. S. Gokhale, P. N. Marinos, and K. S. Trivedi, 'Important Milestones in Sotware Reliability Modeling,' Commu-nications in Reliability, Maintainability and Serviceability, 1996
  6. S. S. Gokhale, T. Philip, P. N. Marinos, and K. S. Trivedi, 'Non-Homogeneous Markov Software Reliability Model with Imperfect Repair,' Technical Report TR-96/12, CACC Duke University, 1996
  7. S. S. Gokhale, T. Philip, P. N. Marinos, and K. S. Trivedi, 'Unification of Finite Failure Non-Homogeneous Poisson Process Models Through Test Coverage,' Technical Report TR-96/36, CACC Duke University, 1996
  8. J. R. Horgan, A. P. Mathur, A. Pasquini, and V. J. Rego, 'Perils of Software Reliability Modeling,' Technical Report SERC-TR-160-p, Software Engineering Research Center, Purdue University, 1995
  9. N. Li and Y. K. Malaiya, 'Fault Exposure Ratio Estimation and Application,' Technical Report CS-96-130, Colorado State University, 1996
  10. M. N. Li and Y. K. Malaiya, and J. Denton, 'Estimating the Number of Defects : A simplified Intuitive Approach, 'Proceedings of International Symposium of Software Engineering, Paderborn, Germany, Nov. 1998
  11. Y. K. Malaiya, 'Estimating The Number of Residual Defects,' Proceedings of the 3rd IEEE International High-Assurance Systems Engineering Symposium, Washington, DC, pp.98-105, Nov. 1998 https://doi.org/10.1109/HASE.1998.731600
  12. Y. K. Malaiya and J. Denton, 'What Do the Software Reliability Growth Model Parameters Represent?' Proceed-ings of the 8th International Symosium on Software Reliability Engineering, Albuquerque, NM, pp.124-135, Nov. 1997 https://doi.org/10.1109/ISSRE.1997.630857
  13. Y. K. Malaiya and J. Denton, 'Estimating Defect Density Using Test Coverage,' Technical Report CS-98-104, Colorado State University, 1998
  14. Y. K. Malaiya, N. Li, J. Bieman, R. Karcich, and R. Skibbe, 'The Relationship Between Test Coverage and Reliability,' Proceedings of the 5th International Symposium on Soft-ware Reliability Engineering. pp.186-195, Monterey, CA, Nov. 1994 https://doi.org/10.1109/ISSRE.1994.341373
  15. Y. K. Malaiya, N. Li, J. Bieman, R. Karcich, and R. Skibbe, 'Software Test Coverage and Reliability,' Technical Report CS-96-128, Colorado State University, 1996
  16. Y. K. Malaiya, N. Karunanithi, and P. Verma, 'Predicta-bility of Software Reliability Models,' IEEE Transactions on Reliability, pp.539-546, 1992 https://doi.org/10.1109/24.249581
  17. J. D. Musa, A. Iannino, and K. Okumoto, Software Reliabil-ity : Measurement, Prediction, Application, McGraq-Hill, 1987
  18. J. D. Musa and K. Okumoto, 'A Logarithmic Poisson Execution Time Model for Software Reliability Mea-surement,' Proceedings of the 7th International Confer-ence on Software Engineering, pp.230-238, Orlando, 1984
  19. A. Pasquini, A. N. Crespo and P. Matrella, 'Sensitivity of Reloability-Growth Models to Operational Profile Errors vs Testing Accuracy,' IEEE Transactions on Reliability, Vol. 45, No.4, pp.531-540, 1996 https://doi.org/10.1109/24.556576
  20. T. Philip, P. N. Marinos, K. S. Trivedi, and J. Lala, 'A Multiphase Software Reliability Model : From Testing to Operational Phase,' Technical Report TR-96-01, CACC Duke University, 1996
  21. P. Piwowarski, M. Ohba and J. Caruso, 'Coverage Mea-surement Experience During Function Test,' Proceedings of the 15th International Conference on Software Engineer-ing, pp.287-300, Baltimore, MD, May 1993 https://doi.org/10.1109/ICSE.1993.346035
  22. C.V. Ramamoorthy and F.B. Bastani, 'Software Reliability-Status and Perspective,' IEEE Transactions on Software Engineering, Vol.SE-8, No.8, pp.354-371, 1982
  23. J. Ramsey and V. R .Basili, 'Analyzing the Test Process Using Structural Coverage,' Proceedings of the 8th Inter-national Conference on Software Engineering, pp.306-312, Aug. 1985
  24. J. G. Shanthikumar, 'Software Reliability Model : A Re-view,' Microelectronics and Reliability, Vol.23, No.5, pp.903-943, 1983 https://doi.org/10.1016/0026-2714(83)91018-1
  25. G. S. Varadan, 'Trends in Reliability and Test Strategies,' IEEE Software, Vol.12, No.3, pp.10, 1995 https://doi.org/10.1109/52.382175
  26. W. E. Wong, 'On Mutation and Data Flow,' PhD Thesis, Department of Computer Science, Prudue University, W. Lafayette, IN, Dec. 1993
  27. W. E. Wong, J. R. Horgan, S. London, and A. P. Mathur, 'Effect of Test Set Size and Block Coverage on the Fault Detection Effectiveness,' Proceedings of the 5th IEEE International Symposium on Software Reliability Engi-neering, pp.230-238, Monterey, CA. Nov, 1994 https://doi.org/10.1109/ISSRE.1994.341379
  28. A. Wood, 'Software Reliability Growth Models : Assump-tions vs. Reality,' Proceedings of the 8th International Symposium on Software Reliability Engineering, pp.136-141, Albuquerque, New Mexico, Nov. 1997 https://doi.org/10.1109/ISSRE.1997.630858