Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

An Application of Software Reliability Estimation Model on Weapon System

국내 무기체계 분야의 소프트웨어 신뢰성 추정 모델 적용 사례

  • Bak, Da-Un (Information System & Common Technology Office, Agency for Defense Development)
  • 박다운 (국방과학연구소 정보화기술실)
  • Received : 2020.03.02
  • Accepted : 2020.06.05
  • Published : 2020.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In the domain of Korean weapon system development, issues about software reliability have become crucial factors when developing a weapon system. There is a process required for weapon system software development and management that includes certain activities required to improve the reliability of software. However, these activities are biased toward static and dynamic analyses of source code and do not include activities necessarily required by the international standard. IEEE std. 1633-2016 defines a process for software reliability engineering and describes software reliability estimation as an essential activity in the process. Software reliability estimation means that collecting defective data during the test and estimating software reliability by using the statistical model. Based on the estimated model, developers could estimate the failure rate and make comparisons with the objective failure rate to determine termination of the test. In this study, we collected defective data and applied reliability estimation models to analyze software reliability in the development of a weapon system. To achieve objective software reliability, we continuously tested our software and quantitatively calculated software reliability. Through the research, we hope that efforts to include activities described by the international standard will be carried out in the domain of Korean weapon system development.

국내 무기체계 연구개발과정에서 소프트웨어 신뢰성이 중요한 요소로 여겨지고 있다. 그래서 무기체계 소프트웨어 연구개발 절차에는 소프트웨어 신뢰성 향상을 위한 활동들이 포함되어 있다. 하지만 개발절차에 포함된 활동은 소스 코드 정적 및 동적 분석으로 국제 표준에서 요구하는 활동과 다소 차이가 존재한다. 소프트웨어 신뢰성 관련 국제 표준인 IEEE std 1633-2016에서는 소프트웨어 신뢰성 확보를 위한 프로세스를 정의하고 있으며, 이들 가운데 소프트웨어 신뢰성 추정을 필수 활동이라고 이야기하고 있다. 소프트웨어 신뢰성 추정은 시험단계의 결함을 기반으로 통계 모델을 활용해 현재 시점의 소프트웨어 신뢰성을 추정하는 활동이다. 추정한 모델을 기반으로 소프트웨어 고장률을 추정할 수 있으며, 목표 고장률과의 비교를 통해 시험 종료 여부를 결정할 수 있다. 따라서 본 연구에서는 무기체계 소프트웨어 개발 과정에 소프트웨어 신뢰성 추정 모델을 적용하였다. 그 결과 목표한 소프트웨어 신뢰성을 달성하기 위해 지속적인 시험이 진행되었으며, 정량적인 소프트웨어의 신뢰성을 확인 할 수 있었다. 본 연구를 기반으로 무기체계 소프트웨어의 개발 과정에서 국제 표준에서 제시한 소프트웨어 신뢰성 공학 프로세스를 반영하는 노력이 지속적으로 이루어지기를 기대한다.

Keywords

References

  1. Lyu, M.R., Handbook of Software Reliability Engineering, p.850, McGraw-Hill. 1996.
  2. IEEE, IEEE Recommended Practice on Software reliability, IEEE Reliability Society, IEEE std. 1633-2016, 2016. DOI: https://doi.org/10.1109/IEEESTD.2017.7827907
  3. DAPA(Defense Acquisition Program Administration), "Weapon System Software Development and Management Manual", DAPA, 2018.
  4. GQ Kenny, "Estimating defects in commercial software during operational use", IEEE Transactions on Reliability, vol. 42, no. 1, pp. 107-115, 1993. DOI: https://doi.org/10.1109/24.210280
  5. M. L. Shooman et al., "Reliability of Shuttle Mission Control Center Software", Proceedings of the Annual Reliability and Maintainability Symposium, pp. 125-135, 1983.
  6. Goel, B., and Okumoto, K., "Time-dependent error-detection rate for software reliability and other performance measures", IEEE Transactions on Reliability, vol. 28, no. 3, pp. 206-211, 1979. DOI: https://dx.doi.org/10.1109/TR.1979.5220566
  7. Musa, J. D., B. Iannino, and K. Okumoto, Software Reliability: Measurement, Prediction, Application, p.621, New York: McGraw-Hill, 1987.
  8. Jelinski, Z., and Moranda, P., "Software Reliability Research", Statistical Computer Performance Evaluation, New York: Academic Press, pp. 465-484, 1972. DOI: https://dx.doi.org/10.1016/B978-0-12-266950-7.50028-1
  9. Shooman, M. L., Reliability of Computer Systems and Networks, Fault Tolerance, Analysis, and Design, p.560, New York: McGraw-Hill, 2002.
  10. Duane, J. T., "Learning curve approach to reliability monitoring", IEEE Transactions on Aerospace, vol. 2, no. 2, pp. 563-566, April 1964. DOI: https://dx.doi.org/10.1109/TA.1964.4319640
  11. Musa, J. D., and Okumoto, K., "A logarithmic Poisson execution time model for software reliability measurement", Proceedings of the Seventh International Conference on Software Engineering, Orlando, FL, USA, pp. 230-238, Mar. 1984.
  12. Gokhale, S., and K. Trivedi, "Log-logistic software reliability growth model", Proceedings IEEE High-Assurance Systems Engineering Symposium, Washington, DC, USA, pp. 34-41, 1998. DOI: https://dx.doi.org/10.1109/HASE.1998.731593
  13. Moranda, P., "Event-altered rate models for general reliability analysis," IEEE Transactions on Reliability, vol. 28, no. 5, pp. 376-381, Dec. 1979. DOI: https://dx.doi.org/10.1109/TR.1979.5220648
  14. Yamada, S., M. Ohba, and S. Osaki, "S-shaped reliability growth modeling for software error detection," IEEE Transactions on Reliability, vol. 32, no. 5, pp. 475-478, Dec. 1983. DOI: https://dx.doi.org/10.1109/TR.1983.5221735
  15. Kichang Kim et al, "A Case Study on Application for Software Reliability Model to Improve Reliability of the Weapon Systm", Journal of Korean Institute of information scientists and engineers, vol.38, no.8, pp.405-418, 2011.
  16. Chin-Yu Huang et al., "An Assessment of Testing-Effort Dependent Software Reliability Growth Models", IEEE Transactions on Reliability, vol.56, no.2, pp.198-211, 2007. DOI: https://doi.org/10.1109/TR.2007.895301
  17. J. D. Musa, Software Reliability Engineering: More Reliable Software, Faster Development and Testing, p.632, Author-House, 2004.
  18. Omar H. Alhazmi et al., "Application of Vulnerability Discovery Models to Major Operating Systems", IEEE Transactions on Reliability, vol.57, no.1, pp.14-22, 2008. DOI: https://doi.org/10.1109/TR.2008.916872
  19. Huang,,C. Y. Lyu, M. R., "Estimation and Analysis of Some Generalized Multiple Change-Point Software Reliability Models", IEEE Transactions on Reliability, vol.60, no.2, pp.498-514, 2011. DOI: https://doi.org/10.1109/TR.2011.2134350
  20. Ohba, Mitsuru. "Inflection S-shaped software reliability growth model.", Stochastic models in reliability theory. Springer, pp.144-162, 1984. DOI: https://doi.org/10.1007/978-3-642-45587-2_10
  21. Gordon, Theodore Jay. "The delphi method." Futures research methodology, 2(3), pp.1-30,1994.
  22. Samjoon Park et al, "SIRIUS:Systematic Investigation for Reliability Improvement Upon Software", IEEE 28th International Symposium on Software Reliability Engineering Workshops (ISSREW), toulouse, France, 2017.