Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Proficiency Comparison Testing Between Testers Using ISO/IEC 25023 Software Quality Characteristics Evaluation

ISO/IEC 25023 소프트웨어 품질 특성 평가를 이용한 시험자간 비교시험에 관한 연구

  • Lee, Chang-Hee (Software Engineering Laboratory, Software Center, LG Electronics) ;
  • Kim, Myung-Sup (Software Engineering Laboratory, Software Center, LG Electronics) ;
  • Kim, Yoon-Sook (Software Engineering Laboratory, Software Center, LG Electronics) ;
  • Noh, A-Reum (Software Engineering Laboratory, Software Center, LG Electronics) ;
  • Yang, Jung-Sim (Software Engineering Laboratory, Software Center, LG Electronics) ;
  • Song, Sung-Hyun (Software Engineering Laboratory, Software Center, LG Electronics)
  • 이창희 (LG전자, SW센터, SW공학연구소) ;
  • 김명섭 (LG전자, SW센터, SW공학연구소) ;
  • 김윤숙 (LG전자, SW센터, SW공학연구소) ;
  • 노아름 (LG전자, SW센터, SW공학연구소) ;
  • 양정심 (LG전자, SW센터, SW공학연구소) ;
  • 송성현 (LG전자, SW센터, SW공학연구소)
  • Received : 2020.03.17
  • Accepted : 2020.06.05
  • Published : 2020.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study compared and analyzed the results of proficiency testing between testers based on the international standard ISO/IEC 17043 proficiency testing requirements using ISO/IEC 25023 software quality characteristics evaluation. Application of the test was submitted to the KASTO as a software test in the electric test field defined by KOLAS. Among ISO/IEC 25023, the evaluation items for proficiency testing between testers were selected as functional completeness and time behavior. The comparison test between testers was carried out on May 28, 2019 at the accredited LG Electronics SW Laboratory in Seoul and attended by KOLAS assessors. The test evaluation method was measured once per tester with functional completeness, and measurement was repeated 10 times per tester according to time behavior. As a result, in the case of functional completeness, all 12 test steps were passed, and the satisfaction was evaluated. Time behavior was repeated 10 times, and the mean was 9.45 ± 0.01 seconds for testers 1 and 3 and 9.52 ± 0.0 seconds for tester 2, but there was no statistically significant difference. In conclusion, the proficiency of the testers was equal, and the reliability of the test results of the test institute was confirmed.

본 연구는 국제표준 ISO/IEC 25023 소프트웨어 품질 특성 평가를 이용하여 ISO/IEC 17043 숙련도 시험 요구 사항을 기준으로 시험자간 숙련도 시험의 결과를 비교 분석한 연구이다. 시험 분야 신청서는 KOLAS에서 정의하는 전기 시험 분야의 소프트웨어 시험으로 한국계량측정협회에 제출을 하였다. 시험자간 숙련도 시험 평가 항목은 국제표준인 ISO/IEC 25023 SW 품질 특성 중 기능 완전성과 시간 효율성으로 선정을 하였다. 시험자간 숙련도 비교 시험은 서울 소재의 LG전자 SW공인시험소에서 2019년 5월 28일에 KOLAS 평가사가 현장에 입회하여 실시되었다. 시험 평가 방법은 기능 완전성으로 시험자 1인당 1회 측정을 하였고 시간 효율성으로 시험자 1인당 10회를 반복 측정을 하였다. 시험의 수행 결과 기능 완전성의 경우는 12개의 시험 단계를 시험자들이 모두 통과하여 만족으로 평가되었다. 시간 효율성은 10회 반복 측정한 평균 결과 시험자 1과 3은 9.45 ± 0.01 초, 시험자 2는 9.52 ± 0.0 초로 나타났으나 통계적으로 유의하게 차이가 없었다. 결론적으로 시험자들의 숙련도는 동등하였으며 해당 시험기관 시험 결과의 신뢰성을 확인할 수 있었다.

Keywords

References

  1. Nilaranjan Barik, Puspanjali Jena, Narayana Sethy. Assessing information communication technology (ICT) skills of degree science students of An autonomous college of ODISHA : A survey. VSRD International Journal of Library & Information Science, Vol. I, Issue I, 2015. Available From: http://hdl.handle.net/10760/31112
  2. Bo Kyung Park, Woo Sung Jang, Ki Du Kim, Young Chul Kim. A Simplified Test Maturity Model (sTMM) for Small and Midsize Test Organization. Journal of KIISE, Vol. 45, No. 6, pp. 522-532, 2018. DOI: http://dx.doi.org/10.5626/JOK.2018.45.6.522
  3. ISO/IEC 25000 "Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Guide to SQuaRE", 2014. Available From: https://www.iso.org/obp/ui/#iso:std:iso-iec:25000:ed-1:v1:en
  4. ISO/IEC 25010, "Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - System and software quality models", 2011. Available From: https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en
  5. ISO/IEC 25020 "Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Quality measurement framework", 2019. Available From: https://www.iso.org/obp/ui/#iso:std:iso-iec:25020:ed-2:v1:en
  6. ISO/IEC 25023 "Software engineering: Software product Quality Requirements and Evaluation (SQuaRE) - Measurment of system and software product quality", 2016. Available From: https://www.iso.org/obp/ui/fr/#iso:std:iso-iec:25023:ed-1:v1:en
  7. ISO/IEC 25030 "Systems and software engineering - Systems and software quality requirements and evaluation (SQuaRE) - Quality requirements framework", 2019. Available From: https://www.iso.org/obp/ui/fr/#iso:std:iso-iec:25030:ed-2:v1:en
  8. Almira S, Nermina Zaimovic-U, Hazim B. Proficiency testing and interlaboratory comparisons in laboratory for dimensional measurement. Journal of Trends in the Development of Machinery and Associated Technology, Vol. 16, No. 1, 2012. Available From: https://www.tmt.unze.ba/zbornik/TMT2012Journal/24.pdf
  9. A. Shakhashiro, A. Fajgelj, U. Sansone. Comparison of Different Approaches to Evaluate Proficiency Test Data. Conference Paper, The Royal Society of Chemistry, Special Publication No. 307, Cambridge, pp. 220-228, 2007. DOI: https://doi.org/10.1007/s00769-008-0413-7
  10. Ewa Szewczak, Adam Bondarzewski. Is the assessment of interlaboratory comparison results for a small number of tests and limited number of participants reliable and rational?, Accreditation and Quality Assurance volume 21, pp. 91-100, 2016. DOI: https://doi.org/10.1007/s00769-016-1195-y
  11. A Dinita. Conformity assessment of the measurement accuracy in testing laboratories using a software application. 13th International Conference on Tribology, Materials Science and Engineering, 174, 2017. Available From: https://iopscience.iop.org/article/10.1088/1757-899X/174/1/012069
  12. H.Y.Lee, H.S. Yang, Convergence Performance Evaluation Model for Intrusion Protection System based on CC and ISO Standard. The Journal of Digital Police & Management, Vol. 13, No. 5, 2015. DOI: https://doi.org/10.14400/JDC.2015.13.5.251
  13. Jung-Hun Lee, Mi-Jin Lee. Time behaviour evaluation of software products considering service types. ICT Convergence (ICTC), Conference Paper, October 2012. Available From: https://ieeexplore.ieee.org/document/6387129
  14. Jung, Hye-Jung. The Software Quality Testing on the basis of the International Standard ISO/IEC 25023. Journal of the Korea Convergence Society, Vol. 7, No 6, pp.35-41, 2016. DOI: http://dx.doi.org/10.15207/JKCS.2016.7.6.035
  15. Kyunghwan Park, Cheolgyu Lee. A study on proficiency test sample development for enviromental and reliablility testing field. J Korean Soc Qual Manag, Vol. 45, No.3, pp. 447-462, 2017. DOI: https://doi.org/10.7469/JKSQM.2017.45.3.447
  16. Chang-Hee Lee, Byeong-Yun Chang. The effect of the self-measurement frequency levels on SmartCare obesity management. Journal of the Korea Academia-Industrial cooperation Society, Vol. 16, No. 3 pp. 1972-1980, 2015. DOI: http://dx.doi.org/10.5762/KAIS.2015.16.3.1972