Journal of Internet Computing and Services (인터넷정보학회논문지)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Suggestion for an ISO 25010 quality model encompassing AI-based software

  • Seung-Hee Kim (Dept. of IT Convergence Software Engineering, Korea University of Technology & Education (KOREATECH))
  • Received : 2024.07.09
  • Accepted : 2024.09.24
  • Published : 2024.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study developed a novel ISO/IEC 25010 quality model for the quality management of artificial intelligence (AI)-based software by using quality characteristics classification card (QCCC) quality models. We used AI models to add, modify, and restructure AI quality attributes for the product quality model and the quality-in-use model of the ISO/IEC 25010 quality model to derive a novel ISO/IEC 25010 quality model. By integrating quality standards derived from various AI-related models, we enhanced the accuracy of the derived model. The product quality model included 10 main quality and 45 subquality attributes, and the quality-in-use model included 10 main quality and 28 subquality attributes. In AI-based models, the quality-in-use model was found to require modifications. The results revealed the direction of improvement of the AI-compatible software quality model and the possibilities for potential standardization and conflict resolution. This study presents the direction for standardization reviews on reorganizing the quality attributes, concepts of attributes, and relationships so that they can be applied to AI software while maintaining the framework of the currently defined software quality model. The results can serve as criteria for the quality management of AI-based software and can also contribute to research on quality models for AI-based software.

Keywords

Acknowledgement

This paper was supported by the Education and Research Promotion Program of KOREATECH in 2023

References

  1. S. Martinez-Fernandez et al., "Software Engineering for AI-Based Systems: A Survey," ACM Transactions on Software Engineering and Methodology (TOSEM), Vol. 31, no. 2, pp. 1-59, Apr. 2022. https://doi.org/10.1145/3487043
  2. H. Jung, "The Software Quality Testing on the Basis of the International Standard ISO/IEC 25023," Journal of Korea Convergence Society, Vol. 7, no 6, pp. 35-41, Dec. 2016. https://doi.org/10.15207/JKCS.2016.7.6.035
  3. N. T. Nikolinakos, "EU Policy and Legal Framework for Artificial Intelligence, Robotics and Related TechnologiesThe AI Act," 53. Springer, Jul. 2023. https://doi.org/10.1007/978-3-031-27953-9
  4. B. C. Stahl, D. Schroeder, & R. Rodrigues, "Ethics of Artificial Intelligence: Case Studies and Options for Addressing Ethical Challenges," Springer Nature, Switzerland, p.116, Cham. 2023. https://doi.org/10.1007/978-3-031-17040-9
  5. Johner Institut - Ihr Partner fur Regularien im Bereich Medizinprodukte (johner-institut.de), https://www.johner-institut.de (accessed on 4 June 2023)
  6. ISO/IEC. Technical report: Software and systems Engineering-Software testing-Part 11: Guidelines on the testing of AI-based systems, ISO/IEC TR 29119-11:2020(E), First edition, Nov. 2020.
  7. ISO/IEC. Information Technology-Artificial Intelligence (AI)-Overview of Computational Approaches for AI Systems, 2021. Available online: https://www.iso.org/standard/78508.html (accessed on 4 June 2023). TR, 24372.
  8. ISO/IEC. Information Technology-Artificial Intelligence -Overview of Trustworthiness in Artificial Intelligence, 2020. Available online: https://www.iso.org/standard/77608.html (accessed on 4 June 2023). TR, 24028.
  9. ISO/IEC. Artificial Intelligence (AI). Assessment of the Robustness of Neural Networks. Overview. Available online: https://www.iso.org/standard/77609.html (accessed on 4 June 2023). TR, 24029-1:2021.
  10. UoN Digital Repository Home (uonbi.ac.ke), accessed on 4 Jul. 2023.
  11. M. Falco, E. Scott, & G. Robiolo, "Overview of an Automated Framework to Measure and Track the Quality Level of a Product," In 2020 IEEE Congreso Bienal de Argentina (ARGENCON), Resistencia, Argentina, pp. 1-7, Aug. 2021,. https://doi.org/10.1109/ARGENCON49523.2020.9505405
  12. S. B. Muradi, "Systematic Selection of Blockchain Platforms Using Fuzzy AHP-TOPSIS," University of Malaya (Malaysia) roQuest Dissertations Publishing, 30594302, Dec. 2022.
  13. M. Felderer, & R. Ramler, "Quality assurance for AI-based systems: Overview and challenges (introduction to inter-active session)," In Software Quality: Future Perspectives on Software Engineering Quality: 13th International Conference, SWQD 2021, Vienna, Austria, January 19-21, Jan. 2021, Proceedings 13 (pp. 33-42). Springer International Publishing. https://doi.org/10.1007/978-3-030-65854-0_3
  14. V. Kharchenko, H. Fesenko, & O. Illiashenko, "Quality Models for Artificial Intelligence Systems: Characteristic-Based Approach, Development and Application," Sensors, Vol. 22, no. 13, p. 4865, Jun. 2022. https://doi.org/10.3390/s22134865
  15. K.-H. Park, J. Kim, S. Lee, M.-K. Kim, K.-R. Lee, & J.-T. Han, "A Study on the Quality Control Method for Geotechnical Information Using AI," Journal of the Korean Geotechnical Society, Vol. 38, no. 11, pp. 87-95, Nov. 2022. https://doi.org/10.7843/kgs.2022.38.11.87
  16. ISO: Global standards for trusted goods and services. https://www.iso.org/home.html, accessed on June 2023.
  17. S.H. Kim, & W. J. Kim, "Analysis of Quality Correlation and Characteristic Importance of Application SW by SW Life Cycle Based on ISO 25000," Journal of KISS: Software and Applications, Vol. 41, no. 2, pp. 112-127, Apr. 2014.
  18. J. Estdale, & E. Georgiadou, "Applying the ISO/IEC 25010 Quality Models to Software Product," Systems, software and services process improvement, EuroSPI 2018, Bilbao, Spain, September 5-7, pp. 492-503, 2018. https://doi.org/10.1007/978-3-319-97925-0_42.
  19. ISO 25000 Software and Data Quality. https://iso25000.com (accessed on June 2023).
  20. M. Herrera, M. A. Moraga, I. Caballero, & C. Calero, "Quality in use model for web portals (QiUWeP)," Current Trends in Web Engineering, ICWE 2010, Lecture Notes in Computer Science, vol 6385, Springer, Berlin, Heidelberg, 2010. https://doi.org/10.1007/978-3-642-16985-4_9
  21. UTokyo Repository. repository.dl.itc.u-tokyo.ac.jp, accessed on 4 Jul. 2023.
  22. S. Jayakumar, V. Sounderajah, P. Normahani, L. Harling, S. R. Markar, H. Ashrafian, & A. Darzi, "Quality Assessment Standards in Artificial Intelligence Diagnostic Accuracy Systematic Reviews: A Meta Research Study," NPJ Digital Medicine, Vol. 5, no. 1, p. 11, Jan. 2022. https://doi.org/10.1038/s41746-021-00544-y
  23. E. Manziuk, O. Barmak, I. Krak, O. Mazurets, & T. F. Skrypnyk, "Formal Model of Trustworthy Artificial Intelligence Based on Standardization," In IntelITSIS, Khmelnytskyi, Ukraine, pp. 190-197, Mar. 2021.
  24. T. Y. Kim, N. Ko, S. Yang, & S. M. Kim, "Trends in Network and AI Technologies," Electronics and Telecommunications Research Institute, Vol. 35, no. 5, pp. 1-13, Oct. 2020. https://doi.org/10.22648/ETRI.2020.J.350501
  25. G. Zhu, J. Zan, Y. Yang, & X. A. Qi, "Supervised Learning Based QoS Assurance Architecture for 5G Networks," IEEE Access, Vol. 7, pp. 43598-43606, Jul. 2019. https://doi.org/10.1109/ACCESS.2019.2907142.
  26. C. H. Baek, "A Study on Service Quality Evaluation in Artificial Intelligence Era Using Delphi Technique," Journal of Korea Service Management Society, Vol. 21, no. 3, pp. 1-15, Oct. 2020. https://doi.org/10.15706/jksms.2020.21.3.001
  27. D. Park, "Study on Service Quality Evaluation of AICC (Artificial Intelligence Contact Center) Considerations and Suggestions," JHSS, Vol. 13, no. 6, pp.4581-4592, Dec. 2022. https://doi.org/ 10.22143/HSS21.13.6.317.
  28. Q. Chen, Y. Gong, Y. Lu, & T. Tang, "Classifying and Measuring the Service Quality of AI Chatbot in Frontline Service," Journal of Bus. Res., Vol. 145, pp. 552-568, Jun. 2022. https://doi.org/10.1016/j.jbusres.2022.02.088
  29. C. H. Baek, S. U. Lim, & J. H. Choe, "A Study on Major Characteristic Analysis and Quality Evaluation Attributes of Artificial Intelligence Service," J Korean Soc Qual Manag, Vol. 47, no. 4, pp. 837-846, Dec. 2019. https://dx.doi.org/10.7469/JKSQM.2019.47.4.837
  30. C. H. Baek, S. Y. Kim, S. U. Lim, & J. Xiong, "Quality evaluation model of artificial intelligence service for startups," International Journal of Entrepreneurial Behavior & Research, Vol. 29, no. 4, pp. 913-940, May 2023. https://doi.org/10.1108/IJEBR-03-2021-0223
  31. S. Nativi, & N. S. DE, "AI Standardization Landscape: State of play and Link to the EC Proposal for an AI Regulatory Framework," Publications Office of the European Union, 2021. https://doi.org/10.2760/376602 (online)
  32. B. Y. Kim, "Trends and Implications of Regulatory Legislation in Major Countries as a Means of Controlling Artificial Intelligence," European Constitutional Law Research, vol 42, pp. 253-307, Aug. 2023. https://doi.org/10.21592/eucj.2023.42.253
  33. A. Idri, M. Bachiri, & J. L. Fernandez-Aleman, "A Framework for Evaluating the Software Product Quality of Pregnancy Monitoring Mobile Personal Health Records," Journal of medical systems, Vol. 40, 50, pp. 1-17, Dec. 2016. https://doi.org/10.1007/s10916-015-0415-z
  34. M. Oriol, J. Marco, & X. Franch, "Quality models for web services: A systematic mapping. Inf. Software," Information and Software Technology, Vol. 56, no. 10, pp. 1167-1182, Oct. 2014. https://doi.org/10.1016/j.infsof.2014.03.012
  35. M. C. S. Fhang, & W. W. Tong, "Why a good process fail? Experience in building a sustainable and effective process for software development," ICSCA '18: Proceedings of the 2018 7th International Conference on Software and Computer Applications, pp. 40-45, Feb. 2018. https://doi.org/10.1145/3185089.3185107
  36. N. Condori-Fernandez, & P. Lago, "Characterizing the contribution of quality requirements to software sustainability," Journal of systems and software, Vol. 137, pp 289-305, Mar. 2018. https://doi.org/10.1016/j.jss.2017.12.005
  37. J. M. Franca, M. M. Costa Junior, & M. S. Soares, "Architecture-driven development of an electronic health record considering the SOAQM quality model," SN Computer Science, Vol. 1, no. 3, 140, Apr. 2020. https://doi.org/10.1007/s42979-020-00150-x
  38. ISO/IEC 25059, https://iso25000.com/index.php/en/iso-25000-standards/iso-25059/204-iso-iec-25059 (accessed on 1 July 2024).
  39. L. Sanchez-Gonzalez, F. Garcia, F. Ruiz, & M. Piattini, "Toward a quality framework for business process models," International Journal of Cooperative Information Systems, Vol. 22, no. 01, 1350003, 2013. https://doi.org/10.1142/S0218843013500032
  40. C. S. Nam, "A Study on the Quality Monitoring and Prediction of OTT Traffic in ISP," The Journal of Korea Institute of Information, Electronics, and Communication Technology, Vol. 14, No. 2, pp.115-121, Apr. 2021. https://doi.org/10.17661/jkiiect.2021.14.2.115
  41. H. G. Hwang, B. S. Kim, Y. T. Woo, Y. W. Yoon, S. C. Shin, & S. J. Oh, " A Development of Welding Information Management and Defect Inspection Platform Based on Artificial Intelligent for Shipbuilding and Maritime Industry," Journal of the Korea Institute of Information and Communication Engineering, Vol. 25, no. 2, pp. 193-201, Feb. 2021. https://doi.org/10.6109/jkiice.2021.25.2.193
  42. D. M. Kim, "A study on the design of AI-based software quality testing framework using UML metadata," Department of IT Convergence (Artificial Intelligence Major) Graduate School, Dong-Eui University, 2022.
  43. H. S. Kim, "A Study on the Data Quality Management Evaluation Model," Journal of the Korea Convergence Society, Vol. 11, no. 7, pp. 217-222, Jul. 2020. https://doi.org/10.15207/JKCS.2020.11.7.217.
  44. QA4AI Consortium. Guideline for the Quality Assurance of AI-Based Products. Available online: http://www.qa4ai.jp/QA4AI. Guideline 2019, 201905.pdf (in Japanese).
  45. C. Yun, H. Shin, S. Y. Choo, & J. Kim, "An Evaluation Study on Artificial Intelligence Data Validation Methods and Open-Source Frameworks," Journal of Korea Multimedia Society, Vol. 24, no. 10, pp. 1403-1413, Oct. 2021. https://doi.org/10.9717/kmms.2021.24.10.1403.
  46. C. H. Baek, "A Study on Major Service Items of Consumers and Companies Using Convergence Technology in the Intelligent Age," International Journal of Software Innovation (IJSI), Vol. 10, no. 1, pp.1-12. Jan. 2021. https://doi.org/10.4018/IJSI.339884
  47. Ml. L. Berihun, (Ed.) Advances of Science and Technology: 9th EAI International Conference, ICAST 2021, Hybrid Event, Bahir Dar, Ethiopia, August 27-29, 2021. Proceedings, Part I (Vol. 411), Springer Nature.
  48. E. Ferko, "Towards a standards-based architecture for digital twins facilitating interoperability," Malardalen University (Sweden), 2023.
  49. T. L. Alves, P. Silva, & M. S. Dias, "Applying ISO/IEC 25010 Standard to prioritize and solve quality issues of automatic ETL processes," 2014 IEEE International Conference on Software Maintenance and Evolution, pp. 573-576, Sep. 2014.
  50. F. Gualo, M. Rodriguez, J. Verdugo, I. Caballero, & M. Piattini, "Data Quality Certification Using ISO/IEC 25012: Industrial Experiences," Journal of Systems and Software, Vol. 176, pp. 110938. Jun. 2021. https://doi.org/10.1016/j.jss.2021.110938.
  51. D. Acton, "Assessing Quality in Software Engineering: A Pragmatic Approach," University of Pretoria (South Africa), 2013.
  52. M. S. Rahman, F. Khomh, A. Hamidi, J. Cheng, G. Antoniol, & H. Washizaki, "Machine learning application development: practitioners' insights," Software Quality Journal, Vol. 31, no. 4, pp. 1065-1119, Dec. 2023. https://doi.org/10.1007/s11219-023-09621-9
  53. J. Siebert, L. Joeckel, J. Heidrich, A. Trendowicz, K. Nakamichi, K. Ohashi, & M. Aoyama, "Construction of a quality model for machine learning systems," Software Quality Journal, Vol. 30, no. 2, pp. 307-335, Jun. 2022. https://doi.org/10.1007/s11219-021-09557-y
  54. D. Ban, "Static Source Code Analysis in Pattern Recognition," Performance Optimization and Software Maintainability (Doctoral dissertation, Szegedi Tudomanyegyetem (Hungary) 2018.