The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Information System Evaluation using IPA Method

IPA 기법을 활용한 정보시스템 평가

  • 박민수 (강남대학교 데이터사이언스전공)
  • Received : 2020.07.31
  • Accepted : 2020.08.12
  • Published : 2020.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Information service organizations that provide science and technology information with a relatively short information life cycle for free or paid are in need of reflecting rapidly changing user needs and behaviors and grafting the latest technologies. The purpose of this study is to derive improvements for each system by comparing and analyzing general recognition of science and technology information users' domestic and foreign science and technology information sites and importance by science and technology information attributes. A total of 816 users of science and technology information participated in the online survey, and the collected data were analyzed by quantitative methods including IPA (Importance Performance Analysis) technique. The importance was evaluated by the impact value calculated through regression analysis. As a result of data analysis, the general recognition of users on science and technology information sites was relatively high in national science and technology information services, and Google Scholar and Science Direct were also high. Google Scholar was found to have more strength than improvement. A better understanding of the user's preferred system is a good driving force for improving the lack of existing systems. It is necessary to improve the information retrieval of the science and technology information service system, that is, to improve the search speed and functions, and also to improve the user interface with improved convenience and usability.

정보의 생명주기가 비교적 짧은 과학기술정보를 무료 또는 유료로 제공하는 정보서비스기관들에게는 그 어느 때보다도 빠르게 변하는 이용자니즈와 행태를 반영하고 최신기술을 접목시켜야 하는 필요성이 대두되고 있다. 본 연구의 목적은 과학기술정보 이용자들의 국내 및 국외 과학기술정보사이트들에 대한 일반적인 인지도와 과학기술정보 속성 별 중요도를 비교 분석하여 각 시스템 별 개선점을 도출하는 데에 있다. 과학기술정보 이용자, 총 816명이 온라인 설문조사에 참여하였으며, 수집한 데이터는 IPA(Importance Performance Analysis) 기법을 포함한 정량적 방법으로 분석하였다. 중요도는 회귀분석을 통해 산출된 임팩트 수치로 평가하였다. 데이터 분석 결과, 과학기술정보사이트에 대한 이용자들의 일반적 인지도는 국가과학기술정보서비스가 비교적 높게 나타났으며, 이와 함께 Google Scholar, Science Direct 등이 높게 나타났다. Google Scholar는 개선영역보다는 많은 강점을 갖춘 것으로 나타났다. 사용자가 선호하는 시스템에 대한 보다 나은 이해는 기존 시스템의 부족한 부분을 개선하는 데 좋은 원동력이 된다. 과학기술정보서비스시스템의 정보검색의 강화 즉, 검색속도 및 기능을 향상시킬 필요가 있으며 편의성 및 사용성을 높인 이용자인터페이스 또한 개선이 요구된다.

Keywords

References

  1. D. O. Case. Looking for information: a survey of research on information seeking, needs, and behavior, Emerald Group Publishing, 2012.
  2. M. Park, "Multi-dimensional analysis of dynamic human-information interaction," Information Research, Vol. 18, No. 1, Paper 566, 2013.
  3. M. Park, “Human multiple information task behavior on the Web,” Aslib Journal of Information Management, Vol. 67, No. 2, pp. 118-135, 2015. https://doi.org/10.1108/AJIM-12-2013-0154
  4. M. Park, “Cognitive factors in adaptive information access,” International Journal of Advanced Culture Technology, Vol. 6, No. 4, pp. 309-316, 2018. https://doi.org/10.17703//IJACT2018.6.4.309
  5. P. J. Agerfalk, J. Sjostrom, E. Eliasson, S. cronholm, and G. Goldkuhl, "Setting the scene for actability evaluation: understanding information systems in context," in Proceedings of ECITE Conference, 2002.
  6. H. Beyer and K. Holtzblatt, Contextual design: defining customer-centered systems, San Diego: Academic Press, 1998.
  7. S. Cronholm and G. Goldkuhl, "Actable information systems - quality ideals put into practice," in Proceedings of the Eleventh Conference on Information Systems, 12-14 September, 2002.
  8. M. Park, "User participation evaluation of a scholarly information site," Journal of the Korean Society for Information Management, Vol. 28, No. 4. pp. 85-97, 2011. https://doi.org/10.3743/KOSIM.2011.28.4.085
  9. M. Park, “Usability of the national science and technology information system,” Journal of the Korean Biblia Society for Library and Information Science, Vol. 22, No. 4, pp. 5-19, 2011. https://doi.org/10.14699/kbiblia.2011.22.4.005
  10. M. Park and T. Lee, “Understanding science and technology information users through transaction log analysis,” Library Hi Tech, Vol. 31, No. 1, pp. 123-140, 2013. https://doi.org/10.1108/07378831311303976
  11. M. Park and T. Lee, "A longitudinal study of information needs and search behaviors in science and technology: A query analysis, Electronic Library, Vol. 34, No. 1, pp. 83-98, 2016. https://doi.org/10.1108/EL-04-2014-0058