Journal of the Korean BIBLIA Society for library and Information Science (한국비블리아학회지)

Korean Biblia Society for Library and Information Science (한국비블리아학회)
권호 표지
DOI QR코드

DOI QR Code

Digital Library Evaluation Criteria: What do Users Want?

디지털 도서관 평가기준: 이용자들이 원하는 것은 무엇인가?

  • Xie, Iris (School of Information Studies, University of Wisconsin-Milwaukee) ;
  • Joo, Soohyung (School of Information Studies, University of Wisconsin-Milwaukee) ;
  • Matusiak, Krystyna K. (Morgridge College of Education, University of Denver)
  • Received : 2014.02.17
  • Accepted : 2014.03.13
  • Published : 2014.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

Criteria for evaluating digital libraries have been suggested in prior studies, but limited research has been done to understand users' perceptions of evaluation criteria. This study investigates users' opinions of the importance of digital library evaluation criteria. Thirty user participants, including 10 faculty members and 20 students, were recruited from five universities across the United States. They were asked to rate the importance of evaluation criteria in eight dimensions (e.g. collections, information organization, context, etc.). The results demonstrate that users care about evaluation criteria related to the use and quality of collection and services rather than the operation of digital libraries. The findings of this study are relevant to the development of user-centered digital libraries and associated evaluation frameworks through the incorporation of unique users' needs and preferences.

기존의 여러 연구들에서 디지털 도서관 평가를 위한 기준들이 제시되어 왔으나, 대부분의 연구에서 평가기준에 대한 이용자 관점을 이해하려는 노력이 부족하였다. 본 연구는 디지털 도서관 평가 기준들에 대한 이용자들의 의견을 미국 내 5개 대학교에서 10명의 교수 이용자와 20명의 학생 이용자에게 설문을 통해 직접 조사하였다. 설문 참여자들은 본 연구진에 의해 제시된 8개 영역 (장서, 정보조직, 맥락 등) 내 평가 기준들의 중요성에 대해 7점 척도로 응답하였다. 설문의 결과는 이용자들이 장서의 이용과 품질, 서비스와 관련된 항목들을 도서관 운영항목에 비해 상대적으로 더 중요하게 생각하고 있었음을 보여주었다. 본 연구의 결과는 이용자 중심의 디지털 도서관 개발과 관련하여 이용자의 요구와 선호를 반영하는 도서관 평가체계 구축에 도움이 될 것이다.

Keywords

References

  1. Borgman, C. L., G. H. Leazer, A. J. Gilliland-Swetland, and R. Gazan. 2000. "Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth Prototype (ADEPT)." Library Trends, 49: 228-250.
  2. Buttenfield, B. 1999. "Usability Evaluation of Digital Libraries." Science & Technology Libraries, 17(3/4):39-50. https://doi.org/10.1300/J122v17n03_04
  3. Candela, L., D. Castelli, P. Pagano,, C. Thanos, Y. Ioannidis, G. Koutrika, S. Ross, H. Schek, and H. Schuldt. 2007. Setting the Foundations of Digital Libraries: The DELOS Manifesto. D-Lib Magazine, 13(3/4).[cited 2014.1.14]. .
  4. Fox, E. A., R. M. Akscyn, R. K. Furuta, and J. J. Leggett. 1995. "Digital Libraries." Communications of the ACM, 38(4): 23-28.
  5. Fuhr, N., P. Hansen, M. Mabe, A. Micsik, and I. Solvberg. 2001. "Digital Libraries: A Generic Classification and Evaluation Scheme." Lecture Notes in Computer Science, 2163: 187-199.
  6. Fuhr, N., G. Tsakonas, T. Aalberg, M. Agosti, P. Hansen, S. Kapidakis, C. Klas, L. Kovacs, M. Landoni, A. Micsik, C. Papatheodorou, C. Peters, and I. Solvberg. 2007. "Evaluation of Digital Libraries."International Journal on Digital Libraries, 8(1): 21-38. https://doi.org/10.1007/s00799-007-0011-z
  7. Hill, L.L., R. Dolin, J. Frew, R.B. Kemp, M. Larsgaard, D.R. Montello, M.-A. Rae, and J. Simpson. 1997."User Evaluation: Summary of the Methodologies and Results for the Alexandria Digital Library, University of California at Santa Barbara." Proceedings of 60th ASIST Annual Meeting. (pp. 225-243, 369). Medford, NJ: Information Today.
  8. Hill, L. L., L. Carver, M. Larsgaard, R. Dolin, T. R. Smith, J. Frew, and M.-A. Rae. 2000. "Alexandria Digital Library: User Evaluation Studies and System Design." Journal of the American Society for Information Science, 51: 246-259. https://doi.org/10.1002/(SICI)1097-4571(2000)51:3<246::AID-ASI4>3.0.CO;2-6
  9. Jeng, J. 2005. "Usability Assessment of Academic Digital Libraries: Effectiveness, Efficiency, Satisfaction, and Learnability." Libri, 55: 96-121.
  10. Joo, S. and J. Lee. 2011. "Measuring the Usability of Academic Digital Libraries: Instrument Development and Validation." The Electronic Library, 29(4): 523-537. https://doi.org/10.1108/02640471111156777
  11. Marchionini, G., C. Plaisant, and A. Komlodi. 1998. " Interfaces and Tools for the Library of Congress National Digital Library Program." Information Processing & Management, 34(5): 535-555. https://doi.org/10.1016/S0306-4573(98)00020-X
  12. Matusiak, K. K. 2012. " Perceptions of Usability and Usefulness of Digital Libraries." The International Journal of Humanities and Arts Computing, 6(1-2): 133-147. https://doi.org/10.3366/ijhac.2012.0044
  13. Nielson. J. 1993. Usability Engineering. Academic Press: Cambridge.
  14. Noh, Y. 2010. "A Study on Developing Evaluation Criteria for Electronic Resources in Evaluation Indicators of Libraries." Journal of Academic Librarianship, 36(1): 41-52. https://doi.org/10.1016/j.acalib.2009.11.005
  15. Saracevic, T. and L. Covi. 2000. "Challenges for Digital Library Evaluation." Proceedings of the American Society for Information Science, 37: 341-350.
  16. Saracevic, T. 2004. Evaluation of Digital Libraries: An Overview. Presented at the DELOS Workshop on the Evaluation of Digital Libraries. [cited 2014.2.14]. -> need cited date. .
  17. Tsakonas, G., S. Kapidakis, and C. Papatheodorou. 2004. Evaluation of User Interaction in Digital Libraries. In M. Agosti, N. Fuhr (eds.) Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries, Padua, Italy.
  18. Van House, N. A., M. H. Butler, V. Ogle, and L. Schiff. 1996. "User-centered Iterative Design for Digital Libraries: The Cypress Experience." D-Lib Magazine, 2.
  19. Xie, I. 2006. "Evaluation of Digital Libraries: Criteria and Problems from Users' Perspectives." Library & Information Science Research, 28(3): 433-452. https://doi.org/10.1016/j.lisr.2006.06.002
  20. Xie, I. 2008. "Users' Evaluation of Digital Libraries: Their Uses, Their Criteria, and Their Assessment." Information Processing & Management, 44(3): 1346-1373. https://doi.org/10.1016/j.ipm.2007.10.003
  21. Ward, J.L. and S. Hiller. 2005. "Usability Testing, Interface Design, and Portals." Journal of Library Administration, 43(1): 155-171. https://doi.org/10.1300/J111v43n01_10
  22. Zhang, Y. 2010. "Developing a Holistic Model for Digital Library Evaluation." Journal of the American Society for Information Science and Technology, 61(1): 88-110. https://doi.org/10.1002/asi.21220

Cited by

  1. Exploring digital library usage for getting information from the ELM perspective vol.68, pp.3, 2016, https://doi.org/10.1108/AJIM-12-2015-0200