Journal of Multimedia Information System

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Using Kirkpatrick's Evaluation Model in a Multimedia-based Blended Learning Environment

  • Received : 2017.08.31
  • Accepted : 2017.09.14
  • Published : 2017.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Over the years, there has been much research in blended learning. However, research regarding its use and evaluation is inconsistent, not following any specific evaluation method, and may not be applicable to local students. In this research, a case study was conducted to evaluate the environment based on three levels of Kirkpatrick's model. Methodological triangulation was the principle of data collection used in which multiple sources of evidence were triangulated to provide insights into this study. Instruments used include surveys, interviews, questionnaires and pre- and post-tests that are guided by Kirkpatrick's model. The results revealed that students were positive with the learning environment. Students enjoyed learning with multimedia and motivated to learn as well as engaged in the environment. The tests showed significant difference in their learning. Students also perceived that they have transferred their learning from face-to-face lecture into problem-based learning and learning outcome. This research contributes to the field by providing deeper insights into assessments in multimedia-based blended learning environment and empirical evidence on views, attitudes, learning and knowledge transfer of students in higher education.

Keywords

References

  1. Malik, S. and Agarwal, A. (2012). Use of Multimedia as a New Educational Technology Tool-A Study. International Journal of Information and Education Technology, 2(5), 468-471.
  2. Kirkpatrick, D.L. (1996). Evaluating Training Programs. San Francisco: Berrett-Koehler.
  3. Hoic-Bozic, N., Vedran, M. and Ivica, B. (2009). A Blended Learning Approach to Course Design and Implementation. IEEE transactions on education(0018-9359), 52 (1), 19-30. https://doi.org/10.1109/TE.2007.914945
  4. Maryam Tayebinik and Marlia Puteh (2012). Blended Learning or E-learning? International Magazine on Advances in Computer Science and Telecommunications, 3(1), 103-110.
  5. Chrysafiadi, K., and Virvou, M. (2013). PeRSIVA: An empirical evaluation method of a student model of an intelligent e-learning environment for computer programming. Computers & Education, 68. 322-333. doi:10.1016/j.compedu.2013.05.020
  6. Diefes-Dux, H.A., C. Samant, T.E. Johnson, and O'Connor, D. (2004). Kirkpatrick's level 1 evaluation of the implementation of a computer-aided process design tool in a senior-level engineering course. Journal of Engineering Education 93(4): 321-31. https://doi.org/10.1002/j.2168-9830.2004.tb00821.x
  7. Wittenborn, D (2008). PhD thesis. Assessment of a Blended Instructional Delivery System for Product Lifecycle Management Education. Purdue University, U.S.A.
  8. Winfrey, E.C. (2002). Kirkpatrick's Four Levels of Evaluation. Retrieved September 7, 2011 from http://coe.sdsu.edu/eet/Atricles/k4levels/index.htm
  9. Yin, R.K. (2009). Case Study Research: Design and Methods (4th ed.). Thousand Oaks, CA: Sage.
  10. Cohen, L., Manion, L., and Morrison, K., (2000) (5th Edition), Research Methods in Education, London: RoutledgeFalmer
  11. Alreck, P. L., and Settle, R. B. (1995). The survey research handbook: Guidelines and strategies for conducting a survey (2nd). Burr Ridge, IL: Irwin.
  12. Alsadhan, A., Alhomod, S. and Shafi, M. (2014). Multimedia Based E-learning : Design and Integration of Multimedia Content in E-learning. International Journal of Emerging Technologies in Learning (iJET), 9(3), 26-30. Kassel, Germany: Kassel University Press GmbH. https://doi.org/10.3991/ijet.v9i3.3308
  13. Hailikari, T.K. and Parpala, A. (2014). What impedes or enhances my studying? The interrelation between approaches to learning, factors influencing study progress and earned credits. Teaching in Higher Education. 19(7). http://dx.doi.org/10.1080/13562517.2014.934348
  14. Jereb, E., and Smitek, B. (2006). Applying multimedia instruction in e-learning. Innovations in Education & Teaching International, 43(1), 15-27. https://doi.org/10.1080/14703290500467335
  15. Kang, M., Hahn, J., Yoo, E. and Kim, B. (2011). Validating a Technology Enhanced Student-Centered Learning Model. In T. Bastiaens & M. Ebner (Eds.), Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2011 (pp. 3025-3034). Chesapeake, VA: AACE.
  16. Lim, D. H., and Morris, M. L. (2009). Learner and Instructional Factors Influencing Learning Outcomes within a Blended Learning Environment. Educational Technology & Society, 12 (4), 282-293
  17. Moos, D.C and Marroquin, E (2010). Multimedia, hypermedia, and hypertext: Motivation considered and reconsidered, Computers in Human Behavior, 26(3), 265-276. 10.1016/j.chb.2009.11.004.(http://www.sciencedirect.com/science/article/pii/S0747563209001757)
  18. Lim C.P., Khine M. S., Hew, T., Wong, P., Shanti, D. and Lim, B. (2003). Exploring critical aspects of information technologies integration in Singapore schools. Australian Journal of Educational Technology, 19(1), 1-24. http://www.ascilite.org.au/ajet/ajet19/lim.html
  19. Field, A. (2009). Discovering Statistics Using SPSS (3rd ed.). United States of America: SAGE Publication Ltd.