Educational Technology International

The Korean Society for Education Technology (한국교육공학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Design Guidelines of Learning Analytics to Facilitate Self-Regulated Learning in MOOCs

  • Received : 2016.03.07
  • Accepted : 2016.04.01
  • Published : 2016.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to develop design guidelines on the learning analytics which can help to promote students' self-regulated learning (SRL) strategies in MOOCs learning environments. First of all, to develop the first draft of design guidelines, relevant literature review and case analysis on current MOOCs platforms such as edX, K-MOOC, Coursera, Khan Academy and FutureLearn were conducted. Then, to validate the design guidelines, expert reviews (validation questionnaires and in-depth interviews) and learner evaluation (in-depth interviews) were conducted. Through the recursive validation, the design guidelines were finalized. Overall, the final version of design guidelines on learning analytics to facilitate SRL strategies was suggested. The final design guidelines consist of 15 items in 10 categories related to the information analyzed based on individual student's learning behaviors and activities on MOOCs environments. Moreover, the results of interview also revealed that the social comparisons, learning progress reports, and personalization might contribute to the improvements of their SRL competences. This study has an implication that MOOCs could offer a higher success or completion rate to students with low SRL skills by taking advantage of the information on learning analytics

Keywords

Acknowledgement

This work was supported by the Soonchunhyang University Research Fund.

References

  1. Anderson, T. (2013). Promise and/or peril: MOOCs and open and distance education. Retrieved from http://econtent.hogrefe.com/health-sciences/index/A65RM03P4874243N.pdf
  2. Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment, 8(1), 13-25.
  3. Cha, H. J. & Park, T. G. (2013). Design guidelines for teacher's professional development program that help improve self-regulated learning skills through OER. The Korean association of computer education, 16(5), 69-83.
  4. Cho, M. H. (2004). The effects of design strategies for promoting students' self-regulated learning skills on students' self-regulation and achievements in online learning environments. Retrieved from http://eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01.
  5. Daniel, J. (2012). Making sense of MOOCs: Musings in a maze of myth, paradox and possibility. Journal of interactive Media in education, 3, 1-20.
  6. Daphne, K., Andrew, N., Chuong, D., & Zhenghao, C. (2013). Retention and intention in massive open online courses. Educause Review, 48(3), 62-63.
  7. Goldberg, B., Sottilare, R., Roll, I., Lajoie, S., Poitras, E., Biswas, G., Segedy, J., Kinnebrew, J., Wiese, E., Long, Y., Aleven, V., Koedinger, K., Winne, P. (2014). Enhancing Self-Regulated Learning through Metacognitively-Aware Intelligent Tutoring Systems. In Proceedings of the 11th International Conference of the Learning Sciences (pp. 1-10).
  8. Johnson, L., Adams Becker, S., Cummins, M., Estrada, V., Freeman, A., and Ludgate, H. (2013). NMC Horizon Report: 2013 Higher Education Edition. Austin, TX: The New Media Consortium.
  9. Johnson, L., Adams Becker, S., Estrada, V., and Freeman, A. (2015). NMC Horizon Report: 2015 Higher Education Edition. Austin, TX: The New Media Consortium.
  10. Johnson, L., Adams Becker, S., Cummins, M., Estrada, V., Freeman, A., and Hall, C. (2016). NMC Horizon Report: 2016 Higher Education Edition. Austin, TX: The New Media Consortium.
  11. Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1), 133-160.
  12. Kizilcec, R. F., Perez-Sanagustin, M., & Maldonado, J. J. (2016). Recommending Self-Regulated Learning Strategies Does Not Improve Performance in a MOOC. In Proceeding of the Third ACM Conference on Learning @ Scale (pp. 101-104).
  13. Lim, C., & Park, T. (2015). Self-Regulated E-Learning Design Principles. In J. M. Spector (Ed.), The SAGE Encyclopedia of Educational Technology (Vol. 2, pp. 631-635). Thousand Oaks, CA: Sage Publications.
  14. Littlejohn, A., Hood, N., Milligan, C., & Mustain, P. (2016). Learning in MOOCs: Motivations and self-regulated learning in MOOCs. The Internet and Higher Education, 29, 40-48.
  15. Marshall, C., & Rossman, G. B. (1999) Designing qualitative research (3rd ed.). Thousand Oaks, CA: Sage Publications.
  16. Meyer, R. (2012). What it's like to teach a MOOC (and what the heck'sa MOOC?). Retrieved from http://www.theatlantic.com/technology/archive/2012/07/hat-its-like-to-teach-a-mooc-and-what-the-hecks-a-mooc/260000/
  17. Noy, C. (2008). Sampling knowledge: The hermeneutics of snowball sampling in qualitative research. International Journal of social research methodology, 11(4), 327-344.
  18. Park, Y., & Cho, I. (2014). Design and Application of Visual Dashboard Based on Learning Analytics. The Journal of Educational Information and Media, 20(2), 191-216.
  19. Parr, C. (2013). MOOC completion rates 'below 7%'. Times Higher Education. Retrieved from https://www.timeshighereducation.com/news/mooc-completion -rates-below-7/2003710.article.
  20. Rha, I. J. (2015). Understanding MOOCs in a Global Learning Age. Seoul, ROK: Hakjisa.
  21. Romero, C., & Ventura, S. (2007). Educational data mining: A survey from 1995 to 2005. Expert systems with applications, 33(1), 135-146.
  22. Romero, C., Ventura, S., Pechenizkiy, M., & Baker, R. S. (Eds.). (2010). Handbook of educational data mining. Boca Raton, FL: CRC Press.
  23. Rowe, F. A. & Rafferty, J. A. (2013). Instructional design interventions for supporting self-regulated learning: enhancing academic outcomes in postsecondary e-learning environments. MERLOT Journal of Online Learning and Teaching, 9(4), 590-601.
  24. Simens, G., & d Baker, R. S. (2012). Learning analytics and educational data mining: towards communication and collaboration. In Proceedings of 2012 ACM 2nd international conference on learning analytics and knowledge (pp. 252-254).
  25. Wang, Y., & Baker, R. (2015). Content or platform: Why do students complete MOOCs?. Journal of Online Learning and Teaching, 11(1), 17-30.
  26. Wintrup, J., Wakefield, K., & Davis, H. C. (2015). Engaged learning in MOOCs: a study using the UK Engagement Survey. Retrieved from https://www.heacademy.ac.uk/sites/default/files/resources/engaged-learning-in-MOOCs.pdf.
  27. Yousef, A. M. F., Chatti, M. A., Schroeder, U., & Wosnitza, M. (2014). What Drives a Successful MOOC? An Empirical Examination of Criteria to Assure Design Quality of MOOCs. In Proceedings of 2014 IEEE 14th International Conference on Advanced Learning Technologies (pp. 44-48).
  28. Yousef, A. M. F., Chatti, M. A., Wosnitza, M., & Schroeder, U. (2015). A Cluster Analysis of MOOC Stakeholder Perspectives. RUSC. Universities and Knowledge Society Journal, 12(1), 74-90.
  29. Zheng, S., Rosson, M. B., Shih, P. C., & Carroll, J. M. (2015). Understanding student motivation, behaviors and perceptions in MOOCs. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (pp. 1882-1895).
  30. Zimmerman, B. J. (1998). Developing self-fulfilling cycles of academic regulation: An analysis of exemplary instructional models. In D. H. Schunk & B. J. Zimmerman (Eds.), Self- regulated learning: From teaching to self-reflective practice (pp. 1-19). New York, NY: Guilford Press.
  31. Zimmerman, B. J., & Martinez-Pons, M. (1986). Development of a structured interview for assessing students' use of self-regulated learning strategies. American Educational Research Journal, 23, 614-628.
  32. Zumbrunn, S., Tadlock, J., & Roberts, E. D. (2011). Encouraging self-regulated learning in the classroom: A review of the literature. Unpublished manuscript, Metropolitan Educational Research Consortium, Virginia Commonwealth University, Richmond, VA. Retrieved from http://merc.soe.vcu.edu/Reports/Self%Regulated%Learning.pdf