Educational Technology International

The Korean Society for Education Technology (한국교육공학회)
권호 표지
DOI QR코드

DOI QR Code

Learning Analytics Framework on Metaverse

  • Received : 2023.09.11
  • Accepted : 2023.10.19
  • Published : 2023.10.30
Download PDF
⟨ Previous Next ⟩

Abstract

The recent development of metaverse-related technology has led to efforts to overcome the limitations of time and space in education by creating a virtual educational environment. To make use of this platform efficiently, applying learning analytics has been proposed as an optimal instructional and learning decision support approach to address these issues by identifying specific rules and patterns generated from learning data, and providing a systematic framework as a guideline to instructors. To achieve this, we employed an inductive, bottom-up approach for framework modeling. During the modeling process, based on the activity system model, we specifically derived the fundamental components of the learning analytics framework centered on learning activities and their contexts. We developed a prototype of the framework through deduplication, categorization, and proceduralization from the components, and refined the learning analytics framework into a 7-stage framework suitable for application in the metaverse through 3 steps of Delphi surveys. Lastly, through a framework model evaluation consisting of seven items, we validated the metaverse learning analytics framework, ensuring its validity.

Keywords

References

  1. ASF (2007). Metaverse roadmap: Pathways to the 3D Web. https://metaverseroadmap.accelerating.org/
  2. Birken, S. A., Rohweder, C. L., Powell, B. J., Shea, C. M., Scott, J., Leeman, J., Grewe, M. E., Alexis Kirk, M., Damschroder, L., Aldridge, W. A., Haines, E. R., Straus, S., & Presseau, J. (2018). T-CaST: An implementation theory comparison and selection tool. Implementation Science, 13(1).
  3. Christopoulos, A., Pellas, N., & Laakso, M. J. (2020). A learning analytics theoretical framework for STEM education virtual reality applications. Education Sciences, 10(11), 317.
  4. Dincelli, E., & Yayla, A. (2022). Immersive virtual reality in the age of the Metaverse: A hybrid-narrative review based on the technology affordance perspective. The Journal of Strategic Information Systems, 31(2), 101717.
  5. Engestrom, Y. (1987). Learning by expanding: An activity-theoretical approach to developmental research. OrientaKosultit Oy.
  6. Fernandez-Gallego, B., Lama, M., Vidal, J. C., & Mucientes, M. (2013). Learning analytics framework for educational virtual worlds. Procedia Computer Science, 25, 443-447. https://doi.org/10.1016/j.procs.2013.11.056
  7. Florian, B., Glahn, C., Drachsler, H., Specht, M., & Fabregat Gesa, R. (2011). Activity-based learner-models for learner monitoring and recommendations in Moodle. European Conference on Technology Enhanced Learning, 111-124. 
  8. Springer. Green, R. A. (2014). The Delphi technique in educational research. Sage Open, 4(2), 2158244014529773.
  9. Han, D. I. D., Bergs, Y., & Moorhouse, N. (2022). Virtual reality consumer experience escapes: Preparing for the metaverse. Virtual Reality, 26(4), 1443-1458. https://doi.org/10.1007/s10055-022-00641-7
  10. ISO/IEC TR 20748-1 (2016). Information technology for learning-education and training-learning analytics interoperability-Part1: Reference model.
  11. Jeong, Y., Choi, S., & Ryu, J. (2022). Work-in-progress-Design of LMS for the shared campus in metaverse learning environment. 2022 8th International Conference of the Immersive Learning Research Network (iLRN), 1-3.
  12. Kim, T. G. (2019). Exploring learning data for the application of learning analytics to the regular teaching and learning setting. Asian Journal of Education, 20(4), 1181-1205. https://doi.org/10.15753/aje.2019.12.20.4.1181
  13. Korean Educational Development Institute. (2021). Educational use of the metaverse: Possibilities and limitations. (RM 2021-6).
  14. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
  15. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine, 151(4), 264-269. https://doi.org/10.7326/0003-4819-151-4-200908180-00135
  16. New Media Consortium (2019). The NMC horizon report. EDUCAUSE.
  17. Oliveira, P. C. D., Cunha, C. J. C. D. A., & Nakayama, M. K. (2016). Learning management systems (LMS) and e-learning management: An integrative review and research agenda. JISTEM-Journal of Information Systems and Technology Management, 13, 157-180.
  18. Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hrobjartsson, A., Lalu, M. M., Li, T., Loder, E. W., MayoWilson, E., McDonald, S., … McKenzie, J. E. (2021). PRISMA 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. Bmj, 372.
  19. Park, Y. J., & Jo, I. H. (2014). Need analysis for learning analytics dashboard in LMS: Applying activity theory as an analytic and design tool. Educational Technology Research, 30(2), 221-258.
  20. Reis, R., Marques, B. P., & Sampaio, I. (2020). Learning analytics framework for improving performance to students through educational virtual worlds. International Journal of Education and Information Technologies, 14, 8-13. https://doi.org/10.46300/9109.2020.14.2
  21. Suh, W., & Ahn, S. (2022). Utilizing the metaverse for learner-centered constructivist education in the post-pandemic era: An analysis of elementary school students. Journal of Intelligence, 10(1), 17.
  22. Sukon, K. S., Sharma, K., Boojihawon, D., Gatsha, G., & Panchoo, S. (2012). Using ODL and ICT to develop the skills of the unreached: A contribution to the ADEA triennial of the working group on distance education and open learning. ADEA.
  23. Sun, W., Pinkwart, N., & Li, T. (2021). Current state of learning analytics: A synthesis review based on the combination of activity theory and pedagogy. Advancing the Power of Learning Analytics and Big Data in Education, 1-28.
  24. Wojciechowski, R., & Cellary, W. (2013). Evaluation of learners' attitude toward learning in ARIES augmented reality environments. Computers & Education, 68, 570-585. https://doi.org/10.1016/j.compedu.2013.02.014
  25. Yoon, J. H. (2021). Metaverse, beyond the boundary of virtual and reality. Science and Technology Policy Institute.
  26. You, J., Kim, W., Lee, H. S., & Kwon, M. (2021). Best content standards in sports career education for adolescents: A Delphi survey of Korean professional views. Sustainability, 13(12), 6566.