DOI QR코드

DOI QR Code

KnowLearn: Evaluating cross-subjects interactive learning by deploying knowledge graph

  • Haolei LIN (Department of Building and Real Estate, Faculty of Construction and Environment, University of The Hong Kong Polytechnic University) ;
  • Junyu CHEN (Department of Building and Real Estate, Faculty of Construction and Environment, University of The Hong Kong Polytechnic University) ;
  • Hung-Lin CHI (Department of Building and Real Estate, Faculty of Construction and Environment, University of The Hong Kong Polytechnic University)
  • Published : 2024.07.29

Abstract

In the realm of Architecture, Engineering, and Construction (AEC) education, various factors play a crucial role in shaping students' acceptance of the learning environments facilitated by visualization technologies, such as virtual reality (VR). Works on leveraging the heterogeneous educational information (i.e., pedagogical data, student performance data, and student survey data) to identify essential factors influencing students' learning experience and performance in virtual environments are still insufficient. This research proposed KnowLearn, an interactive learning assistant system, to integrate an educational knowledge graph (KG) and a locally deployed large language model (LLM) to generate real-time personalized learning recommendations. As the knowledge base of KnowLearn, the educational KG accommodated multi-faceted educational information from twelve perspectives, such as the teaching content, students' academic performance, and their perceived confidence in a specific course from the AEC discipline. A heterogeneous graph attention network (HAN) was utilized to infer the latent information in the KG and, thus, identified the perceived confidence, intention to use, and performance in a relevant quiz as the top three indicators that significantly influenced students' learning outcomes. Based on the information preserved in the KG and learned from the HAN model, the LLM enhanced the personalization of recommendations concerning adopting virtual learning environments while protecting students' privacy. The proposed KnowLearn system is expected to feasibly provide enhanced recommendations on the teaching module design for educators from the AEC domain.

Keywords

Acknowledgement

The authors would like to thank The Hong Kong Polytechnic University for the funding support under the Teaching Development Grant (No. TDG22-25/SEI-1).

References

  1. Li X, Yi W, Chi H L, et al. A critical review of virtual and augmented reality (VR/AR) applications in construction safety[J]. Automation in Construction, 2018, 86: 150-162.
  2. Wang, P., Wu, P., Wang, J., Chi, H. L., & Wang, X. (2018). A critical review of the use of virtual reality in construction engineering education and training. International journal of environmental research and public health, 15(6), 1204.
  3. Fogarty, J., McCormick, J., & El-Tawil, S. (2018). Improving student understanding of complex spatial arrangements with virtual reality. Journal of Professional Issues in Engineering Education and Practice, 144(2), 04017013.
  4. Perlman, A., Sacks, R., & Barak, R. (2014). Hazard recognition and risk perception in construction. Safety Science, 64, 22-31.
  5. Wong, K. D. A., Wong, K. W. F., & Nadeem, A. (2011). Building information modeling for tertiary construction education in Hong Kong. Journal of Information Technology in Construction (ITcon), 16(27), 467-476.
  6. Zheng, L., Zhu, M., & Yu, H. (2020, August). A virtual environment making method for CAVE system. In 2020 International Conference on Computing and Data Science (CDS) (pp. 377-380). IEEE.
  7. AL-Oudat, M., & Altamimi, A. (2022). Factors influencing behavior intentions to use virtual reality in education. International Journal of Data and Network Science, 6(3), 733-742.
  8. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
  9. Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems.
  10. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410.
  11. Bing Chat. https://www.digitaltrends.com/computing/how-to-use-microsoft-chatgpt-bing-edge/, 2023. Available Online, Accessed on March.
  12. Wang, X., Ji, H., Shi, C., Wang, B., Ye, Y., Cui, P., & Yu, P. S. (2019, May). Heterogeneous graph attention network. In The world wide web conference (pp. 2022-2032).