An Analysis Method and Environment for Team Project-Based Learning in Non-Face-to-Face Situation for Student Evaluation

An educator may utilize various pedagogies such as hands-on practice, practicum, and project-based learning to enhance a student's competency. Among various pedagogies, project-based learning is one of the well-known pedagogies that may provide similar on-the-job experience. In general, an educator may divide the students into small groups and assign tasks to check students' cooperation skills and achievements during project-based learning. However, an educator may experience difficulties operating project-based learning due to the COVID-19 pandemic. Most of the team activities are done in non-face-to-face meetings, and as a consequence, the educator may not find an underachieving team easily and cannot intervene appropriately. This study introduces a rigorous analysis method to evaluate team activities to analyze individual students' participation and contributions. First, this study develops evaluation rubrics by conducting questionnaires to professors and students to find an appropriate weight value for the evaluation scale. Then, this research introduces an analysis environment to evaluate students automatically. The analysis environment collects dialog data from social network services and measures interactions among students in a team. After measuring interactions, the environment generates a report to visualize the team activities. We applied the proposed method and environment to the capstone design course to show the effectiveness of the method and environment. Based on the case study, the environment showed that the analysis method could easily indicate the teams' activities and check the level of participation.

비대면 팀 프로젝트 기반 수업 평가를 위한 분석 방법 및 평가환경