Browse > Article
http://dx.doi.org/10.3837/tiis.2020.05.013

Statistical Profiles of Users' Interactions with Videos in Large Repositories: Mining of Khan Academy Repository  

Yassine, Sahar (University of Alcala)
Kadry, Seifedine (Department of Mathematics and Computer Science, Faculty of Science, Beirut Arab University)
Sicilia, Miguel Angel (University of Alcala)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.5, 2020 , pp. 2101-2121 More about this Journal
Abstract
The rapid growth of instructional videos repositories and their widespread use as a tool to support education have raised the need of studies to assess the quality of those educational resources and their impact on the quality of learning process that depends on them. Khan Academy (KA) repository is one of the prominent educational videos' repositories. It is famous and widely used by different types of learners, students and teachers. To better understand its characteristics and the impact of such repositories on education, we gathered a huge amount of KA data using its API and different web scraping techniques, then we analyzed them. This paper reports the first quantitative and descriptive analysis of Khan Academy repository (KA repository) of open video lessons. First, we described the structure of repository. Then, we demonstrated some analyses highlighting content-based growth and evolution. Those descriptive analyses spotted the main important findings in KA repository. Finally, we focused on users' interactions with video lessons. Those interactions consisted of questions and answers posted on videos. We developed interaction profiles for those videos based on the number of users' interactions. We conducted regression analysis and statistical tests to mine the relation between those profiles and some quality related proposed metrics. The results of analysis showed that all interaction profiles are highly affected by video length and reuse rate in different subjects. We believe that our study demonstrated in this paper provides valuable information in understanding the logic and the learning mechanism inside learning repositories, which can have major impacts on the education field in general, and particularly on the informal learning process and the instructional design process. This study can be considered as one of the first quantitative studies to shed the light on Khan Academy as an open educational resources (OER) repository. The results presented in this paper are crucial in understanding KA videos repository, its characteristics and its impact on education.
Keywords
Open Educational Resources; Quantitative Analysis; Instructional Video; Users' Interactions; Learning Repository; Online Learning;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Kim, J., Li, S.-W. (Daniel), Cai, C.J., Gajos, K.Z., Miller, R.C., "Leveraging Video Interaction Data and Content Analysis to Improve Video Learning," in Proc. of CHI '14 Workshop on Learning Innovation at Scale, pp. 1-6, 2014.
2 Li, N., Kidzinski, L., Jermann, P., Dillenbourg, P., "MOOC video interaction patterns: What do they tell us?," Design for Teaching and Learning in a Networked World, pp. 197-210, 2015.
3 Haya, P.A., Daems, O., Malzahn, N., Castellanos, J., Hoppe, H.U., "Analysing content and patterns of interaction for improving the learning design of networked learning environments," Br. J. Educ. Technol, 46, 300-316, 2015.   DOI
4 Loff, S., "NASA, Khan Academy Collaborate to Bring STEM Opportunities to Online Learners, https://www.nasa.gov/content/nasa-khan-academy-collaborate-to-bring-stem-opportunities-to-online-learners
5 Khan Academy Practice I SAT Suite of Assessments - The College Board, https://collegereadiness.collegeboard.org/about/benefits/khan-academy-practice
6 Alpert, F., Hodkinson, C.S., "Video use in lecture classes: current practices, student perceptions and preferences," Educ. Train, 61, 31-45, 2019.   DOI
7 Giannakos, M.N., Chorianopoulos, K., Chrisochoides, N., "Making sense of video analytics: Lessons learned from clickstream interactions, attitudes, and learning outcome in a video-assisted course," Int. Rev. Res. Open Distance Learn, 16, 260-283, 2015.
8 Saurabh, S., Gautam, S., "Modelling and statistical analysis of YouTube's educational videos: A channel Owner's perspective," Comput. Educ., 128, 145-158, 2019.   DOI
9 Yip, J., Wong, S.H., Yick, K.L., Chan, K., Wong, K.H., "Improving quality of teaching and learning in classes by using augmented reality video," Comput. Educ., 128, 88-101, 2019.   DOI
10 Wiley, D., "Connecting Learning Objects to Instructional Design Theory: A definition, a metaphor, and a taxonomy," Instr. use Learn. objects, 10, 1-35, 2000.   DOI
11 Lee, B.G., Kim, S.J., Park, K.C., Kim, S.J., Jeong, E.S., "Empirical analysis of learning effectiveness in u-learning environment with digital textbook," KSII Trans. Internet Inf. Syst., 6, 869-885, 2012.   DOI
12 Hwang, G.-J., Lai, C.-L., Wang, S.-Y., "Seamless flipped learning: a mobile technology-enhanced flipped classroom with effective learning strategies," J. Comput. Educ., 2, 449-473, 2015.   DOI
13 Zengin, Y., "Investigating the use of the Khan Academy and mathematics software with a flipped classroom approach in mathematics teaching," Educ. Technol. Soc., 20, 89-100, 2017.
14 Kay, R.H., "Exploring the use of video podcasts in education: A comprehensive review of the literature," Comput. Human Behav., 28, 820-831, 2012.   DOI
15 Cargile, L.A., Harkness, S.S., "Flip or Flop: Are Math Teachers Using Khan Academy as Envisionedby Sal Khan?," TechTrends, 59, 21-28, 2015.   DOI
16 Santos-Hermosa, G., Ferran-Ferrer, N., Abadal, E., "Repositories of open educational resources: An assessment of reuse and educational aspects," Int. Rev. Res. Open Distance Learn, 18, 84-120, 2017.
17 Karabulut-Ilgu, A., Jaramillo Cherrez, N., Jahren, C.T., "A systematic review of research on the flipped learning method in engineering education," Br. J. Educ. Technol, 49, 398-411, 2018.   DOI
18 Ochoa, X., Duval, E., "Quantitative analysis of learning object repositories," TLT, pp. 226-238, 2009.
19 Hylen, J., "Open Educational Resources : Opportunities and Challenges," Proc. Open Educ., 4963, 49-63, 2006.
20 Thompson, C., "How Khan Academy is changing the rules of education," Wired Mag., 126, 1-5, 2011.
21 Cechinel, C., Sanchez-Alonso, S., Garcia-Barriocanal, E., "Statistical profiles of highly-rated learning objects," Comput. Educ., 57, 1255-1269, 2011.   DOI
22 Cechinel, C., Camargo, S.D.S., Sanchez-Alonso, S., Sicilia, M.A., "Towards automated evaluation of learning resources inside repositories," Recommender Systems for Technology Enhanced Learning: Research Trends and Applications, Springer, pp. 25-46, 2014.
23 Clements, K., Pawlowski, J., Manouselis, N., "Open educational resources repositories literature review - Towards a comprehensive quality approaches framework," Comput. Human Behav., 51, 1098-1106, 2015.   DOI
24 Robinson, D.E., Wizer, D.R., "Universal Design for Learning and the Quality Matters Guidelines for the Design and Implementation of Online Learning Events," Int. J. Technol. Teach. Learn, 12, 17-32, 2016.
25 Holland, A.A., "Effective principles of informal online learning design: A theory-building metasynthesis of qualitative research. Comput," Educ., 128, 214-226, 2019.   DOI