Browse > Article
http://dx.doi.org/10.9708/jksci.2022.27.03.225

The Artificial Intelligence Literacy Scale for Middle School Students  

Kim, Seong-Won (Dept. of Computer Education, Silla University)
Lee, Youngjun (Dept. of Computer Education, Korea National University of Education)
Publication Information
Journal of the Korea Society of Computer and Information / v.27, no.3, 2022 , pp. 225-238 More about this Journal
Abstract
Although the importance of literacy in Artificial Intelligence (AI) education is increasing, there is a lack of testing tools for measuring such competency. To address this gap, this study developed a testing tool that measures AI literacy among middle school students. This goal was achieved through the establishment of an expert group that was enlisted to determine the relevant factors and items covered by the proposed tool. To verify the reliability and validity of the developed tool, a field review, exploratory factor analysis, and confirmatory factor analysis were conducted. These procedures resulted in a testing tool comprising six domains that encompass 30 items. The domains are the social impact of AI (eight items), the understanding of AI (six items), AI execution plans (five items), problem solving with AI (five items), data literacy (four items), and AI ethics (two questions). The items are to be rated using a five-point Likert scale. The internal consistency of the tool was .970 (total), while that of the domains ranged from .861 to .939. This study can serve as reference for developing the analysis of AI literacy, teaching and learning, and evaluation in AI education.
Keywords
AI literacy; AI education; Middle school student; Test tool; SW education;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 D. G. Zytowski and D. A. Luzzo, "Developing the Kuder skills assessment," Journal of Career Assessment, Vol. 10, No. 2, pp. 190-199, May, 2002. DOI: 10.1177/1069072702010002004   DOI
2 L. R. Aiken, "Psychological testing and assessment" Allyn & Bacon, 1997.
3 Korean Educational Statistics Service, 2020 Middel school information, 2021. kess.kedi.re.kr
4 R. V. Krejcie and D. W. Morgan, "Determining sample size for research activities," Educational and psychological measurement, Vol. 30, No. 3, pp. 607-610. Sep. 1970. DOI: 10.1177/001316447003000308   DOI
5 J. Kim. "On the Direction of Designing Content and Teaching.Learning Methods of Primary and Secondary Level based on Artificial Intelligence," Korean Journal of Elementary Education, Vol. 32, No 3, pp. 19-35. Jun. 2021.   DOI
6 L. Crocker and J. Algina, "Introduction to classical and modern test theory" Holt, Rinehart and Winston, 6277 Sea Harbor Drive, Orlando, FL 32887, 1986.
7 J. Park and J. Kim, "The Development of Workplace Learning Agility Assessment Inventory for Knowledge Workers," The Korean Journal of Human Resource Development Quarterly, Vol. 21, No. 4, pp. 115-152. Nov. 2019. DOI: 10.18211/kjhrdq.2019.21.4.005   DOI
8 S. Shin, M. Ha, and J. K. Lee, "Exploring Elementary School Students' Image of Artificial Intelligence," Journal of Korean Elementary Science Education, Vol. 37, No. 2, pp. 126-146, May 2018. DOI: 10.15267/keses.2018.37.2.126   DOI
9 Korea Foundation for the Advancement of Science & Creativity, A Study on the Development of Artificial intelligence Basic Subjects, Aug. 2020. www.kofac.re.kr
10 S. Shin, M. Ha, and J. K. Lee, "High School Students' Perception of Artificial Intelligence: Focusing on Conceptual Understanding, Emotion and Risk Perception," The Journal of Learner-Centered Curriculum and Instruction, Vol. 17, No. 21, pp. 289-312. Nov. 2017. DOI: 10.22251/jlcci.2017.17.21.289   DOI
11 Pega, "What Consumers Really Think About AI:A Global Study," 2018. https://www.pega.com/ai-survey
12 S. W. Kim and Y. Lee, "An analysis of pre-service teachers' learning process in programming learning," International Journal on Advanced Science Engineering and Information Technology, Vol. 10, No. 1, pp. 58-69, Feb. 2020. DOI: 10.18517/ijaseit. 8.4-2.5723   DOI
13 Organisation for Economic Cooperation and Development (OECD), The future of education and skills: Education 2030. OECD Education Working Papers, 2018. www.oecd.org/education/2030-project/
14 M. Eslami, K. Vaccaro, M. K. Lee, A. Elazari Bar On, E. Gilbert, and K. Karahalios, "User attitudes towards algorithmic opacity and transparency in online reviewing platforms," In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1-14, 2019. DOI: https://doi.org/10.1145/3290605.3300724   DOI
15 E. Lee, "A Comparative Analysis of Contents Related to Artificial Intelligence in National and International K-12 Curriculum," The Journal of Korean Association of Computer Education, Vol. 23, No. 1, pp. 37-44. Jan. 2020.   DOI
16 K. Li, Z. Wu, K. C. Peng, J. Ernst, and Y. Fu, "Tell me where to look: Guided attention inference network," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 9215-9223, 2018.
17 S. Ali, B. H. Payne, R. Williams, H. W. Park, and C. Breazeal, "Constructionism, ethics, and creativity: Developing primary and middle school artificial intelligence education," In International workshop on education in artificial intelligence K-12 (EDUAI'19), pp. 1-4, 2019.
18 M. R. Zimmerman, "Teaching AI: exploring new frontiers for learning" 2018.
19 H. Lim and C. Jyung, "The Development of Career Development Competency Inventory for Middle School Students," The Journal of Career Education Research, Vol. 28, No. 4, pp. 107-137. Sep, 2015.
20 Y. Lee, S. H. Paik, H. Yoo, I. Jung, S. Jan, J. Choi, S. Jeon, Research for Introducing Computational Thinking into Primary and Secondary Education, Dec. 2014. scienceon.kisti.re.kr/srch/selectPORSrchReport.do?cn=TRKO201500007885
21 C. Jyung, J. Lim, T. Kim, H. Lim, S. Im, and Y. Lee, "Development of Conceptual Model for Performance Evaluation of Career Education," The Journal of Career Education Research, Vol. 32, No. 3, pp. 285-307. Sep. 2019.   DOI
22 M. Xu, J. M. David, and S. H. Kim, "The fourth industrial revolution: Opportunities and challenges," International journal of financial research, Vol. 9, No. 2, pp. 90-95, 2018. DOI: 10.5430/ijfr.v9n2p90   DOI
23 Software Policy & Research Institute, AI(Artificial Intelligence) Brain Index: Analysis of Core Talent and Implication, 2019. https://spri.kr/posts/view/22795?code=issue_reports
24 Y. Jung and H. Kim, "Analysis of Overseas Research Trends Related to Artificial Intelligence(AI) in Elementary, Middle and High School Education," Journal of Korean Library and Information Science Society, Vol. 52, No. 3, pp. 313-334. Sep. 2021. DOI: 10.16981/kliss.52.3.202109.313   DOI
25 S. W. Kim and Y. Lee, "Development of a Software Education Curriculum for Secondary Schools," Journal of The Korea Society of Computer and Information, Vol. 21, No. 8, pp. 127-141. Aug. 2016.   DOI
26 Ministry of Education, 2022 Revised Curriculum Frameworks, 2021. www.korea.kr/news/visualNewsView.do?newsId=148896153
27 S. W. Kim, S. Lee, E. Jung, S. J. Choi, Y. Lee, "Korean Elementary and Secondary School Students' Attitudes toward Artificial Intelligence according to School Level," Korean Journal of Teacher Education, Vol. 37, No. 3, pp. 131-153. July 2021.
28 J. M. Wing, "Computational thinking," Communications of the ACM, Vol. 49, No. 3, pp. 33-35, 2006. DOI: 10.1145/1118178.1118215   DOI
29 Related ministry, Education Policy Direction and Core Tasks in Artificial Intelligence Era, 2020. https://www.korea.kr/archive/expDocView.do?docId=39237
30 D. Long and B. Magerko, "What is AI literacy? Competencies and design considerations," In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-16, April 2020. DOI: 10.1145/3313831.3376727   DOI
31 Ministry of Education, Masterplan of Informatics Education, 2020. https://www.moe.go.kr/boardCnts/view.do?boardID=294&boardSeq=80718&lev=0&searchType=null&statusYN=W&page=1&s=moe&m=020402&opType=N
32 S. W. Kim and Y. Lee, "Development of Test Tool of Attitude toward Artificial Intelligence for Middle School Students," The Journal of Korean Association of Computer Education, Vol. 23, No. 3, pp. 17-30. May 2020. DOI: 10.32431/kace.2020.23.3.003   DOI
33 M. Lee, "Characteristics and Trends in the Classifications of Scientific Literacy Definitions," Journal of the Korean Association for Science Education, Vol. 34, No. 2, pp. 55-62. Apr 2014. DOI: 10.14697/jkase.2014.34.2.0055   DOI
34 A. W. Branscomb, "Knowing how to know," Science, Technology, & Human Values, Vol. 6, No. 3, pp. 5-9. Jul. 1981. DOI: 10.1177/016224398100600302   DOI
35 F. W. Horton Jr, "Information literacy vs. computer literacy," Bulletin of the American Society for Information Science, Vol. 9, No. 4, pp. 14-16. Apr 1983.
36 T. P. Mackey and T. E. Jacobson, "Reframing information literacy as a metaliteracy," College & research libraries, Vol. 72, No. 1, pp. 62-78. Jan. 2011. DOI: 10.5860/crl-76r1   DOI
37 M. Antoninis and S. Montoya, A global framework to measure digital literacy. UIS. UNESCO. Published March, 19, 2018. iite.unesco.org/publications/
38 P. Gilster, "Digital literacy" John Wiley & Sons, 1997.
39 J. Fraillon, W. Schulz, and J. Ainley, "International Computer and Information Literacy Study: Assessment Framework" International Association for the Evaluation of Educational Achievement. Herengracht 487, Amsterdam, 1017 BT, The Netherlands, 2013.
40 J. Fraillon, J. Ainley, W. Schulz, D. Duckworth, and T. Friedman, "IEA international computer and information literacy study 2018 assessment framework" Springer Nature, 2019.
41 D. G. Lee, S. W. Kim and Y. Lee, "The Analysis on Research Trends for Artificial Intelligence literacy Education in Korea," Proceeding of Korean Association of Computer Education, 25(2), 25-27, August 2021.
42 C. Jyung, "Basic Study for the Development of Agricultural Career Assessment Instrument," Journal of Agricultural Education and Human Resource Development, Vol. 34, No. 4, pp. 59-82, Dec. 2002.
43 L. T. Hu and P. M. Bentler, "Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification," Psychological methods, Vol. 3, No. 4, pp. 424, 1998. DOI: 10.1037/1082-989X.3.4.424   DOI
44 C. Fornell and D. F. Larcker, "Structural equation models with unobservable variables and measurement error: Algebra and statistics," Journal of Marketing Research, Vol. 18, No. 3, pp. 382-388. Aug. 1981. DOI: 10.2307/3150980   DOI