Browse > Article
http://dx.doi.org/10.5143/JESK.2017.36.6.717

Analysis of Reading Process with Korean Learner using EEG and Eye Tracking  

Im, Jung Nam (Hanyang University, Korean Language and Literature)
Min, Seung Nam (Shinsung University, Fire Safety Mamagement)
Cho, Sung Moon (Hanyang University, Korean Language and Literature)
Publication Information
Journal of the Ergonomics Society of Korea / v.36, no.6, 2017 , pp. 717-727 More about this Journal
Abstract
Objective: The purpose of this study is to establish the goal with the reading stage of Korean learners in Korean language education institutions for preparing enter university using EEG and eye tracker. Background: International students enter the university after completing Korean language education finding lots of difficulties in classes handled in Korean. This is due to the current qualitative evaluation method adopted by the Korean teachers. Therefore, the international students need a proper learning method. Method: The Korean language proficiency test and learner's level are classified as a beginner, intermediate, and advanced levels. The reading process was measured using Eye tracker and EEG. The independent variables consisted of 3 text level and 3 learner's level. The dependent variables consisted of fixation time, fixation number, saccade number, saccade time, and stress index. The variance analysis was performed with $3{\times}3$ within subject design. Results: As the text level increased, the fixation time and number were lowered for beginner, intermediate, and advanced learner. Even the number of fixation decreased, the understanding score as significantly increased. It was also found that the part of fixation number was related to process vocabulary and grammar. The text level significantly increased when saccade number increased. In addition, the saccade number significantly increased for the learner language level. There was no significant difference in the level of text difficulties between beginner and intermediate learners. Nevertheless, we found that advanced learners were confirmed with higher saccade time in beginner difficulty text. Conclusion: The fixation ratio was higher for beginner learners. Similarly, it was found that fixation time had a constant pattern with respect to learners' proficiency regardless of difficulty level. The saccade time affects the learners' level of text understanding. Also, the number of saccades associated with grammar and vocabulary. Application: In the future, if this study focus on a word and grammar in a sentence using EEG and eye tracking, this can prepare a study design for Korean reading system.
Keywords
Cognitive dimension; EEG; Eye-tracking; Korean leaner;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Ashby, J., Rayner, K. and Clifton, C.J., Eye movements of highly skilled and average readers: Differential effects of frequency and predictability. The Quarterly Journal of Experimental Psychology, 58, 1065-1086, 2005.   DOI
2 Barber, H., Vergara, M. and Carreiras, M., Syllable-frequency effects in visual word recognition: evidence from ERPs. Neuroreport, 15(3), 545-548, 2004.   DOI
3 Choi, G.S., A Study of Improvement of Internet Text Reading of Elementary Students Using a Gaze Tracking System, Master Thesis, 2016.
4 Choi, S.G., Exploring Gender Difference in Reading Comprehension Process Using Eye Tracking Technology. Journal of Korean Association for Learner-Centered Curriculum and Instruction, 14(11), 573-597, 2014.
5 Ga, K.S., Correlation between reading ability and reading cognitive variables. The Korean Reading Association, 15, 243-269, 2006.
6 Goodman, K, Goodman, Y. and Flores, B., Reading in the bilingual classroom: Literacy and biliteracy. Rosslyn, VA: National Clearing For Bilingual Education, 1979.
7 Goodman, K.S., A linguistic study of cues and miscues in reading. Elementary English, 42(6), 639-643, 1965.
8 Harmony, T., Marosi, E., Becker, J., Rodriguez, M., Reyes, A., Fernandez, T. and Bernal, J., Longitudinal quantitative EEG study of children with different performances on a reading-writing test. Electroencephalography and Clinical Neurophysiology, 95(6), 426-433, 1995.   DOI
9 Holcomb, P.J. and Grainger, J., On the time course of visual word recognition: An event-related potential investigation using masked repetition priming. Journal of Cognitive Neuroscience, 18(10), 1631-1643, 2006.   DOI
10 Im, J.N., Min, S.N. and Cho, S.M., Comparison of Cognitive Loads between Koreans and Foreigners in the Reading Process. Journal of the Ergonomics Society of Korea, 35(4), 293-305, 2016.   DOI
11 Jeon, H.I., Yun, H.O. and Hong, O.H., The representation and processing of polysemy and homonym nouns in Korean sentence comprehension: an ERP study. Language Eesearch Institute, 68, 149-182, 2015.
12 Jeon, S.J., Needs Analysis of Korean Learners for Reading Education for Academic Purpose. Korean Language Education as a Foreign Language, 29(0), 203-230, 2004.
13 Jeong, S.M., Study of Textbook Reading Tendency of the First Grade Students in Elementary School through the Eye-tracking. Master's Thesis, 2015.
14 Juhola, M. and Grönfors, T., A scheme of inference of regular grammars for the syntactic pattern recognition of saccadic eye movements. Artificial Intelligence in Medicine, 3(2), 87-93, 1991.   DOI
15 Just, M.A. and Carpenter, P.A.A., theory of reading: from eye fixations to comprehension. Psychological Review, 87(4), 329, 1980.   DOI
16 Ki, J.S., A Study of Korean Reading Strategies Employed by Chinese Background Speakers. The International Association for Korean Language Education, 21(2), 29-58, 2010.
17 Kim, J.Y., Lee, M,H., Min, S,N., Cho, Y.J. and Choi, J.H., Quantitative Comparison of the E-book and Paper-book by using Eyetracker. Journal of the Ergonomics Society of Korea, 31(5), 609-616, 2012.   DOI
18 Kim, T.Y. and Yi, S.H., The Differences in Children's Story Comprehension According to the Types of Reading Media: Paperback Books vs. Electronic Books. Korean Journal of Child Studies, 35(4), 249-262, 2014.   DOI
19 Liu, H.C. and Chuang, H.H., An examination of cognitive processing of multimedia information based on viewers' eye movements. Interactive Learning Environments, 19(5), 503-517, 2011.   DOI
20 Kwon, Y., Nam, K. and Lee, Y., ERP index of the morphological family size effect during word recognition. Neuropsychologia, 50(14), 3385-3391, 2012.   DOI
21 Morrison, R.E. and Rayner, K., Saccade size in reading depends upon character spaces and not visual angle. Attention, Perception and Psychophysics, 30(4), 395-396, 1981.   DOI
22 Newell, A. and Simon, H.A., Human problem solving, Englewood Cliffs. NJ: Prentice-Hall, 1972.
23 Rayner, K., Ashby, J., Pollatsek, A. and Reichle, E.D., The effects of frequency and predictability on eye fixations in reading: implications for the EZ Reader model, Journal of Experimental Psychology. Human Perception and Performance, 30(4), 720, 2004.   DOI
24 Sim, S.M., An Analysis of Research Trends in Korean Language Education for Multicultural Learner. The Association of Korean Education, 98, 153-183, 2014.
25 Suh, H., Kim, J.H., Pyeon, J.Y. and Shin, Y.H., A Research of Characteristics and Eye-tracking of Readers in Problem-solving Context- Focused on Readers' Task Commitment According to the Reading Level. Korea Reading Association, 38, 225-254, 2016.
26 Lee, M.S. and Yong, N.S., Processing of syntactic dependency in Korean relative clauses: Evidence from an eye-tracking study. Korean Journal of Cognitive Science, 20(4), 507-533, 2009.   DOI