• Journal of the Korean Society for Library and Information Science
• /
• v.56 no.1
• /
• pp.95-117
• /
• 2022

This study developed and evaluated audio-visual (AV) semantics-based video summarization methods using eye tracking and electroencephalography (EEG) data. For this study, twenty-seven university students participated in eye tracking and EEG experiments. The evaluation results showed that the average recall rate (0.73) of using both EEG and pupil diameter data for the construction of a video summary was higher than that (0.50) of using EEG data or that (0.68) of using pupil diameter data. In addition, this study reported that the reasons why the average recall (0.57) of the AV semantics-based personalized video summaries was lower than that (0.69) of the AV semantics-based generic video summaries. The differences and characteristics between the AV semantics-based video summarization methods and the text semantics-based video summarization methods were compared and analyzed.

• Science of Emotion and Sensibility
• /
• v.20 no.1
• /
• pp.31-40
• /
• 2017

The present study used one of research techniques which is eye gaze tracking for neuromarketing. When pupil's size of men dilated over than three sigma (0.135%), the interest and eye movement in observation were measured. According to statistical analysis of previous studies, three sigma range is meaningful therefore sigma range was used as operational definition because 'pupil dilatation' is difficult to be define in eye gaze tracking data. Pictures of basketball games were selected as visual stimuli and 90% effective ratio of total 7,200 data were calculated. Thus, 29 of 34 participants were used for test. Pupil's size was calculated by applying pupil's width and height into a formular; [Pupil's size = Pupil width/2${\times}$Pupil height/$2{\times}{\pi}$]. In conclusion, billboard utilized for sports marketing had meaningless effects because gaze frequency to basketball player and surrounding environment was higher than that to billboard when participantsas game spectators diltaed their pupil's size over than three sigma. Thus, it was required using new marketing strategies like neuromarketing to increase utility through the present study.

• Journal of the Korean Society for information Management
• /
• v.41 no.1
• /
• pp.261-282
• /
• 2024

This study proposed and evaluated electroencephalography (EEG)-based and eye-tracking-based methods to determine relevance by utilizing users' implicit relevance feedback while navigating content in a digital library. For this, EEG/eye-tracking experiments were conducted on 32 participants using video, image, and text data. To assess the usefulness of the proposed methods, deep learning-based artificial intelligence (AI) techniques were used as a competitive benchmark. The evaluation results showed that EEG component-based methods (av_P600 and f_P3b components) demonstrated high classification accuracy in selecting relevant videos and images (faces/emotions). In contrast, AI-based methods, specifically object recognition and natural language processing, showed high classification accuracy for selecting images (objects) and texts (newspaper articles). Finally, guidelines for implementing a digital library interface based on EEG, eye-tracking, and artificial intelligence technologies have been proposed. Specifically, a system model based on implicit relevance feedback has been presented. Moreover, to enhance classification accuracy, methods suitable for each media type have been suggested, including EEG-based, eye-tracking-based, and AI-based approaches.

• Smart Media Journal
• /
• v.5 no.3
• /
• pp.62-66
• /
• 2016

The recent increase in virtual reality (VR) technology around the world has been VR work in cooperation with technology from other sectors to form new trends. In the case of advertising, it is difficult to trace if VR users viewed a certain piece of advertisement because the current technology does not allow them to interact with the screen. Eye tracking technology can act as a solution to the problem of tracing advertisement views as it allows for data extraction in relation to which advertisements were viewed and for how long. The research paper suggests a method of how to track the eyes of users in VR advertising. The suggested method includes communication between a server and VR HMD (virtual reality head mounted display) as well as a screen of output from the server.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.10 no.5
• /
• pp.223-227
• /
• 2010

Since the most of existing virtual model house used non-immersive type virtual reality technology, it was made to control using direct input type device such as keyboard and mouse. But in this paper realized not only direct data entry method but also indirect data entry method using eyetracking technology through universal webcam for virtual model house based upon modeling. In this paper showed the position of pointer controlled according to the relative movement of pupils or the part of function related to the equipment entry called by comparing the value of gray after extracting the area of pupil in the user' video data received from webcam. Such a method provided the convenience of navigation and interface to the user.

• Education of Primary School Mathematics
• /
• v.20 no.4
• /
• pp.305-319
• /
• 2017

In the process of finding the triangle height, 26 students in the 6th grade were surveyed to understand the students' triangle height through the eye movement data and to investigate the cognitive load of the students. As a result, the correctness rate of the pre-test was significantly increased in the post-test, and the frequency and retention of gaze data were smaller in the post-test than in the AOI of each question. The Participants's subjective cognitive load indicated that it was more difficult to understand the concept of rotated triangles compared with upright triangles that were parallel to the ground. More frequent and more retentions in the eye-tracking data were detected in the right triangles and acute triangles by rotating configuration. Eye movement data show that eye tracking technology can provide an objective measure of students' cognitive load for feedback on instructional design.

• Journal of the Korean Society of Earth Science Education
• /
• v.16 no.2
• /
• pp.261-275
• /
• 2023

The purpose of this study was to analyze the conceptual understanding of carbon neutrality among secondary school science pre-service teachers, as well as to identify gaze patterns in visual materials. For this study, gaze tracking data of 20 pre-service secondary school science teachers were analyzed. Through this, the levels of conceptual understanding of carbon neutrality were categorized for the participants, and differences in gaze patterns were analyzed based on the degree of conceptual understanding of carbon neutrality. The research findings are as follows. First, as a result of performing modeling activities to predict carbon emissions and removals until 2100 using the concept of '2050 carbon neutrality,' 50% of the participants held a conception that carbon emissions would continue to increase. Additionally, 25% of the participants did not properly understand the causal relationship between net carbon dioxide emissions and cumulative concentrations. Second, the gaze movements of the participants regarding visual materials related to carbon neutrality were significantly influenced by the information presented in the text area, and in the case of graphs, the focus was mainly on the data area. Moreover, when visual data with the same function and category were arranged, participants showed the most interest in materials explaining concepts or visual data placed on the left side. This implies a preference for specific positions or orders. Participants with lower levels of conceptual understanding and inadequate grasp of causal relationships among elements exhibited notably reduced concentration and overall gaze flow. These findings suggest that conceptual understanding of carbon neutrality including climate change and natural disaster significantly influences interest in and engagement with visual materials.

• Archives of design research
• /
• v.16 no.4
• /
• pp.197-206
• /
• 2003

Nowadays, the studies on interface and cognition-engineering has become issues of general interest as newly design-methods which analyze the behavior of user on products. However existing studies were mainly done with verbal-centered method which made it difficult for the designer to apply for visual realization. Moreover many mistakes and noises are taken place whenever the designer converts verbal statements and needs of user into visual factors. Therefore the designer needs to analyze visual perception on user and product as visual-centered methods. This study applies the eye tracking method as analysing-instrument and aims to develop the analysis-framework, the concrete techniques of measurement and the application for the product design. At first the nature and the process of visual perception on products are reviewed for developing analysis method. Then the technique of eye tracking and the meaning of fixation and movement are discussed to specify the concrete method. The basic experiment of product can reveal general analysis process, advantage and guideline for the application of eye tracking method. The Study is peformed through the following 4 steps ; to pre-research into product design and visual perception theory ; to identify the concrete experiment method, to measure the fixation/movement data and analyze the raw data, to convert the result of analysis to the visual framework. Finally the major findings and the limits of the study are suggested and summarized.

• Science of Emotion and Sensibility
• /
• v.21 no.2
• /
• pp.3-14
• /
• 2018

For satisfying consumer needs, commercial facilities require a variety of sale-related space expressions and eye-catching product arrangements; space composition can also be a direct marketing strategy. The human eye is the sensory organ that acquires the largest amount of information, and an analysis of visual information helps in understanding visual relations between . However, the existing studies are mostly focused on analysis of still frames in experimental images, and there is a lack of studies analyzing gaze information based on mobile images of commercial spaces. Therefore, this study analyzed emotional responses through gaze information of space users in reality using a video of a movement route through a commercial facility. The analysis targeted straight sections of the moving route; based on the data acquired, sectional characteristics of five gaze intensity ranges were examined. As a result, section A, the starting point of the route, had a low gaze intensity, while section B had the highest gaze intensity. This indicates that, starting in section B, the subjects explored the space in a stable way and needed time to adapt to the experimental video. In relation to space characteristics of the gaze-concentrated area, display formats of the right stores in 4 of 6 sections received greater attention. The gaze of consumers was mostly focused on props, and big gaze information was revealed in showcase display formats of the stores. In conclusion, this analysis method can provide highly useful direct design data about merchandise display and merchandise component arrangement based on consumer visual preference.

• Education of Primary School Mathematics
• /
• v.23 no.1
• /
• pp.1-26
• /
• 2020

The purpose of this study was to analyze the process of reading and understanding mathematics lesson plan through eye-tracking to suggest implications of pre-service teacher education. As a result of the analysis, the pre-service teachers felt that the mathematics lesson plans were more difficult than the experienced teacher, they read and understood the mathematics lesson plan in sequential order. Experienced teachers, on the other hand, used a hypertext reading strategy to find key topics and make connections in order to grasp the flow of instruction in mathematics lesson plan. Based on these results, several suggestions were drawn for pre-service teachers when teaching their ability to read and understand mathematics lesson plan.