• The Journal of the Korea Contents Association
• /
• v.10 no.8
• /
• pp.1-10
• /
• 2010

For virtual education, the multimodal learning environment with haptic feedback, termed 'immersive textbook', is necessary to enhance the learning effectiveness. However, the learning contents for immersive textbook are not widely available due to the constraints in creation and playback environments. To address this problem, we propose a framework for producing and displaying the multimodal contents for immersive textbook. Our framework provides an XML-based meta-language to produce the multimodal learning contents in the form of intuitive script. Thus it can help the user, without any prior knowledge of multimodal interactions, produce his or her own learning contents. The contents are then interpreted by script engine and delivered to the user by visual and haptic rendering loops. Also we implemented a prototype based on the aforementioned proposals and performed user evaluation to verify the validity of our framework.

• 한국정보교육학회:학술대회논문집
• /
• 2021.08a
• /
• pp.283-288
• /
• 2021

In the COVID-19 situation, digital textbooks have been used in many schools. In order for digital textbooks to become active even in the post COVID-19 era, the functions of digital textbooks must be improved. Digital textbooks are traditional book-type textbooks with glossaries, video materials, and evaluation questions added. Recently, they are being used usefully for practical education by providing realistic contents such as Augmented Reality, Virtual Reality, and 360 images. Therefore, in this study, in order to prepare for the post COVID-19, we found the functional problems of digital textbooks and suggested a way to improve them. First, the layout of digital textbooks should be developed as a responsive layout, deviating from the same form as a book-type textbook. Second, digital textbooks and learning management systems must be integrated. Third, by developing a digital textbook for teachers, teachers should be able to directly reorganize the contents or add external materials. Fourth, learning analysis should be possible using data recorded in digital textbooks. Fifth, in the 2022 revised curriculum, various subjects should be developed as digital textbooks.

• Journal of The Korean Association For Science Education
• /
• v.43 no.2
• /
• pp.59-72
• /
• 2023

This study analyzed a group interview with six earth science teachers and eight middle school students to find out the evaluations and criteria they use to evaluate VR/AR contents (two virtual reality content and two augmented reality contents) in middle school science digital textbook. The study found the VR/AR contents were evaluated on four criteria as follows: VR/AR media characteristics; technical operation; user interface; and teaching-learning design. The evaluations can be summarized by each criterion. First, regarding VR/AR media characteristics, interesting features of VR/AR contents were considered relatively advantageous compared to other media like videos. However, its shortage of visual presence and inconvenience of using markers were mentioned as shortcomings. Second, in the technical operation criteria, teachers and students found the following conditions as technically challenging: failing to properly operate on a particular OS; huge volumes of contents in the application; and frequent freezing when using the application. Third, poor intuitiveness and lack of flexibility were found as negative aspects in user interface. Fourth, regarding teaching-learning design, the teachers evaluated whether the VR/AR contents delivered scientifically accurate information; whether they incorporated class goals set by teachers; and whether they can help students' inquiry. It turned out teachers gave negative feedbacks on VR/AR contents. The students evaluated VR/AR contents by assessing whether they help them with learning science but concluded they did not regard them necessary in science learning at school. Based on the findings, this study discusses which development direction VR/AR contents should take to be useful in teaching and learning science.

• Journal of The Korean Association of Information Education
• /
• v.26 no.1
• /
• pp.23-34
• /
• 2022

Teachers should be able to reorganize the curriculum according to the student level, reorganize textbooks freely, and distribute them to students. However, current paper-textbooks are difficult to modify or edit some contents and distribute them to students, also current digital textbooks are grouped into units, so the order or educational resources cannot be reconstructed. In addition, The digital textbooks are difficult to update external links or the latest resources, and to contain various multimedia materials or high-definition realistic content due to capacity limitations. Therefore, this study presented functions: teaching and learning and evaluation functions, resources search and sharing functions, learning records and analysis functions, screen showing and printing functions, so that teachers can provide customized learning by level to students using digital textbooks. Through the expert Delphi survey, detailed functions for each area were divided into teachers and students. We proposed expanding and developing digital textbooks to various subjects, and distributing various teaching and learning models using digital textbooks.

• Journal of Korean Elementary Science Education
• /
• v.41 no.3
• /
• pp.480-500
• /
• 2022

In this study, the perception and demands on the use of realistic content were analyzed through in-depth interviews with elementary school teachers experienced in using realistic content in science classes. Specifically, the following questions were investigated: (1) What kind of realistic content and how do elementary school teachers use it in science classes? (2) What are the perceptions and difficulties of elementary school teachers regarding the use of realistic content in science classes? (3) What are the needs of elementary school teachers related to the professional development program for the use of realistic content in science classes? The study revealed the following results. First, elementary school teachers mainly used digital textbooks and realistic content provided by the "Science Level Up" site, and the content types could be classified into "exploration type," "visit type," and "production type," according to the purpose of use. Second, elementary school teachers mentioned the educational advantages of using realistic content to help students understand scientific content, induce interest and curiosity, and become immersed in a sense of reality. Several difficulties related to the use of realistic content were mentioned. Among them, the lack of high-quality educational content suitable for science classes and a lack of examples of specific class cases that use realistic content stood out. Thirdly, regarding the development of teacher expertise to use realistic content, elementary school teachers emphasized the need for information on quality realistic content; teacher training centered on specific class cases; instructional models that can be applied by realistic content type; and information on the purchase, use, management, and operation of necessary devices. Reflecting on these research results, implications for more effective use of realistic content in elementary science classes were discussed.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.99-104
• /
• 2009

최근 멀티미디어 기술과 가상/증강현실 기술의 발전으로 사용자에게 몰입감 있는 콘텐츠를 제공하는 여러 시스템들이 제안되고 있다. 또한 기존의 시각과 음향효과만으로 이루어진 시스템의 한계를 넘어서 실제와 같은 느낌을 전달할 수 있는 햅틱기술을 적용하여 보다 몰입감있는 체험형 실감책들이 고안되고 있다. 본 논문은 과학교과서를 중심으로 과학적 이론을 보다 효과적으로 가르치고 배우기 위해 필요한 다양한 촉감(Haptic)을 분류하고, 이를 실감책에 적용하여 책이 담고 있는 주요 내용 또는 삽화와 관련된 다양한 멀티미디어 콘텐츠를 가상/증강환경에서 시청각정보와 함께 촉각콘텐츠를 독자에게 제공함으로써 보고, 듣고 만질 수 있는 적극적인 촉감 상호작용이 가능한 실감책 ('Sil-Gam' Book) 시스템의 기본 프레임워크를 제시한다. 제시된 실감책은 크게 세 부분으로 구성된다. 첫째, 실감책을 읽고 있는 사용자의 손가락의 위치, 시선과 같은 사용자의 움직임을 추적하고 책의 크기, 페이지 등을 인식하는 센서가 부착된 센싱 부; 둘째, 장비에 따라 적용 가능한 촉감 속성, 물체의 움직임에 따라 적용할 수 있는 촉감 속성등 다양한 촉감콘텐츠의 속성을 저작하고 편집하는 소프트웨어 부; 마지막으로 사용자에게 저작된 실감 콘텐츠를 사용자가 쉽고 직관적으로 체험하게 하기 위한 디스플레이부로 구성된다. 여기서 디스플레이 부는 세부적으로 시청각 콘텐츠를 전달하는 시청각 디스플레이 부와 역촉감 콘텐츠를 전달하는 역촉감 디스플레이부로 구성된다. 본 논문에서는 또한 실감책 촉감 저작도구를 사용하여 제시할 수 있는 다양한 촉감을 중고등학교 교육과정에서 배우는 과학 이론에 적용하여 과학 실험시 경험할 수 있는 다양한 역/촉감을 전달하는 몇 가지 시나리오를 예시하였다.