Browse > Article
http://dx.doi.org/10.9708/jksci.2019.24.11.061

Multisensory based AR System for Education of Cultural Heritage  

Jeong, Eunsol (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage)
Oh, Jeong-eun (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage)
Won, Haeyeon (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage)
Yu, Jeongmin (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage)
Publication Information
Journal of the Korea Society of Computer and Information / v.24, no.11, 2019 , pp. 61-69 More about this Journal
Abstract
In this paper, we propose a multisensory(i.e., visual-auditory-tactile) based AR system for the education of cultural heritage. The proposed system provides a multisensory interaction by designing a user to experience with a 3D printed artifact which is mapped by a virtual 3D content of digital heritage. Compared with the existing systems of cultural heritage education based on augmented reality(AR) technology, this system focused on not only providing learning experience via a sense of visual and auditory, but also a sense of tactile. Furthermore, since this systems mainly provided the direct interactions using a 3D printed model, it gives a higher degree of realism than existing system that use touch or click motions on a 2D display of mobile phones and tablets. According to a result of user testing, we concluded that the proposed system delivered the excellent presence and learning flow to users. Particularly, from the usability evaluation, a 3D printed target artifact which is similar in shape to original heritage artifact, achieved the highest scores among the various tested targets.
Keywords
Multisensory; Tactile Interaction; Augmented Reality(AR); Mobile Education; Education of heritage; Interactive Learning Environment;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 K-Heritage tv, http://www.k-heritage.tv/brd/board/229/L/CATEGORY/2378/menu/372?brdCodeField=CATEGORY&brdCodeValue=2378&bbIdx=12564&brdType=R
2 Csikszentmihalyi, M, "Flow: The Psychology of Optimal Experience", Harper and Row, Harper Perennial Modern Classics, 2008.
3 Heejeon Seo, "Relationships among Presence, Learning Flow, Attitude toward Usability, and Learning Achievement in an Augmented Reality Interactive Learning Environment", Korean Association For Educational Information and Media, Vol.14, No.3, September 2008.
4 Jiyeon Yang, "Collections Use and the Educational Roles of Open Storage", Korean journal of culture and arts education studies, Vol. 9, No. 4, pp. 1-23, August 2014. DOI: 10.15815/kjcaes.2014.9.4.1   DOI
5 Jeongeun Lee, and Goun Choi, "A critical review of object-based learning and generic learning outcomes in museum education in Korea", Korean journal of culture and arts education studies, Vol. 9, No. 5, pp. 41-58, December 2014. DOI: 10.15815/kjcaes.2014.9.5.41   DOI
6 Nayeong Jung, Wonjoo Hwang, Siwoo Kang, Jeongsep Lee, Minho Kyung, "Haptic Intonation learning system for learning Chinese", EXTENDED ABSTRACTS OF HCI KOREA 2016, pp.277-279, January 2016.
7 SoYoung Jeong, "Analysis of Augmented Reality-Based Museum APP Contents Types", Korean Society of Basic Design & Art, Vol.20, No. 2, pp.386-396, March 2019.
8 Sunae Oh, and Jiyeon Gong, "The Study on the Environmental Elements of Exhibitions Applied the Flow Theory in the Museum - Focused on Visitors of the Experience Exhibitions", Journal of Digital Design, Vol. 11, No. 3, pp.143-152, November 2011. DOI: 10.1728 0/jdd.2011.11.3.014   DOI
9 Deokman Kim, and Junhong Park, "Vibration Feedback at Virtual Position in a Beam using Wave Propagation Approach", The Korean Society of Mechanical Engineers, pp. 1474-1475, December 2018.
10 WooSang Kim, and Ken Nah, "A Study on Contents Design of Virtual and Augmented Reality Reflecting Presence", JOURNAL OF THE KOREAN SOCIETY DESIGN CULTURE, Vol. 23, No. 3, pp.139-153, September 2017. DOI: 10.18208/ksdc.2017.23.3.139
11 Jong-Mun Jeon, and Hyung-Jeong Yang, "Multi-modal Sense based Interface for Augmented Reality in Table Top Display", JOURNAL OF KOREA MULTIMEDIA SOCIETY, Vol.12, No.5, May 2009.
12 Junhun Lee, and Taejin Ha, and Jeha Ryu, and Woontack Woo, "Development of Pen-type Haptic User Interface and Haptic Effect Design for Digilog Book Authoring", Proceedings of HCI KOREA 2019, pp.402-405, February 2009.
13 Jin-Ok Park, "Subjectivity study on the from of the virtual reality contents user experience", Journal of Digital Contents Society, Vol. 20, No. 2, pp.395-403 February 2019. DOI: 10.9728/dcs.2019.20 .2.395   DOI
14 Jenifer Tidwell, "Designing Interfaces: Patterns for Effective Interaction Design", O'Reilly book, 2005.
15 Sunhee Kim, "A study on the making celadon flower vase-Focused on the celadon design excavated in Gangjin area", DankookUniversity, 2006.
16 Taejin Ha, and Yeongmi Kim, and Jeha Ryu, and Woontack Woo, "Methodologies for Enhancing Immersiveness in AR-based Product Design", Journal of the Institute of Electronic Engineers of Korea-CI, Vol. 44, No. 2, pp.37-46, March 2007.
17 Miheon Jo, Jeonghye Han, Eunja Hyun "The Development of Robot and Augmented Riality Based Contents and Instructional Model Supporting Childrens' Dramatic Play", Journal of The Korean Association of Information Education Vol. 17, No. 4, December 2013, pp. 421-432. DOI: 10.14352/jkaie.2013.17.4.421   DOI
18 Junghoon Leem, and Byungro Lim, and Eunmo Sung, "Developmental Study on the Quality Certification Standards of Smart Education Contents", The Journal of Educational Information and Media, Vol 20, No 3, pp.327-353, September 2014. DOI: 10.15833 /KAFEIAM. 20.3.327
19 National Research Institute of Maritime Cultural Heritage, "Taean Mado Shipwreck No.2 Underwater Excavation", National Research Institute of Maritime Cultural Heritage, 2011.
20 Hyon-jeong An. "A Study on Aesthetics of 'Flower Pattern' in Korean Ceramic History -Focusing on Korean National Treasures", Korea Society of Floral Art & Design, Vol. 30, pp. 133-157, June 2014.
21 Goryeo Celadon Museum, http://www.celadon.go.kr/dorok/boardList.do?menuId=celadon0404010000
22 Seoul Historiography Institute, https://history.seoul.go.kr/nuri/bbs/bbs.php?sub_type=view&b_idx=336&didx=125
23 Eunju Lee, and Sungsil Park. "A Case Study on the Change of Names for Important Folklore Materials and Remains - Based on the Material No. 37, the Excavated Costume from Ihyujeong's Collection in Ulsan-", Journal of the Korean Society of Costume, Vol. 55, No. 6s, pp.107-120, December 2005.