Browse > Article
http://dx.doi.org/10.3745/KTSDE.2022.11.2.101

Automatic Adaptation Based Metaverse Virtual Human Interaction  

Chung, Jin-Ho (울산대학교 AI융합전공)
Jo, Dongsik (울산대학교 IT융합전공)
Publication Information
KIPS Transactions on Software and Data Engineering / v.11, no.2, 2022 , pp. 101-106 More about this Journal
Abstract
Recently, virtual human has been widely used in various fields such as education, training, information guide. In addition, it is expected to be applied to services that interact with remote users in metaverse. In this paper, we propose a novel method to make a virtual human' interaction to perceive the user's surroundings. We use the editing authoring tool to apply user's interaction for providing the virtual human's response. The virtual human can recognize users' situations based on fuzzy, present optimal response to users. With our interaction method by context awareness to address our paper, the virtual human can provide interaction suitable for the surrounding environment based on automatic adaptation.
Keywords
Virtual Human; Metaverse; Authoring; Multimodal; Interaction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Ekman and R. Davidson, "The nature of emotion: Fundamental questions," Oxford University Press, 1994.
2 K. Otsuka, "MMSpace: Kinetically-augmented telepresence for small group-to-group conversations," In IEEE Conference on Virtual Reality, pp.19-28, 2016.
3 C. Breiteneder, S. Gibbs, and C. Arapis, "Teleport-an augmented reality teleconferencing environment," In Eurographics Workshops, Virtual Environments and Scientific Visualization, pp.41-49, 2006.
4 S. Scherer, S. C. Marsella, G. Stratou, Y. Xu, F. Morbini, A. Egan, A. Rizzo, and L.-P. Morency, "Perception markup language: Towards a standardized representation of perceived nonverbal behaviors," In The 12th International Conference on Intelligent Virtual Agents (IVA), 2012.
5 B. Lok, "Training with virtual operating room teammates to influence team behaviors," International Conference on Collaboration Technologies and Systems(CTS), 2016.
6 R. Al-Asqhar, T, Komura, and M. Choi, "Relationship descriptors for interactive motion adaptation," In Proceedings of 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp.45-53, 2013.
7 K. S. Shin and D. S. Jo, "Exploring the effects of the virtual human with physicality on co-presence and emotional response," Journal of The Korea Society of Computer and Information, Vol.24, No.1, pp.67-71, 2019.   DOI
8 K. P. Tee, R. Yan, Y. Chua, Z. Huang, and S. Liemhetcharat, "Gesture-based attention direction for a telepresence robot: Design and experimental study," In IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.4090-4095. 2014.
9 A. Maimone, X. Yang, N. Dierk, A. State, M. Dou, and H. Fuchs, "General-purpose telepresence with head-worn optical see-through displays and projector-based lighting," In IEEE Conference on Virtual Reality, pp.23-26, 2013.
10 S. Zhao, "Toward a taxonomy of copresence," Presence: Teleoperators and Virtual Environments, Vol.12, No.5, pp.445-455, 2003.   DOI
11 D. Kim and D. Jo, "Exploring the effects of gesture interaction on co-presence of a virtual human in a hologram-like system," Journal of the Korea Institute of Information and Communication Engineering, Vol.24, No.10, pp.1390-1393, 2020.   DOI
12 D. Jo, "Effects of virtual humans on co-presence," In Proceeding of the International Conference on Future Information and Communication Engineering, 2019.
13 E. Shin and D. Jo, "Virtual human authoring toolKit for a senior citizen living alone," Journal of the Korea Institute of Information and Communication Engineering, Vol.24, No.9, pp.1245-1248, 2020.   DOI
14 J.-H. Chung and D. Jo, "Authoring toolkit for interaction with a virtual human," In Proceeding of the Spring Conference on Korea Information Processing Society(KIPS), 2021.
15 E. Ho, T. Komura, and C, Tai, "Spatial relationship preserving character motion adaptation," In Proceedings of SIGGRAPH ACM Transactions on Graphics, Vol.29, No.4, Article 33, 2010.
16 H. Y. Song, I. J. Kim, and D. S. Jo, "Virtual human interaction based on reinforcement learning," In Proceeding of the Korea Institute of Information and Communication Engineering, 2020.
17 S. Gandhe, "Rapid prototyping and evaluation of dialogue systems for virtual humans," Dissertation of University of Southern California, 2014.
18 D. Jo, K.-H. Kim, and G. Kim, "SpaceTime: Adaptive control of the teleported avatar for improved AR tele-conference experience," Computer Animation and Virtual Worlds (CAVW), Vol.26, No.3-4, pp.259-269, 2015.   DOI