Browse > Article
http://dx.doi.org/10.15701/kcgs.2022.28.3.1

A study on visuomotor and visuotactile synchronization in full body ownership illusion with virtual avatars  

Oh, Jintaek (Dept. of Computer Science, Hanyang University)
Kim, Jihwan (Dept. of Computer Science, Hanyang University)
Kim, Kwanguk (Dept. of Computer Science, Hanyang University)
Publication Information
Journal of the Korea Computer Graphics Society / v.28, no.3, 2022 , pp. 1-11 More about this Journal
Abstract
Body ownership illusion (BOI), which means 'the illusion that a non-bodily object feels like my body', has been actively studied since the Rubber-hand Illusion showed that a person can feel a rubber hand like one's own hand. It has been proven that BOI can be elicited for virtual bodies in virtual reality. Although many studies have been examined the effect of visuomotor (VM) and visuotactile (VT) stimuli, which are mainly used for the elicitation of BOI, there were very limited studies that delivered both stimuli to the whole body at the same time. In this paper, we investigated how each stimulus affects BOI when delivering VM and VT stimulisimultaneously to the virtual avatar, and examined user experience that appears as presence, emotion, and virtual motion sickness. The results showed that BOI was high when VM is synchronous, but there was no significant difference according to VT levels. In the case of presence, it was confirmed that VT affects only when VM is synchronous, and in the case of emotion, both VM and VT affect valence, and in the case of virtual motion sickness, a statistical difference is not found.These results suggest that overall synchrony of VM is important factor in BOI with virtual avatars, but that the matching VT affects subjective experience such as presence when VM is synchronous.
Keywords
Body Ownership Illusion; Presence; Virtual Reality; Visuomotor; Visuotactile;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Khundam, C., First person movement control with palm normal and hand gesture interaction in virtual reality. In 2015 12th International Joint Conference on Computer Science and Software Engineering (JCSSE) (pp. 325-330). IEEE, 2015, July.
2 Maselli, A., & Slater, M., The building blocks of the full body ownership illusion. Frontiers in human neuroscience, 7, 83, 2013.   DOI
3 Kim, C. S., Jung, M., Kim, S. Y., & Kim, K., Controlling the sense of embodiment for virtual avatar applications: methods and empirical study. JMIR Serious Games, 8(3), e21879, 2020.   DOI
4 Jun, J., Jung, M., Kim, S. Y., & Kim, K., Full-body ownership illusion can change our emotion. In Proceedings of the 2018 CHI conference on human factors in computing systems(pp. 1-11), 2018, April.
5 Caserman, P., Krug, C., & Gobel, S., Recognizing Full-Body Exercise Execution Errors Using the Teslasuit. Sensors, 21(24), 8389, 2021.   DOI
6 Kokkinara, E., & Slater, M., Measuring the effects through time of the influence of visuomotor and visuotactile synchronous stimulation on a virtual body ownership illusion. Perception, 43(1), 43-58, 2014.   DOI
7 Ehrsson, H. H., Multisensory processes in body ownership. Multisensory perception, 179-200, 2020.
8 Freeman, G., & Maloney, D., Body, avatar, and me: The resentation and perception of self in social virtual reality. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3), 1-27, 2021.
9 Steed, A., Pan, Y., Zisch, F., & Steptoe, W., The impact of a self-avatar on cognitive load in immersive virtual reality. In 2016 IEEE virtual reality (VR) (pp. 67-76). IEEE, 2016, March.
10 Slater, M., Pertaub, D. P., & Steed, A., Public speaking in virtual reality: Facing an audience of avatars. IEEE Computer Graphics and Applications, 19(2), 6-9, 1999.   DOI
11 Kilteni, K., Bergstrom, I., & Slater, M., Drumming in immersive virtual reality: the body shapes the way we play. IEEE transactions on visualization and computer graphics, 19(4), 597-605, 2013.   DOI
12 Tamaki, E., Miyaki, T., & Rekimoto, J., PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(pp. 543-552), 2011, May.
13 Kondo, R., Sugimoto, M., Minamizawa, K., Hoshi, T., Inami, M., & Kitazaki, M., Illusory body ownership of an invisible body interpolated between virtual hands and feet via visual-motor synchronicity. Scientific reports, 8(1), 1-8, 2018.
14 Slater, M., & Wilbur, S., A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603-616, 1997.   DOI
15 Wolf, D., Rietzler, M., Hnatek, L., & Rukzio, E., Face/on: multimodal haptic feedback for head-mounted displays in virtual reality. IEEE transactions on visualization and computer graphics, 25(11), 3169-3177, 2019.   DOI
16 Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G., Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology, 3(3), 203-220, 1993.   DOI
17 Normand, J. M., Giannopoulos, E., Spanlang, B., & Slater, M., Multisensory stimulation can induce an illusion of larger belly size in immersive virtual reality. PloS one, 6(1), e16128, 2011.   DOI
18 Limanowski, J., Lutti, A., & Blankenburg, F., The extrastriate body area is involved in illusory limb ownership. Neuroimage, 86, 514-524, 2014.   DOI
19 Perez-Marcos, D., Sanchez-Vives, M. V., & Slater, M., Is my hand connected to my body? The impact of body continuity and arm alignment on the virtual hand illusion. Cognitive neurodynamics, 6(4), 295-305, 2012.   DOI
20 Kim, S. Y., Park, H., Jung, M., & Kim, K., Impact of Body Size Match to an Avatar on the Body Ownership Illusion and User's Subjective Experience. Cyberpsychology, Behavior, and Social Networking, 23(4), 234-241, 2020.   DOI
21 Banakou, D., & Slater, M., Body ownership causes illusory self-attribution of speaking and influences subsequent real speaking. Proceedings of the National Academy of Sciences, 111(49), 17678-17683, 2014.   DOI
22 Williams, B., Garton, A. E., & Headleand, C. J., Exploring visuohaptic feedback congruency in virtual reality. In 2020 International Conference on Cyberworlds (CW) (pp. 102-109). IEEE, 2020, September.
23 Bradley, M. M., & Lang, P. J., Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry, 25(1), 49-59, 1994.   DOI
24 LaViola Jr, J. J., A discussion of cybersickness in virtual environments. ACM Sigchi Bulletin, 32(1), 47-56, 2000.   DOI
25 Witmer, B. G., & Singer, M. J., Measuring presence in virtual environments: A presence questionnaire. Presence, 7(3), 225-240, 1998.   DOI
26 Auda, J., Pascher, M., & Schneegass, S., Around the (Virtual) World: Infinite Walking in Virtual Reality Using Electrical Muscle Stimulation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(pp. 1-8), 2019, May.
27 O'Kane, S. H., & Ehrsson, H. H., The contribution of stimulating multiple body parts simultaneously to the illusion of owning an entire artificial body. Plos one, 16(1), e0233243, 2021.   DOI
28 Lopes, P., You, S., Cheng, L. P., Marwecki, S., & Baudisch, P., Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(pp. 1471-1482), 2017, May.
29 Kuschel, M., Freyberger, F., Buss, M., & Farber, B.,A presence measure for virtual reality and telepresence based on multimodal conflicts. In Proceedings of PRESENCE 2007: The 10th Annual International Workshop on Presence, 2007.
30 Slater, M., Perez Marcos, D., Ehrsson, H., & Sanchez-Vives, M. V., Towards a digital body: the virtual arm illusion. Frontiers in human neuroscience, 2, 6, 2008.   DOI
31 Petkova, V. I., & Ehrsson, H. H., If I were you: perceptual illusion of body swapping. PloS one, 3(12), e3832, 2008.   DOI
32 Khamis, M., Schuster, N., George, C., & Pfeiffer, M., Electrocutscenes: Realistic haptic feedback in cutscenes of virtual reality games using electric muscle stimulation. In 25th ACM Symposium on Virtual Reality Software and Technology (pp. 1-10), 2019, November.
33 Park, W., Kim, J., & Lee, J.,A Study on the Design and Effect of Feedback for Virtual Reality Exercise Posture Training. Journal of the Korea Computer Graphics Society, 26(3), 79-86, 2020.   DOI
34 Botvinick, M., & Cohen, J., Rubber hands 'feel'touch that eyes see. Nature, 391(6669), 756-756, 1998.   DOI
35 Sanchez-Vives, M. V., Spanlang, B., Frisoli, A., Bergamasco, M., & Slater, M., Virtual hand illusion induced by visuomotor correlations. PloS one, 5(4), e10381, 2010.   DOI