The Journal of Korea Robotics Society (로봇학회논문지)

Korea Robotics Society (한국로봇학회)
권호 표지
DOI QR코드

DOI QR Code

Analysis of User's Eye Gaze Distribution while Interacting with a Robotic Character

로봇 캐릭터와의 상호작용에서 사용자의 시선 배분 분석

  • Jang, Seyun (Robots in Education & Entertainment Lab., Hansung University) ;
  • Cho, Hye-Kyung (School of IT-Convergence Eng., Hansung University)
  • Received : 2018.11.20
  • Accepted : 2018.11.30
  • Published : 2019.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we develop a virtual experimental environment to investigate users' eye gaze in human-robot social interaction, and verify it's potential for further studies. The system consists of a 3D robot character capable of hosting simple interactions with a user, and a gaze processing module recording which body part of the robot character, such as eyes, mouth or arms, the user is looking at, regardless of whether the robot is stationary or moving. To verify that the results acquired on this virtual environment are aligned with those of physically existing robots, we performed robot-guided quiz sessions with 120 participants and compared the participants' gaze patterns with those in previous works. The results included the followings. First, when interacting with the robot character, the user's gaze pattern showed similar statistics as the conversations between humans. Second, an animated mouth of the robot character received longer attention compared to the stationary one. Third, nonverbal interactions such as leakage cues were also effective in the interaction with the robot character, and the correct answer ratios of the cued groups were higher. Finally, gender differences in the users' gaze were observed, especially in the frequency of the mutual gaze.

Keywords

References

  1. H. Admoni and B. Scassellati, "Social Eye Gaze in Human-Robot Interaction: A Review," Journal of Human-Robot Interaction, vol. 6, no. 1, pp. 25-63, May, 2017.
  2. K. Ruhland, C. E. Peters, S. Andrist, J. B. Badler, N. I. Badler, M. Gleicher, B. Mutlu, and R. McDonnell, "A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception," Computer Graphics Forum, vol. 34, no. 6, pp.299-326, Sept., 2015. https://doi.org/10.1111/cgf.12603
  3. O. Palinko, F. Rea, G. Sandini, and A. Sciutti, "Robot Reading Human Gaze: Why Eye Tracking Is Better Than Head Tracking for Human-Robot Collaboration," 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, Oct., 2016.
  4. A. George and A. Routray, "Real-time Eye Gaze Direction Classification using Convolutional Neural Network," 2016 Int'l Conf. on Signal Processing and Communications, Bangalore, India, Nov. 2016.
  5. S. Sheikhi, V. Khalidov, D. Klotz, B. Wrede, and J.-M. Odobez, "Leveraging the Robot Dialog State for Visual Focus of Attention Recognition," 15th ACM Int'l Conf. on Multimodal Interaction, Sydney, Australia, Dec., 2013.
  6. R. Vertegaal, R. Slagter, G. van der Veer, and A. Nijholt, "Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes," SIGCHI Conference on Human Factors in Computing Systems, Seattle, USA, pp. 301-308, 2001.
  7. T. Xu, H, Zhang, and C. Yu, "See You See Me: The Role of Eye Contact in Multimodal Human-Robot Interaction," ACM Transactions on Interactive Intelligent Systems, vol. 6, no. 1, May, 2016.
  8. B. Mutlu, F. Yamaoka, T. Kanda, H. Ishiguro, and N. Hagita, "Nonverbal Leakage in Robots: Communication of Intentions through Seemingly Unintentional Behavior," 4th ACM/IEEE Int'l Conference on Human Robot Interaction, La Jolla, California, USA, pp 69-76, 2009.
  9. E. Mwangi, E. I. Barakova, M. Diaz-Boladeras, A. C. Mallofre, and M. Rauterberg, "Directing Attention Through Gaze Hints Improves Task Solving in Human-Humanoid Interaction," International Journal of Social Robotics, vol. 10, no. 3. pp 343-355, Jun., 2018. https://doi.org/10.1007/s12369-018-0473-8
  10. H. Admoni, C. Bank, J. Tan, M. Tonevaand, and B. Scassellati, "Robot gaze does not reflexively cue human attention," 33rd Annual Conference of the Cognitive Science Society, pp.1983-1988, 2011.
  11. E. Ackerman, IEEE Spectrum, "What People See in 157 Robot Faces," [Online], https://spectrum.ieee.org/automaton/robotics/humanoids/what-people-see-in-157-robot-faces, Accessed: Jun. 1, 2018.
  12. Tobii Gaming, "Tobii Eye Tracker 4C," [Online], https://tobiigaming.com/product/tobii-eye-tracker-4c/, Accessed: Nov. 1, 2018.

Cited by

  1. Design of Effective Robotic Gaze-Based Social Cueing for Users in Task-Oriented Situations: How to Overcome In-Attentional Blindness? vol.10, pp.16, 2019, https://doi.org/10.3390/app10165413