Browse > Article
http://dx.doi.org/10.6109/jkiice.2021.25.10.1427

The process of estimating user response to training stimuli of joint attention using a robot  

Kim, Da-Young (Korea Institute of Robotics and Technology Convergence)
Yun, Sang-Seok (Division of Mechanical Convergence Engineering, Silla University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.25, no.10, 2021 , pp. 1427-1434 More about this Journal
Abstract
In this paper, we propose a psychological state estimation process that computes children's attention and tension in response to training stimuli. Joint attention was adopted as the training stimulus required for behavioral intervention, and the Discrete trial training (DTT) technique was applied as the training protocol. Three types of training stimulation contents are composed to check the user's attention and tension level and provided mounted on a character-shaped tabletop robot. Then, the gaze response to the user's training stimulus is estimated with the vision-based head pose recognition and geometrical calculation model, and the nervous system response is analyzed using the PPG and GSR bio-signals using heart rate variability(HRV) and histogram techniques. Through experiments using robots, it was confirmed that the psychological response of users to training contents on joint attention could be quantified.
Keywords
Human-robot interaction; Eye contact; Socially assistive robots; Autism; Joint attention;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. G. Lee, B. H. Lee, J. S. Jung, and J. Y. Kwon, "Robot design and action study for the treatment of autistic spectrum disorders children," Journal of Institute of Korean Electrical and Electronics Engineers, vol. 20, no. 2, pp. 196-199, 2016.
2 S. Lee, K. Hong, and S. Y. Kang, "A review of studies on discrete trail teaching(DTT) for children with autism spectrum disorders: Based on the intervention outcome and the staff variable," Journal of Emotional and Behavioral Disorders, vol. 28, no. 3, pp. 523-549, 2012.
3 P. Mundy, M. Sigman, J. Ungerer, and T. Sherman, "Defining the social deficits of autism: The contribution of non-verbal communication measures," Journal of Child Psychology and Psychiatry and Allied Disciplines, vol. 27, pp. 657-669, 1986.   DOI
4 D. Y. Kim, H. K. Eom, and S. S. Yun, "Design of head robot understanding human Pose," in Proceedings of 2020 Fall Conference of ESK, pp. 330-333, Oct. 2020.
5 J. P. Parsons, R. Bedford, E. J. H. Jones, T. Charman, M. H. Johnson, and T. Gliga, "Gaze following and attention to objects in infants at familial risk for ASD," Frontiers in Psychology, vol. 10, pp. 1799, 2019.   DOI
6 A. Arcentales, R. Daniel, C. Betancourt, I. Yepez, D. Alulema, and A. V. Guaman, "A multivariate signal analysis of a sensing platform prototype for stress detection," in Proceedings of International Conference on Intelligent Information Technology, pp. 63-77, 2020.
7 S. S. Yun, H. Kim, J. Choi, and S. K. Park, "A robotic system with behavioral intervention facilitating eye contact and facial emotion recognition of children with autism spectrum disorders," Journal of Korea Robotics Society, vol. 10, no. 2, pp. 61-69, 2015.   DOI
8 Centers for Disease Control and Prevention [Internet]. Available: https://www.cdc.gov/ncbddd/autism/facts.html.
9 E. Y. Choi, "Literature Review of Robots Used for the Rehabilitation of Children with Autistic Spectrum Disorder," Journal of Rehabilitation Welfare Engineering & Assistive Technology, vol. 9, no. 4, pp. 265-273, 2015.
10 H. Kozima, M. P. Michalowski, and C. Nakagawa, "Keepon," International Journal of Social Robotics, vol. 1, pp. 3-18, 2009.   DOI
11 M. Tolgyessy, M. Dekan, F. Duchon, J. Rodina, P. Hubinsky, and L. U. Chovanec, "Foundations of visual linear human-robot interaction via pointing gesture navigation," International Journal of Social Robotics, vol. 9, no. 4, pp. 509-523, 2017.   DOI
12 B. Kim and J. Min, Use and Interpretation of HRV in Stress Clinics, Panmun Education, 2015.
13 S. Kim and Y. Ko, "Analysis of robot research and development cases used for treatment and social adaptation of children with autism spectrum disorder," Journal of Integrated Design Research, vol. 16. no. 4. pp. 21-32, 2017.
14 I. Berk-Smeekens, M. Korte, M Dongen-Boomsma, I. Oosterling, J. Boer, E. Barakova, T. Lourens, J. Glennon, W. Staal, and J. K. Buitelaar, "Pivotal Response Treatment with and without robot-assistance for children with autism: a randomized controlled trial," European Child & Adolescent Psychiatry, pp. 1-13, 2021.