ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Interactive Human Intention Reading by Learning Hierarchical Behavior Knowledge Networks for Human-Robot Interaction

  • Received : 2016.02.25
  • Accepted : 2016.08.25
  • Published : 2016.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

For efficient interaction between humans and robots, robots should be able to understand the meaning and intention of human behaviors as well as recognize them. This paper proposes an interactive human intention reading method in which a robot develops its own knowledge about the human intention for an object. A robot needs to understand different human behavior structures for different objects. To this end, this paper proposes a hierarchical behavior knowledge network that consists of behavior nodes and directional edges between them. In addition, a human intention reading algorithm that incorporates reinforcement learning is proposed to interactively learn the hierarchical behavior knowledge networks based on context information and human feedback through human behaviors. The effectiveness of the proposed method is demonstrated through play-based experiments between a human and a virtual teddy bear robot with two virtual objects. Experiments with multiple participants are also conducted.

Keywords

References

  1. M.M. Botvinick, "Hierarchical Models of Behavior and Prefrontal Function," Trends Cognitive Sci., vol. 12, no. 5, May 2008, pp. 201-208. https://doi.org/10.1016/j.tics.2008.02.009
  2. L. Zhang and D. Zhang, "Visual Understanding via Multi-feature Shared Learning with Global Consistency," IEEE Trans. Multimedia, vol. 18, no. 2, Feb. 2016, pp. 247-259. https://doi.org/10.1109/TMM.2015.2510509
  3. L. Zhang et al., "LSDT: Latent Sparse Domain Transfer Learning for Visual Adaptation," IEEE Trans. Image Process., vol. 25, no. 3, Mar. 2016, pp. 1177-1191. https://doi.org/10.1109/TIP.2016.2516952
  4. P. Carruthers and P.K. Smith, "Theories of Theories of Mind," New York, USA: Cambridge University Press, 1996.
  5. J. Gray et al., "Action Parsing and Goal Inference Using Self as Simulator," IEEE Int. Workshop Robot Human, Interactive Commun., Nashville, TN, USA, Aug. 13-15, 2005, pp. 202-209.
  6. C. Breazeal et al., "An Embodied Cognition Approach to Mindreading Skills for Socially Intelligent Robots," Int. J. Robot. Res., vol. 28, no. 5, May 2009, pp. 656-680. https://doi.org/10.1177/0278364909102796
  7. B. Jansen and T. Belpaeme, "A Computational Model of Intention Reading in Imitation," Robot. Auton. Syst., vol. 54, May 2006, pp. 394-402. https://doi.org/10.1016/j.robot.2006.01.006
  8. L.M. Hiatt et al., "Accommodating Human Variability in Human-Robot Teams through Theory of Mind," Proc. Int. Joint Conf. AI, Barcelona, Spain, July 16-22, 2011, pp. 2066-2071.
  9. O.C. Schrempf et al., "A Novel Approach to Proactive Human-Robot Cooperation," Proc. IEEE Int. Workshop Robot Human Interactive Commun., Nashville, TN, USA, Aug. 13-15, 2005, pp. 555-560.
  10. A.J. Schmid et al., "Proactive Robot Task Selection Given a Human Intention Estimate," Proc. IEEE Int. Symp. Robot Human Interactive Commun., Jeju, Rep. of Korea, Aug. 26-29, 2007, pp. 726-731.
  11. R. Kelley et al., "Context-Based Bayesian Intent Recognition," IEEE Trans. Auton. Mental Develop., vol. 4, no. 3, Sept. 2012, pp. 215-225. https://doi.org/10.1109/TAMD.2012.2211871
  12. Z. Wang et al., "Probabilistic Movement Modeling for Intention Inference in Humanrobot Interaction," Int. J. Robot. Res., vol. 32, no. 7, 2013, pp. 841-858. https://doi.org/10.1177/0278364913478447
  13. E. Bicho et al., "Integrating Verbal and Nonverbal Communication in a Dynamic Neural Field Architecture for Human-Robot Interaction," Frontiers Neurorobot., vol. 4, no. 5, 2010.
  14. E. Bicho et al., "Neuro-Cognitive Mechanisms of Decision Making in Joint Action: A Human-Robot Interaction Study," Human Movement Sci., vol. 30, no. 5, Oct. 2011, pp. 846-868. https://doi.org/10.1016/j.humov.2010.08.012
  15. K. Strabala et al., "Learning the Communication of Intent Prior to Physical Collaboration," Proc. IEEE RO-MAN, Paris, France, Sept. 9-13, 2012, pp. 968-973.
  16. R. Kelley et al., "Deep Networks for Predicting Human Intent with Respect to Objects," Proc. Annu. ACM/IEEE Int. Conf. Human-Robot Interaction, Boston, MA, USA, Mar. 5-8, pp. 171-172.
  17. Z. Yu and M. Lee, "Human Motion Based Intent Recognition Using a Deep Dynamic Neural Model," Robot. Auton. Syst., vol. 71, Sept. 2015, pp. 134-149. https://doi.org/10.1016/j.robot.2015.01.001
  18. J.-H. Han and J.-H. Kim, "Consideration about the Application of Dynamic Time Warping to Human Hands Behavior Recognition for Human-Robot Interaction," in Robot Intell. Technol. Appl., Switzerland: Springer International Publishing, 2013, pp. 269-277.
  19. R.E. Bellman, "Dynamic Programming," Princeton, NJ, USA: Princeton University Press, 1957.