Journal of KIISE (정보과학회 논문지)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지
DOI QR코드

DOI QR Code

Comparing Initiating and Responding Joint Attention as a Social Learning Mechanism: A Study Using Human-Avatar Head/Hand Interaction

사회 학습 기제로서 IJA와 RJA의 비교: 인간-아바타 머리/손 상호작용을 이용한 연구

  • 김민규 (한양대학교 컴퓨터소프트웨어학과) ;
  • 김소연 (덕성여자대학교 심리학과) ;
  • 김광욱 (한양대학교 컴퓨터공학부)
  • Received : 2015.12.09
  • Accepted : 2016.03.25
  • Published : 2016.06.15
⟨ Previous Next ⟩

Abstract

Joint Attention (JA) has been known to play a key role in human social learning. However, relative impact of different interaction types has yet to be rigorously examined because of limitation of existing methodologies to simulate human-to-human interaction. In the present study, we designed a new JA paradigm with emulating human-avatar interaction and virtual reality technologies, and tested the paradigm in two experiments with healthy adults. Our results indicated that initiating JA (IJA) condition was more effective than responding JA (RJA) condition for social learning in both head and hand interactions. Moreover, the hand interaction involved better information processing than the head interaction. The implication of the results, the validity of the new paradigm, and limitations of this study were discussed.

사회학습기제(Social learning mechanisms) 가운데 공동주의(Joint Attention; JA)는 인간의 학습에 핵심적 역할을 하는 것으로 알려져 왔다. 그러나 기존 인간 대 인간 상호작용 연구 방법론으로는 JA 요소 별 상호작용(예: 손 또는 머리)에 대한 연구가 어려웠다. 본 연구에서는 인간-아바타 상호작용(Human-Avatar Interaction)과 가상현실(Virtual Reality) 방법론을 시험적으로 적용하여 JA 요소 별 상호작용을 연구할 수 있는 프로그램을 만들고, 이를 활용하여 정상군의 상호작용에 대하여 2회에 걸친 실험으로 연구하였다. 본 연구 결과에 따르면 상호작용 방법론(손 또는 머리)에 상관없이 능동적 JA(Initiating JA: IJA)가 반응적 JA (Responding JA: RJA)보다 정보처리를 촉진시켰으며, 손을 이용한 상호작용이 머리를 이용한 상호작용 보다 상대적으로 정보처리에 영향을 많이 주는 것을 확인하였다. 본 연구 결과에 대한 잠재적 해석과 연구로써의 한계에 대하여 본 논문에서 논의하였다.

Keywords

Acknowledgement

Supported by : 한국연구재단

References

  1. A. Bandura, Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, Vol. 84, No. 2, pp. 191-215, 1977. https://doi.org/10.1037/0033-295X.84.2.191
  2. C. Kasari, T. Paparella, S. Freeman, L. B. Jahromi, Language outcome in autism: randomized comparison of joint attention and play interventions. J Consult Clin Psychol, Vol. 76, No. 1, pp. 125, 2008. https://doi.org/10.1037/0022-006X.76.1.125
  3. P. Mundy, L. Sullivan, and A. Master george, A parallel and distributed processing model of joint attention and autism. Autism Res., Vol. 2, No. 1, pp. 2-21, 2009. https://doi.org/10.1002/aur.61
  4. M. Tomasello, and M. Carpenter, The emergence of social cognition in three young chimpanzees. Monogr. Soc. Res. ChildDev. Vol. 70, pp. 1-136, 2005. https://doi.org/10.1111/j.1540-5834.2005.00365.x
  5. M. Tomasello, M. Carpenter, J. Call, T. Behne, and H. Moll, Understanding sharing intentions: the origins of cultural cognition. Behav. BrainSci. Vol. 28, No. 5, pp. 675-691, 2005.
  6. S. P. Vecera, and M. H. Johnson, Gaze detection and the cortical processing of faces: Evidence from infants and adults. Visual Cognition, Vol. 2, No. 1, pp. 59-87, 1995. https://doi.org/10.1080/13506289508401722
  7. P. Mundy, J. Block, C. Delqado, Y. Pomares, A. V. Van Hecke, and M. V. Parlade, Individual differences and the development of joint attention in infancy, Child Dev, Vol. 78, No. 3, pp. 938-954, 2007. https://doi.org/10.1111/j.1467-8624.2007.01042.x
  8. S. E. Miller and S. Marcovitch, Examining executive function in the second year of life: coherence, stability, and relations to joint attention and language, Dev Psychol, Vol. 51, No. 1, pp. 101-14, 2015. https://doi.org/10.1037/a0038359
  9. A. P. Bayliss, M. A. Paul, P. R. Cannon, and S. P. Tipper, Gaze cuing and affective judgments of objects: I like what you look at, Psychonomic Bulletin & Review, Vol. 13, No. 6, pp. 1061-1066, 2006. https://doi.org/10.3758/BF03213926
  10. A. Frischen, A. P. Bayliss, and S. P. Tipper, Gaze cuing of attention: visual attention, social cognition, and individual differences, Psychol Bull, Vol. 133, No. 4, pp. 694, 2007. https://doi.org/10.1037/0033-2909.133.4.694
  11. A. P. Bayliss, A. Frischen, M. J. Fenske, and S. P. Tipper, Affective evaluations of objects are influenced by observed gaze direction and emotional expression, Cognition, Vol. 104, No. 3, pp. 644-653, 2007. https://doi.org/10.1016/j.cognition.2006.07.012
  12. F. Capozzi, A. P. Bayliss, M. R. Elena, and C. Becchio, One is not enough: Group size modulates social gaze-induced object desirability effects, Psychon Bull Rev. Vol. 22, No. 3, pp. 850-855, 2015. https://doi.org/10.3758/s13423-014-0717-z
  13. J. M. Seibert, A. E. Hogan, and P. C. Mundy, Assessing interactional competencies: the early social communication scales. Infant Ment. HealthJ. Vol. 3, No. 4, pp. 244-258, 1982. https://doi.org/10.1002/1097-0355(198224)3:4<244::AID-IMHJ2280030406>3.0.CO;2-R
  14. R. MacDonald, J. Anderson, W. V. Dude, A. Geckeler, G. Green, W. Holcomb, R. Mansfield, and J. Sanchez, Behavioral assessment of joint attention: A methodological report, Research in Developmental Disabilities, Vol. 27, No. 2, pp. 138-150, 2006. https://doi.org/10.1016/j.ridd.2004.09.006
  15. P. Mundy, M. Sigman, and C. Kasari, Joint attention, developmental level, and symptom presentation in young children with autism, Development and Psychopathology, Vol. 6, No. 3, pp. 389-401, 1994. https://doi.org/10.1017/S0954579400006003
  16. C. Whalen and L. Schreibman, Joint attention training for children with autism using behavior modification procedures, Journal of Child Psychology and Psychiatry, Vol. 44, No. 3, pp. 456-469, 2003. https://doi.org/10.1111/1469-7610.00135
  17. W. Jarrold, P. Mundy, M. Gwaltney, J. Bailenson, N. Hatt, N, McIntyre, K. Kim, M. Solomon, S. Novotny, and L. Swain, Social Attention in a Virtual Public Speaking Task in Higher Functioning Children With Autism, Autism Res, Vol. 6, No. 5, pp. 393-410, 2013. https://doi.org/10.1002/aur.1302
  18. K. Kim, M. Z. Rosenthal, M. Gwaltney, W. Jarrold, N. Hatt, N. McIntyre, L. Swain, M. Solomon, and P. Mundy, A Virtual Joy-Stick Study of Emotional Responses and Social Motivation in Children with Autism Spectrum Disorder, J Autism Dev Disord, Vol. 45, No. 12, pp. 3891-3899, 2014. https://doi.org/10.1007/s10803-014-2036-7
  19. J. B. Grossman, A. Klin, A. S. Carter, and F. R. Volkmar, Verbal bias in recognition of facial emotions in children with Asperger syndrome, Journal of Child Psychology and Psychilatry, Vol. 41, No. 3, pp. 369-379, 2000. https://doi.org/10.1111/1469-7610.00621
  20. M. B. Harms, A. Martin, and G. L. Wallace, Facial emotion recognition in autism spectrum disorders: A review of behavioral and neuroimaging studies, Neuropsychology Review, Vol. 20, No. 3, pp. 290-322, 2010. https://doi.org/10.1007/s11065-010-9138-6
  21. J. L. Tracy, R. W. Robins, R. A. Schiriber, and M. Solomon, Is Emotion Recognition Impaired in Individuals with Autism Spectrum Disorders? Journal of Autism and Developmental Disorders, Vol. 41, No. 1, pp. 102-109, 2011. https://doi.org/10.1007/s10803-010-1030-y
  22. K. Kim, P. Mundy, Joint attention, social-cognition, and recognition memory in adults, Front Hum Neurosci, Vol. 6, 2012.
  23. K. M. Stanney, Handbook of Virtual Environments: Design, Implementation and applications, Lawrence Erlbaum Associates, Mahwah, NJ, 2002.
  24. H. G. Weller, Assessing the impact of computer-based learning on science, Journal of Research in Computing in Education, Vol. 28, No. 4, pp. 461-485, 1996. https://doi.org/10.1080/08886504.1996.10782178
  25. J. Diemer, G. W. Alpers, H. M. Peperkorn, Y. Shiban, and A. Muhlberger, The impact of Perception and presence on emotional reaction: a review of research in virtual reality, Front. Psychol., Vol. 6, 2015.
  26. J. Rampling, A. O'Brien, K. Hindhaugh, L. Woodhan, and S. Kavia, Use of an online virtual environment in psychiatric problembased learning, Psychiatrist, Vol. 36, No. 10, pp. 391-396, 2012. https://doi.org/10.1192/pb.bp.111.037630
  27. Jin SA and Park N, Parasocial interaction with my avatar: effects of interdependent self-construal and the mediating role of self-presence in an avatarbased console game, Wii, Cyberpsychol Behav, Vol. 12, No. 6, pp. 723-727, 2009. https://doi.org/10.1089/cpb.2008.0289
  28. D. Sheslow, and W. Adams, Wide Range Assessment of Memory and Learning Second Edition Administration and Technical Manual. Lutz, FL: Psychological Assessment Resources, 2003.
  29. H. Stanislaw, and N. Todorov, Calculation of signal detection theory. Behav. Res. Methods Instrum. Comput. Vol. 31, No. 1, pp. 137-149, 1999. https://doi.org/10.3758/BF03207704
  30. K. P. Schulz, J. Fan, O. Magidina, D. J. Marks, B. Hahn, and J. M. Halperin, Does the emotional go/no-go task really measure behavioral inhibition? Convergence with measures of a non-emotional analog. Arch. Clin. Neuropsychol. Vol. 22, No. 2, pp. 151-160, 2007. https://doi.org/10.1016/j.acn.2006.12.001
  31. L. Vygotsky, Interaction between learning and development. In Mind and Society, Cambridge, Mass.: Harvard University Press, 1978.
  32. R. Bakeman and L. B. Adamson, Coordinating attention to people and objects in mother-infant and peerinfant interaction, Child Dev, Vol. 55, No. 4, pp. 1278-1289, 1984. https://doi.org/10.2307/1129997
  33. A. P. Bayliss, D. Griffiths, and S. P. Tipper, Predictive gaze cues affect face evaluations: The effect of facial emotion, Eur J Cogn Psychol, Vol. 21, No. 7, pp. 1072-1084, 2009. https://doi.org/10.1080/09541440802553490
  34. G. Butterworth, Pointing is the royal road to language for babies, Pointing: where language, culture, and cognition meet. pp. 9-33.
  35. B. A. Sibley and J. L. Etnier, The relationship between physical activity and cognition in children: a meta-analysis, Pediatric Exercise Science, Vol. 15, No. 3, pp. 243-256, 2003. https://doi.org/10.1123/pes.15.3.243
  36. R. Ruscheweyh, C. Willemer, K. Kuger, T. Duning, T. Warnecke, J. Sommer, K. Volker, H. V. Ho, F. Mooren, S. Knecht, and A. Floel, Physical activity and memory functions: An interventional study, Neurobiology of Aging, Vol. 32, No. 7, pp. 1304-1319, 2011. https://doi.org/10.1016/j.neurobiolaging.2009.08.001