Korean Journal of Biological Psychiatry (생물정신의학)

The Korean Society of Biological Psychiatry (대한생물정신의학회)
권호 표지

Characteristics of Telepresence by Multisensory Feedback and Related Neural Mechanism in Patients with Schizophrenia : A Functional MRI Study

조현병 환자에서 다감각적 되먹임에 의한 원격현존감 특성 및 관련 신경 기전 : 기능자기공명영상 연구

  • Han, Ki-Wan (Severance Biomedical Science Institute, Yonsei University College of Medicine) ;
  • Choi, Soo-Hee (Institute of Behavioral Science in Medicine, Yonsei University College of Medicine) ;
  • Park, Il-Ho (Department of Psychiatry, Myongji Hospital, Kwandong University) ;
  • Lee, Hyeong-Rae (Department of Biomedical Engineering, Hanyang University) ;
  • Kim, Sun-I. (Department of Biomedical Engineering, Hanyang University) ;
  • Kim, Jae-Jin (Severance Biomedical Science Institute, Yonsei University College of Medicine)
  • 한기완 (연세대학교 의과대학 의생명과학부) ;
  • 최수희 (연세대학교 의과대학 의학행동과학연구소) ;
  • 박일호 (관동대학교 의과대학 명지병원 정신건강의학교실) ;
  • 이형래 (한양대학교 의용생체공학과) ;
  • 김선일 (한양대학교 의용생체공학과) ;
  • 김재진 (연세대학교 의과대학 의생명과학부)
  • Received : 2012.04.10
  • Accepted : 2012.06.07
  • Published : 2012.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives : The multimodal telepresence systems have been adopted in a variety of applications, such as telemedicine, space or underwater teleoperation and videoconference. Multimedia, one of the telepresence systems, has been used in various fields including entertainment, education and communication. The degree of subjective telepresence is defined as the probability that a person perceives to be physically in the remote place when he/she experiences a multisensory feedback from the multimedia. The current study aimed to explore the neural mechanism of telepresence related to multisensory feedback in patients with schizophrenia. Methods : Brain activity was measured using functional magnetic resonance imaging while fifteen healthy controls and fifteen patients with schizophrenia were experiencing filmed referential conversation at various distances (1 m, 5 m and 10 m). Correlations between the image contrast values and the telepresence scores were analyzed. Results : Subjective telepresence was not significantly different between the two groups. Some significant correlations of brain activities with the telepresence scores were found in the left postcentral gyrus, bilateral inferior frontal gyri, right fusiform gyrus, and left superior temporal sulcus. There were no main effects of group and distance. Conclusion : These results suggest that patients with schizophrenia experience telepresence as appropriately as healthy people do when exposed to multimedia. Therefore, patients with schizophrenia would have no difficulty in immersing themselves in multimedia which may be used in clinical training therapies.

Keywords

References

  1. Heeter C. Being there: the subjective experience of presence. Presence (Camb) 1992;1:262-271. https://doi.org/10.1162/pres.1992.1.2.262
  2. Sheridan TB. Further musings on the psychophysics of presence. Presence (Camb) 1996;5:241-246. https://doi.org/10.1162/pres.1996.5.2.241
  3. Lombard M, Ditton T. At the heart of it all: the concept of presence. JCMC 1997;3.
  4. Shi Z, Zou H, Rank M, Chen L, Hirche S, Muller HJ. Effects of packet loss and latency on the temporal discrimination of visual-haptic events. IEEE Trans Haptics 2010;3:28-36. https://doi.org/10.1109/TOH.2009.45
  5. Steuer J. Defining virtual reality: dimensions determining telepresence. J Commun 1992;42:73-93.
  6. Hirzinger G, Brunner B, Dietrich J, Heindl J. Sensor-based space robotics-ROTEX and its telerobotic features. IEEE Trans Rob Autom 1993;9:649-663. https://doi.org/10.1109/70.258056
  7. Ferre M, Buss M, Aracil R, Melchiorri C, Balaguer C. Advances in Telerobotics. Berlin: Springer;2007.
  8. Biocca F, Levy MR. Communication in the Age of Virtual Reality. New York: L. Erlbaum Associates;1995.
  9. Schloerb DW. A quantitative measure of telepresence. Presence (Camb) 1995;4:64-80. https://doi.org/10.1162/pres.1995.4.1.64
  10. Gescheider GA. Psychophysics: Method, Theory, and Application. 2nd ed. London: Psychology Press;1985.
  11. Draper JV, Kaber DB, Usher JM. Speculations on the value of telepresence. Cyberpsychol Behav 1999;2:349-362. https://doi.org/10.1089/cpb.1999.2.349
  12. Mueser KT, Jeste DV. Clinical Handbook of Schizophrenia. New York: Guilford Press;2008.
  13. van Os J, Kapur S. Schizophrenia. Lancet 2009;374:635-645. https://doi.org/10.1016/S0140-6736(09)60995-8
  14. Rothbaum BO, Hodges LF, Kooper R, Opdyke D, Williford JS, North M. Effectiveness of computer-generated (virtual reality) graded exposure in the treatment of acrophobia. Am J Psychiatry 1995;152:626-628.
  15. North MM, North SM, Coble JR. Virtual reality therapy for fear of flying. Am J Psychiatry 1997;154:130.
  16. Garcia-Palacios A, Hoffman H, Carlin A, Furness TA 3rd, Botella C. Virtual reality in the treatment of spider phobia: a controlled study. Behav Res Ther 2002;40:983-993. https://doi.org/10.1016/S0005-7967(01)00068-7
  17. Botella C, Villa H, Garcia Palacios A, Quero S, Banos RM, Alcaniz M. The use of VR in the treatment of panic disorders and agoraphobia. Stud Health Technol Inform 2004;99:73-90.
  18. Klinger E, Bouchard S, Legeron P, Roy S, Lauer F, Chemin I, et al. Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychol Behav 2005;8:76-88. https://doi.org/10.1089/cpb.2005.8.76
  19. Josman N, Somer E, Reisberg A, Weiss PL, Garcia-Palacios A, Hoffman H. BusWorld: designing a virtual environment for post-traumatic stress disorder in Israel: a protocol. Cyberpsychol Behav 2006;9:241-244. https://doi.org/10.1089/cpb.2006.9.241
  20. Rothbaum BO, Anderson P, Zimand E, Hodges L, Lang D, Wilson J. Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment of fear of flying. Behav Ther 2006;37:80-90. https://doi.org/10.1016/j.beth.2005.04.004
  21. Mitchell P, Parsons S, Leonard A. Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J Autism Dev Disord 2007;37:589-600. https://doi.org/10.1007/s10803-006-0189-8
  22. Cho BH, Ku J, Jang DP, Kim S, Lee YH, Kim IY, et al. The effect of virtual reality cognitive training for attention enhancement. Cyberpsychol Behav 2002;5:129-137. https://doi.org/10.1089/109493102753770516
  23. Rose FD, Brooks BM, Rizzo AA. Virtual reality in brain damage rehabilitation: review. Cyberpsychol Behav 2005;8:241-262; discussion 263-271. https://doi.org/10.1089/cpb.2005.8.241
  24. Rey B, Alcaniz M, Tembl J, Parkhutik V. Brain activity and presence: a preliminary study in different immersive conditions using transcranial Doppler monitoring. Virtual Real 2010;14:55-65. https://doi.org/10.1007/s10055-009-0141-2
  25. Baumgartner T, Speck D, Wettstein D, Masnari O, Beeli G, Jancke L. Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children. Front Hum Neurosci 2008;2:8. doi: 10.3389/neuro.09.008.2008.
  26. Nowak KL, Biocca F. The effect of the agency and anthropomorphism on users' sense of telepresence, copresence, and social presence in virtual environments. Presence (Camb) 2003;12:481-494. https://doi.org/10.1162/105474603322761289
  27. Cox RW. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 1996;29:162-173. https://doi.org/10.1006/cbmr.1996.0014
  28. McCarthy G, Puce A, Gore JC, Allison T. Face-specific processing in the human fusiform gyrus. J Cogn Neurosci 1997;9:605-610. https://doi.org/10.1162/jocn.1997.9.5.605
  29. Bokde AL, Lopez-Bayo P, Meindl T, Pechler S, Born C, Faltraco F, et al. Functional connectivity of the fusiform gyrus during a facematching task in subjects with mild cognitive impairment. Brain 2006;129(Pt 5):1113-1124. https://doi.org/10.1093/brain/awl051
  30. Radua J, Phillips ML, Russell T, Lawrence N, Marshall N, Kalidindi S, et al. Neural response to specific components of fearful faces in healthy and schizophrenic adults. Neuroimage 2010;49:939-946. https://doi.org/10.1016/j.neuroimage.2009.08.030
  31. Tranel D, Damasio H, Damasio AR. A neural basis for the retrieval of conceptual knowledge. Neuropsychologia 1997;35:1319-1327. https://doi.org/10.1016/S0028-3932(97)00085-7
  32. Chao LL, Haxby JV, Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat Neurosci 1999;2:913-919. https://doi.org/10.1038/13217
  33. Ishai A, Ungerleider LG, Martin A, Schouten JL, Haxby JV. Distributed representation of objects in the human ventral visual pathway. Proc Natl Acad Sci U S A 1999;96:9379-9384. https://doi.org/10.1073/pnas.96.16.9379
  34. Cabeza R, Nyberg L. Imaging cognition II: an empirical review of 275 PET and fMRI studies. J Cogn Neurosci 2000;12:1-47.
  35. Howard MA, Volkov IO, Mirsky R, Garell PC, Noh MD, Granner M, et al. Auditory cortex on the human posterior superior temporal gyrus. J Comp Neurol 2000;416:79-92. https://doi.org/10.1002/(SICI)1096-9861(20000103)416:1<79::AID-CNE6>3.0.CO;2-2
  36. Beauchamp MS, Lee KE, Argall BD, Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 2004;41:809-823. https://doi.org/10.1016/S0896-6273(04)00070-4
  37. Kim JJ, Mohamed S, Andreasen NC, O'Leary DS, Watkins GL, Boles Ponto LL, et al. Regional neural dysfunctions in chronic schizophrenia studied with positron emission tomography. Am J Psychiatry 2000;157:542-548. https://doi.org/10.1176/appi.ajp.157.4.542
  38. Turk M, Robertson G. Perceptual user interfaces. Commun ACM 2000;43:32-34.
  39. Stanney KM, Mollaghasemi M, Reeves L, Breaux R, Graeber DA. Usability engineering of virtual environments (VEs): identifying multiple criteria that drive effective VE system design. Int J Hum Comput Stud 2003;58:447-481. https://doi.org/10.1016/S1071-5819(03)00015-6
  40. Bowman DA. Interaction techniques for common tasks in immersive virtual environments. Georgia: Georgia University of Technology;1999.