Browse > Article

Characteristics of Telepresence by Multisensory Feedback and Related Neural Mechanism in Patients with Schizophrenia : A Functional MRI Study  

Han, Ki-Wan (Severance Biomedical Science Institute, Yonsei University College of Medicine)
Choi, Soo-Hee (Institute of Behavioral Science in Medicine, Yonsei University College of Medicine)
Park, Il-Ho (Department of Psychiatry, Myongji Hospital, Kwandong University)
Lee, Hyeong-Rae (Department of Biomedical Engineering, Hanyang University)
Kim, Sun-I. (Department of Biomedical Engineering, Hanyang University)
Kim, Jae-Jin (Severance Biomedical Science Institute, Yonsei University College of Medicine)
Publication Information
Korean Journal of Biological Psychiatry / v.19, no.3, 2012 , pp. 121-127 More about this Journal
Abstract
Objectives : The multimodal telepresence systems have been adopted in a variety of applications, such as telemedicine, space or underwater teleoperation and videoconference. Multimedia, one of the telepresence systems, has been used in various fields including entertainment, education and communication. The degree of subjective telepresence is defined as the probability that a person perceives to be physically in the remote place when he/she experiences a multisensory feedback from the multimedia. The current study aimed to explore the neural mechanism of telepresence related to multisensory feedback in patients with schizophrenia. Methods : Brain activity was measured using functional magnetic resonance imaging while fifteen healthy controls and fifteen patients with schizophrenia were experiencing filmed referential conversation at various distances (1 m, 5 m and 10 m). Correlations between the image contrast values and the telepresence scores were analyzed. Results : Subjective telepresence was not significantly different between the two groups. Some significant correlations of brain activities with the telepresence scores were found in the left postcentral gyrus, bilateral inferior frontal gyri, right fusiform gyrus, and left superior temporal sulcus. There were no main effects of group and distance. Conclusion : These results suggest that patients with schizophrenia experience telepresence as appropriately as healthy people do when exposed to multimedia. Therefore, patients with schizophrenia would have no difficulty in immersing themselves in multimedia which may be used in clinical training therapies.
Keywords
Telepresence; Schizophrenia; Multimedia; Brain function; Functional MRI;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Heeter C. Being there: the subjective experience of presence. Presence (Camb) 1992;1:262-271.   DOI
2 Sheridan TB. Further musings on the psychophysics of presence. Presence (Camb) 1996;5:241-246.   DOI
3 Lombard M, Ditton T. At the heart of it all: the concept of presence. JCMC 1997;3.
4 Shi Z, Zou H, Rank M, Chen L, Hirche S, Muller HJ. Effects of packet loss and latency on the temporal discrimination of visual-haptic events. IEEE Trans Haptics 2010;3:28-36.   DOI
5 Steuer J. Defining virtual reality: dimensions determining telepresence. J Commun 1992;42:73-93.
6 Hirzinger G, Brunner B, Dietrich J, Heindl J. Sensor-based space robotics-ROTEX and its telerobotic features. IEEE Trans Rob Autom 1993;9:649-663.   DOI   ScienceOn
7 Ferre M, Buss M, Aracil R, Melchiorri C, Balaguer C. Advances in Telerobotics. Berlin: Springer;2007.
8 Biocca F, Levy MR. Communication in the Age of Virtual Reality. New York: L. Erlbaum Associates;1995.
9 Schloerb DW. A quantitative measure of telepresence. Presence (Camb) 1995;4:64-80.   DOI
10 Gescheider GA. Psychophysics: Method, Theory, and Application. 2nd ed. London: Psychology Press;1985.
11 Draper JV, Kaber DB, Usher JM. Speculations on the value of telepresence. Cyberpsychol Behav 1999;2:349-362.   DOI
12 Mueser KT, Jeste DV. Clinical Handbook of Schizophrenia. New York: Guilford Press;2008.
13 van Os J, Kapur S. Schizophrenia. Lancet 2009;374:635-645.   DOI   ScienceOn
14 Rothbaum BO, Hodges LF, Kooper R, Opdyke D, Williford JS, North M. Effectiveness of computer-generated (virtual reality) graded exposure in the treatment of acrophobia. Am J Psychiatry 1995;152:626-628.
15 North MM, North SM, Coble JR. Virtual reality therapy for fear of flying. Am J Psychiatry 1997;154:130.
16 Garcia-Palacios A, Hoffman H, Carlin A, Furness TA 3rd, Botella C. Virtual reality in the treatment of spider phobia: a controlled study. Behav Res Ther 2002;40:983-993.   DOI   ScienceOn
17 Botella C, Villa H, Garcia Palacios A, Quero S, Banos RM, Alcaniz M. The use of VR in the treatment of panic disorders and agoraphobia. Stud Health Technol Inform 2004;99:73-90.
18 Klinger E, Bouchard S, Legeron P, Roy S, Lauer F, Chemin I, et al. Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychol Behav 2005;8:76-88.   DOI   ScienceOn
19 Josman N, Somer E, Reisberg A, Weiss PL, Garcia-Palacios A, Hoffman H. BusWorld: designing a virtual environment for post-traumatic stress disorder in Israel: a protocol. Cyberpsychol Behav 2006;9:241-244.   DOI   ScienceOn
20 Rothbaum BO, Anderson P, Zimand E, Hodges L, Lang D, Wilson J. Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment of fear of flying. Behav Ther 2006;37:80-90.   DOI   ScienceOn
21 Mitchell P, Parsons S, Leonard A. Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J Autism Dev Disord 2007;37:589-600.   DOI   ScienceOn
22 Baumgartner T, Speck D, Wettstein D, Masnari O, Beeli G, Jancke L. Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children. Front Hum Neurosci 2008;2:8. doi: 10.3389/neuro.09.008.2008.
23 Cho BH, Ku J, Jang DP, Kim S, Lee YH, Kim IY, et al. The effect of virtual reality cognitive training for attention enhancement. Cyberpsychol Behav 2002;5:129-137.   DOI   ScienceOn
24 Rose FD, Brooks BM, Rizzo AA. Virtual reality in brain damage rehabilitation: review. Cyberpsychol Behav 2005;8:241-262; discussion 263-271.   DOI   ScienceOn
25 Rey B, Alcaniz M, Tembl J, Parkhutik V. Brain activity and presence: a preliminary study in different immersive conditions using transcranial Doppler monitoring. Virtual Real 2010;14:55-65.   DOI   ScienceOn
26 Nowak KL, Biocca F. The effect of the agency and anthropomorphism on users' sense of telepresence, copresence, and social presence in virtual environments. Presence (Camb) 2003;12:481-494.   DOI   ScienceOn
27 Cox RW. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 1996;29:162-173.   DOI   ScienceOn
28 McCarthy G, Puce A, Gore JC, Allison T. Face-specific processing in the human fusiform gyrus. J Cogn Neurosci 1997;9:605-610.   DOI   ScienceOn
29 Bokde AL, Lopez-Bayo P, Meindl T, Pechler S, Born C, Faltraco F, et al. Functional connectivity of the fusiform gyrus during a facematching task in subjects with mild cognitive impairment. Brain 2006;129(Pt 5):1113-1124.   DOI
30 Radua J, Phillips ML, Russell T, Lawrence N, Marshall N, Kalidindi S, et al. Neural response to specific components of fearful faces in healthy and schizophrenic adults. Neuroimage 2010;49:939-946.   DOI   ScienceOn
31 Cabeza R, Nyberg L. Imaging cognition II: an empirical review of 275 PET and fMRI studies. J Cogn Neurosci 2000;12:1-47.
32 Tranel D, Damasio H, Damasio AR. A neural basis for the retrieval of conceptual knowledge. Neuropsychologia 1997;35:1319-1327.   DOI   ScienceOn
33 Chao LL, Haxby JV, Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat Neurosci 1999;2:913-919.   DOI   ScienceOn
34 Ishai A, Ungerleider LG, Martin A, Schouten JL, Haxby JV. Distributed representation of objects in the human ventral visual pathway. Proc Natl Acad Sci U S A 1999;96:9379-9384.   DOI   ScienceOn
35 Howard MA, Volkov IO, Mirsky R, Garell PC, Noh MD, Granner M, et al. Auditory cortex on the human posterior superior temporal gyrus. J Comp Neurol 2000;416:79-92.   DOI   ScienceOn
36 Beauchamp MS, Lee KE, Argall BD, Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 2004;41:809-823.   DOI   ScienceOn
37 Kim JJ, Mohamed S, Andreasen NC, O'Leary DS, Watkins GL, Boles Ponto LL, et al. Regional neural dysfunctions in chronic schizophrenia studied with positron emission tomography. Am J Psychiatry 2000;157:542-548.   DOI
38 Turk M, Robertson G. Perceptual user interfaces. Commun ACM 2000;43:32-34.
39 Stanney KM, Mollaghasemi M, Reeves L, Breaux R, Graeber DA. Usability engineering of virtual environments (VEs): identifying multiple criteria that drive effective VE system design. Int J Hum Comput Stud 2003;58:447-481.   DOI   ScienceOn
40 Bowman DA. Interaction techniques for common tasks in immersive virtual environments. Georgia: Georgia University of Technology;1999.