• Korean Journal of Biological Psychiatry
• /
• v.19 no.3
• /
• pp.121-127
• /
• 2012

Objectives : The multimodal telepresence systems have been adopted in a variety of applications, such as telemedicine, space or underwater teleoperation and videoconference. Multimedia, one of the telepresence systems, has been used in various fields including entertainment, education and communication. The degree of subjective telepresence is defined as the probability that a person perceives to be physically in the remote place when he/she experiences a multisensory feedback from the multimedia. The current study aimed to explore the neural mechanism of telepresence related to multisensory feedback in patients with schizophrenia. Methods : Brain activity was measured using functional magnetic resonance imaging while fifteen healthy controls and fifteen patients with schizophrenia were experiencing filmed referential conversation at various distances (1 m, 5 m and 10 m). Correlations between the image contrast values and the telepresence scores were analyzed. Results : Subjective telepresence was not significantly different between the two groups. Some significant correlations of brain activities with the telepresence scores were found in the left postcentral gyrus, bilateral inferior frontal gyri, right fusiform gyrus, and left superior temporal sulcus. There were no main effects of group and distance. Conclusion : These results suggest that patients with schizophrenia experience telepresence as appropriately as healthy people do when exposed to multimedia. Therefore, patients with schizophrenia would have no difficulty in immersing themselves in multimedia which may be used in clinical training therapies.

• The Journal of Korean Academy of Sensory Integration
• /
• v.8 no.1
• /
• pp.41-49
• /
• 2010

Objective : Multisensory integration (MSI) is the essential process to use diverse sensory information for cognitive task or execution of motor action. Especially, visual and somatosensory integration is critical for motor behavior and coordination. This study was designed to explain spatial and temporal characteristics of visual and somatosensory integration by neurophysiological research method that identifies the time course and brain location of the SI process. Methods : Electroencephalography (EEG) and event-related potential (ERP) is used in this study in order to observe neural activities when integrating visual and tactile input. We calculate the linear summation (SUM) of visual-related potentials (VEPs) and somatosensory-related potentials (SEPs), and compared the SUM with simultaneously presented visual-tactile ERPs(SIM) Results : There were significant differences between the SIM and SUM in later time epochs (about 200-300ms) at contralateral somatosensory areas (C4) and occipital cortices (O1&O2). The amplitude of the SIM was mathematically larger than the summed signals, implying that the integration made some extra neural activities. Conclusion : This study provides some empirical neural evidence of that multisensory integration is more powerful than just combing two unisensory inputs in the brain and ERP data reveals neural signature relating to multisensory integrative process. Since this study is preliminary pilot study, larger population and criteria are needed for level of the significance. Further study is recommended to consider issues including effect of internally-driven attention and laterality of interaction to make the evidence by this study solid.

• The Journal of Korean society of community based occupational therapy
• /
• v.6 no.2
• /
• pp.1-10
• /
• 2016

Objective : The purpose of this study was to examine the effect of multi-sensory stimulation training on cognitive function and balance skill of the community resident elderly. Methods : 10 participants who is over aged 65 years carry out multisensory stimulation training program for 12weeks, once a week for 60minutes. The multisensory stimulation training program is consisted of total 12 topic based on body schema, gross muscle and tactile stimulation. The result was measured using Mini-Mental State Examination-Korean and Berg Balance Scale to evaluate before and after of cognitive function and balance skill. And after intervention, the satisfaction of the program was investigated. Wilcoxon matched-pair signed rank test was used to compare pre- post difference of cognitive function and balance skill. Results : There was significant difference in cognitive function and balance skill(p<.05) and the satisfaction is positive at the end of the program. Conclusion : The multisensory stimulation training program has positive effects on cognitive function and balance skill for elderly. And the satisfaction is positive at the end of the program. The multisensory stimulation training program can enhance the satisfaction to elderly in the aging society. So, additional studies is needed for efficient use.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.11
• /
• pp.61-69
• /
• 2019

In this paper, we propose a multisensory(i.e., visual-auditory-tactile) based AR system for the education of cultural heritage. The proposed system provides a multisensory interaction by designing a user to experience with a 3D printed artifact which is mapped by a virtual 3D content of digital heritage. Compared with the existing systems of cultural heritage education based on augmented reality(AR) technology, this system focused on not only providing learning experience via a sense of visual and auditory, but also a sense of tactile. Furthermore, since this systems mainly provided the direct interactions using a 3D printed model, it gives a higher degree of realism than existing system that use touch or click motions on a 2D display of mobile phones and tablets. According to a result of user testing, we concluded that the proposed system delivered the excellent presence and learning flow to users. Particularly, from the usability evaluation, a 3D printed target artifact which is similar in shape to original heritage artifact, achieved the highest scores among the various tested targets.

• Journal of the Korean Society of Costume
• /
• v.65 no.6
• /
• pp.133-147
• /
• 2015

The aim of this study is to review the creative fashion installation of Henrik Vibskov, Danish designer. Its intention is to contribute useful information for more innovative fashion presentation. As a research method, document and case study were performed and his collections from 2004 F/W to 2016 S/S were analyzed. In fashion installation, the designer puts objects in meaningful spaces in order to convey a certain message, to make an integrated artwork, and to interact with spectator. It has been used in fashion exhibitions, as well as in the set design of fashion performance and fashion show. The results were as follows. Henrik Vibskov's fashion installation has three features, which are 1)conceptual theme approach that communicates a twisted and metaphoric message, with a poetic and interesting show title, 2) surrealistic scenography that plays with fragmentation of the human body, clustering of plastic and symbolic objects, innovative color transformations, and visual trickery between figures and the background, and 3) setting for multisensory performance that makes spectators interact by making artistic objects and surroundings, which stimulates the five senses. Henrik Vibskov's fashion installation can exist as an independent artwork, and not just as a supporting piece for a fashion show. It has both artistic and fashionable values, and can be an effective fashion presentation communicating his conceptual fashion themes.

• Science of Emotion and Sensibility
• /
• v.24 no.4
• /
• pp.139-148
• /
• 2021

This study aimed to verify how a multisensory storytelling-based activity-based intervention affects social interaction in children with cerebral palsy. As a quasi-experimental investigation, this study used a single-blind, two-group pre-post test design. This study comprised 24 children aged 7 to 8 y who had been diagnosed with spastic cerebral palsy and were classified as having GMFCS stages I to III. Twelve children were randomly assigned to experimental and control groups, with neither the children nor their guardians knowing which group they were placed in. The group program comprised 16 sessions of 60 min each, twice a week for eight weeks. The experimental group engaged in an activity-centered intervention centered on multisensory storytelling, whereas the control group engaged in structured physical activity. The activities were assessed using the peer relations skills scale to determine the extent to which social interaction had changed prior to and during the child's intervention. The SPSS 25.0 for Windows (IBM Corp, USA) application was used to analyze the data, and the significance level (α) for statistical verification was set to 0.05. Furthermore, the Wilcoxon Signed-Rank and Mann-Whitney U tests were used to assess the differences in social interaction between the experimental and control groups. Significant differences were observed in the total of the peer relationship skill scale and cooperation and empathy areas of the subtest in the intragroup change of the peer relationship skill scale between the experimental and control groups. However, the experimental group demonstrated a significant difference in the initiative area, whereas the control group demonstrated no significant difference. A significant difference was observed in the amount of change between the two groups in the initiative area and total of the subtest of peer relationship skills but no significant difference in the collaboration and empathy areas. We gave a multisensory storytelling-based activity-based intervention based on multisensory storytelling to children with cerebral palsy and saw a significant improvement in peer relationship skills. It may be proposed as an effective intervention strategy for children with cerebral palsy who struggle with social contact.

• The Journal of Korean society of community based occupational therapy
• /
• v.8 no.2
• /
• pp.1-14
• /
• 2018

Objective : The purpose of this study was to investigate the change in self-efficacy and writing ability after applying a Task-Oriented Multi-Sensory Movement Program to children with ADHD tendency accompanied by learning delays. Methods : A Task-Oriented Multi-Sensory Movement Program was implemented to children with ADHD tendency accompanied by learning delays attending S elementary school. The research proceeded in the order of a pre-test, Task-Oriented Multi-Sensory Movement intervention, and a post-test. The first session involved a pre-test, in which the children's self-efficacy and writing ability were examined using self-efficacy test and type 'A' KNISE-BAAT writing test. The multisensory group activity program intervention was conducted for a total of 8 sessions. In the last session, a post-test was conducted using self-efficacy test and type 'B' KNISE-BAAT writing test. Data collected from the tests were analyzed using SPSS Statistics 18. Results : According to the tests taken before and after implementing the Task-Oriented Multi-Sensory Movement Program, there was a significant improvement in self-efficacy (school, society), writing ability(command of vocabulary and sentence). Conclusion : Task-Oriented Multi-Sensory Movement Program may be used as a beneficial measure to improve the self-efficacy and writing abilities of children with ADHD tendency accompanied by learning delays. It is necessary to design various intervention models by combining educational media based on a multisensory approach.

• Investigative Magnetic Resonance Imaging
• /
• v.19 no.1
• /
• pp.1-9
• /
• 2015

Purpose: Several morphometric studies have been performed to investigate brain abnormalities in congenitally deaf people. But no report exists concerning structural brain abnormalities in congenitally deaf adolescents. We evaluated the regional volume changes in gray matter (GM) using voxel-based morphometry (VBM) in congenitally deaf adolescents. Materials and Methods: A VBM8 methodology was applied to the T1-weighted magnetic resonance imaging (MRI) scans of eight congenitally deaf adolescents (mean age, 15.6 years) and nine adolescents with normal hearing. All MRI scans were normalized to a template and then segmented, modulated, and smoothed. Smoothed GM data were tested statistically using analysis of covariance (controlled for age, gender, and intracranial cavity volume). Results: The mean values of age, gender, total volumes of GM, and total intracranial volume did not differ between the two groups. In the auditory centers, the left anterior Heschl's gyrus and both inferior colliculi showed decreased regional GM volume in the congenitally deaf adolescents. The GM volumes of the lingual gyri, nuclei accumbens, and left posterior thalamic reticular nucleus in the midbrain were also decreased. Conclusions: The results of the present study suggest that early deprivation of auditory stimulation in congenitally deaf adolescents might have caused significant underdevelopment of the auditory cortex (left Heschl's gyrus), subcortical auditory structures (inferior colliculi), auditory gain controllers (nucleus accumbens and thalamic reticular nucleus), and multisensory integration areas (inferior colliculi and lingual gyri). These defects might be related to the absence of general auditory perception, the auditory gating system of thalamocortical transmission, and failure in the maturation of the auditory-to-limbic connection and the auditorysomatosensory-visual interconnection.

• 제어로봇시스템학회:학술대회논문집
• /
• 1991.10b
• /
• pp.1597-1600
• /
• 1991

In this paper, we describe a notion of sensor modeling method in multisensor data fusion using fuzzy set theory. Each sensor module is characterized by its fuzzy constraints to specific features of environment. These sensor fuzzy constraints can be imposed on multisensory data to verify their degree of truth and compatibility toward the final decision making. In comparison with other sensor modeling methods, such as probabilistic models or rule-based models, the proposed method is very simple and can be easily implemented in intelligent robot systems.

• Journal of the Korean Institute of Navigation
• /
• v.24 no.3
• /
• pp.133-140
• /
• 2000

The paper deals with the implementation of prototype Ship Simulator system (VRSS) by Virtual Reality techniques with Head Mounted Display (HMD) device. The prototype VRSS was consists of PC-based human sensors, object oriented operating system. In addition, two kinds of databases arranged from Head Related Transfer Functions and 3D object models were used to create 3D sea sound, and to construct virtual world, respectively. Using the prototype system, we carried out some simulation tests for the overtaking situation to prevent collisions at sea, and discussed on the usability of the system. As results from simulations, the prototype VRSS can provide multisensory and interactive display environment. The results gave rise to the user interaction with 3D objects that give realistic reproduction of navigational environments under a given scenario. Thus, we found that the prototype VRSS should be one of the next-generation ship simulation system.