• Journal of the Institute of Convergence Signal Processing
• /
• v.11 no.2
• /
• pp.132-136
• /
• 2010

Psychophysical experiment was performed to investigate how audio-visual spatial disparity affects on perceptual space in peripheral vision. In the experiment, participants were exposed to two stimuli of vision and sound which comes simultaneously from different directions, respectively. The visual stimulus was implemented by 7 white LEDs which were located at an equal distance with 7 different angles of $-70^{\circ}$, $-40^{\circ}$, $-20^{\circ}$, $0^{\circ}$, $20^{\circ}$, $40^{\circ}$, and $70^{\circ}$ from the right front. Those audial stimuli were also implemented by loudspeakers which were placed at 9 different directions equally spaced by $5^{\circ}$ ranged from $-20^{\circ}$ to $20^{\circ}$. Each participant then evaluated spatial disparity between visual and audial stimuli with 5 levels of response, in which the higher level indicates the larger gap. When the visual stimulus is applied from the right, the results show that the response level gets higher for a larger angle between visual and auditory stimuli. A similar tendency for the visual stimulus with $0^{\circ}$ orientation was also be observed. On the other hand, when the visual stimulus is applied from the left, the response level gets lower for the larger angle.

• Science of Emotion and Sensibility
• /
• v.26 no.1
• /
• pp.43-54
• /
• 2023

In this study, we assessed how participants represent various sensory stimuli experiences through behavioral ratings and physiological measurements. Utilizing intersubject correlation (ISC) analysis, we evaluated whether individuals' affective responses of dominance, arousal, and valence differed when stimuli of three modality conditions (auditory, visual, and haptic) were presented. ISC analyses were used to measure the similarities between one participant's responses and those of the others. To calculate the intersubject correlation, we divided the entire dataset into one subject and all other subject datasets and then correlated the two for all possible stimulus pair combinations. The results revealed that for dominance, ISCs of the visual modality condition were greater than the auditory modality condition, whereas, for arousal, the auditory condition was greater than the visual modality. Last, negative valence conditions had the greater consistency of the participants' reactions than positive conditions in each of the sensory modalities. When comparing modalities, greater ISCs were observed in haptic modality conditions than in visual and auditory modality conditions, regardless of the affective categories. We discussed three core affective representations of multiple modalities and proposed ISC analysis as a tool for examining differences in individuals' affective representations.

• Science of Emotion and Sensibility
• /
• v.26 no.3
• /
• pp.3-14
• /
• 2023

This study used intersubject representational similarity analysis (IS-RSA) to identify participant-response consistency patterns in previously published data. Additionally, analysis of variance (ANOVA) was utilized to detect any variations in the conditions of each experiment. In each experiment, a combination of ASMR stimulation, visual and auditory stimuli, and time-series emotional video stimulation was employed, and emotional ratings and physiological measurements were collected in accordance with the respective experimental conditions. Every pair of participants' measurements for each stimulus in each experiment was correlated using Pearson correlation coefficient as part of the IS-RSA. The results of study revealed a consistent response pattern among participants exposed to ASMR, visual, and auditory stimuli, in contrast to those exposed to time-series emotional video stimulation. Notably, the ASMR experiment demonstrated a high level of response consistency among participants in positive conditions. Furthermore, both auditory and visual experiments exhibited remarkable consistency in participants' responses, especially when subjected to high arousal levels and visual stimulation. The findings of this study confirm that IS-RSA serves as a valuable tool for summarizing and presenting multidimensional data information. Within the scope of this study, IS-RSA emerged as a reliable method for analyzing multidimensional data, effectively capturing and presenting comprehensive information pertaining to the participants.

• Journal of Digital Convergence
• /
• v.16 no.9
• /
• pp.405-412
• /
• 2018

When a film company decides whether to invest or not in a scenario is the appropriate time to predict box office success. In response to market demands, AI based scenario analysis service has been launched, yet the algorithm is by no means perfect. The purpose of this study is to present a prediction model of movie scenario's box office hit based on human brain processing mechanism. In order to derive patterns of visual, auditory, and cognitive stimuli on the time spectrum of box office animation hit, this study applied Weber's law and brain mechanism. The results are as follow. First, the frequency of brain stimulation in the biggest box office movies was 1.79 times greater than that in the failure movies. Second, in the box office success, the cognitive stimuli codes are spread evenly, whereas in the failure, concentrated among few intervals. Third, in the box office success movie, cognitive stimuli which have big cognition load appeared alone, whereas visual and auditory stimuli which have little cognitive load appeared simultaneously.

• Proceedings of the KSPS conference
• /
• 2003.10a
• /
• pp.33-36
• /
• 2003

Two experiments were conducted to support the suggestion that the same information processing was used in both input modalities, visual and auditory modality in Wonil Choi & Kichun Nam(2003)'s paper. The primed lexical decision task was performed and pseudoword prime stimuli were used. The result was that priming effect did not occur in any experimental condition. This result might be interpreted visual facilitative information and phonological inhibitory information cancelled each other.

• Journal of Biomedical Engineering Research
• /
• v.17 no.2
• /
• pp.179-188
• /
• 1996

A clinically oriented 32-channel electroencephalogram (EEG) and evoked potential (EP) mapping system has been developed EEG and EP signals acquired from 32-channel electrodes attached on the heroid surface are amplified by a pre-amplifier which is separated from main amplifier and is located near the patient to reduce signal attenuation and noise contamination between electrodes and the amplifier. The amplified signals are further amplified by a main amplifier where various filtering and gain contr61 are achieved An automatic artifact rejection scheme is employed using neural network-based EEG and artifact classifier, by which examination time is substantially reduce4 The continuously measured EEG sigrlals are used for spectral mapping, and auditory and visual evoked potentials measured in synchronous to the auditory and visual stimuli are used for temporal evoked potential mapping. A user-friendly graphical interface based on the Microsoft Window 3.1 is developed for the operation of the system. Statistical databases for comparisons of group and individual are included to support a statistically-based diagnosis.

• Investigative Magnetic Resonance Imaging
• /
• v.15 no.2
• /
• pp.130-138
• /
• 2011

Purpose : To compare fMRIs of visual and auditory word generation tasks, and to evaluate the difference of its activated areas and lateralization according to the mode of stimuli. Materials and Methods : Eight male normal volunteers were included and all were right handed. Functional maps were obtained during auditory and visual word generation tasks in all. Normalized group analysis were performed in each task and the threshold for significance was set at p<0.05. Activated areas in each task were compared visually and statistically. Results : In both tasks, left dominant activations were demonstrated and were more lateralized in visual task. Both frontal lobes (Broca's area, premotor area, and SMA) and left posterior middle temporal gyrus were activated in both tasks. Extensive bilateral temporal activations were noted in auditory task. Both occipital and parietal activations were demonstrated in visual task. Conclusion : Modality independent areas could be interpreted as a core area of language function. Modality specific areas may be associated with processing of stimuli. Visual task induced more lateralized activation and could be a more useful in language study than auditory task.

• Science of Emotion and Sensibility
• /
• v.21 no.2
• /
• pp.73-88
• /
• 2018

The present study examined how processing features of visual information near the hand would affect task switching. Recent studies reported enhanced cognitive control of visual information presented the near hands. To investigate the enhancement of cognitive control based on the relationship between hand proximity and attention, we implemented 2 experiments. In the task switching performance experiment, the hand proximity effect depended on modality of cue and target. The first experiment showed that stimuli near the hand received greater cognitive control than stimuli far from the hand, resulting in smaller switch cost. The result could rule out the feature-binding problem, which identifies reduced switch cost as the cause instead of hand proximity. Our results show that hand proximity actually reduced switch cost. In the second experiment, we examined the effects of hand nearness, modality, and their interaction on switch cost. In task switching, the target was always visual, and the cue was presented either visually or auditorily. In addition, we manipulated the cue-target interval to observe the preparation effect of cue. The results showed that a visual cue near the hand reduced switch cost by shortening task preparation time. Also, modality switching between an auditory cue and visual target was remarkable in a hand-near condition. The results for the visual cue could be interpreted as a benefit of rapid visual attention orienting. On the other hand, the results for the auditory cue could be interpreted as the cost of interference of modality switching by slower attentional disengagement of stimuli near the hands. Finally, modulation of switch cost by attention induced by hand nearness was discussed.

• The Journal of the Korea Contents Association
• /
• v.20 no.10
• /
• pp.199-215
• /
• 2020

The purpose of this study is to understand dogs for their happy lives. Experiment and survey were conducted to find out the effects of sensory stimulation on dogs emotions. Sensory were divided into visual, auditory, olfactory, tactile, complex and emotions were measured by the rate of deep sleep, feed intake, and heart rate. Research has shown that complex stimulation (walking) is the most positive stimulation for dog's emotions, but visual stimulation and auditory stimulation do not act as stimuli that positively change usual state of dog's emotions. Olfactory stimuli is the second best stimulation. Since olfactory stimulation is effective in maintaining a calm state without large deviation in the dog's state, it can be used as a method for relieving the dog's stress in exceptional situations when complex stimulation is not possible. On the other hand, tactile stimulation, bath, is a negative sensory stimulus that causes hypersomnia and binge eating for most dogs.

• Journal of Veterinary Clinics
• /
• v.25 no.6
• /
• pp.506-509
• /
• 2008

A 2-month-old, intact female white Bull Terrier presented because of suspected deafness. The coat color was predominantly white and the iris color, of both eyes, was brown. The dog did not respond to the owner's voice when the sound stimuli were presented outside of the visual field; however, the dog responded to visual gestures. The other physical, neurological, otoscopic, radiographic, and blood examinations were unremarkable. To assess the apparent deafness, brainstem auditory evoked responses (BAER) were recorded and analyzed in the dog with suspected deafness as well as a normal littermate. The response in the normal littermate consisted of a series of five wave peaks (I-V) with decreased amplitude and prolonged latency as the stimulus intensity decreased. The BAER from the dog suspected of deafness appeared as a flat line and did not reveal identifiable peaks that corresponded to those found in the normal littermate. Thus, congenital, sensorineural and bilateral deafness was confirmed by the BAER.