• Science of Emotion and Sensibility
• /
• v.26 no.1
• /
• pp.43-54
• /
• 2023

In this study, we assessed how participants represent various sensory stimuli experiences through behavioral ratings and physiological measurements. Utilizing intersubject correlation (ISC) analysis, we evaluated whether individuals' affective responses of dominance, arousal, and valence differed when stimuli of three modality conditions (auditory, visual, and haptic) were presented. ISC analyses were used to measure the similarities between one participant's responses and those of the others. To calculate the intersubject correlation, we divided the entire dataset into one subject and all other subject datasets and then correlated the two for all possible stimulus pair combinations. The results revealed that for dominance, ISCs of the visual modality condition were greater than the auditory modality condition, whereas, for arousal, the auditory condition was greater than the visual modality. Last, negative valence conditions had the greater consistency of the participants' reactions than positive conditions in each of the sensory modalities. When comparing modalities, greater ISCs were observed in haptic modality conditions than in visual and auditory modality conditions, regardless of the affective categories. We discussed three core affective representations of multiple modalities and proposed ISC analysis as a tool for examining differences in individuals' affective representations.

• Journal of Biomedical Engineering Research
• /
• v.20 no.4
• /
• pp.471-477
• /
• 1999

Many researches have been performed whether electrical stimulation could be used for diagnosis and treatment on the auditory system impairment. Unfortunately, there were no standard methods or theoretical background for choosing stimulus conditions because of the lack of understanding on the transmission of electrical stimulation through the auditory pathway. This research was conducted to observe the effect of electrical stimulation on the tinnitus-induced animals. Nine guniea pigs were used for the experment and divided into two groups, five animals for the experimental group(A) and four animals for the control group(B). Experimental conditions were divided into four steps, before tinnitus induction and 1, 6, 12 hours after tinnitus induction using salicylate based on the Jastreboff model. In each experimental condition, ABR and ECochG were obtained, and autocorrelation coefficients were calculated from normalized waveforms based on rms values. Sum of all the autocorrelation coefficients was extracted as a parameter to observe the changes between before and after the electrical stimulation. As a result, ABR parameter values were rapidly increased 6 hours after tinnitus induction, the gradually returned back to the initial state. On the other hand, when electrical stimulation was applied, parameter values did not change compared with the initial sate. Parameter values of ECochG showed that the effect of electrical stimulation appeared 12 hours after the tinnitus induction. It was concluded that an electrical stimulation to the tinnitus-induced model changes the correlation coefficients of ABR and ECochG waveforms.

• Journal of Biomedical Engineering Research
• /
• v.19 no.5
• /
• pp.539-546
• /
• 1998

The purpose of this study is to estimate human emotion quantitatively under colors and music stimuli and to examine the for correlation between color and music sensibility. Physiological signals(electroencephalogram, electrocardiogram, Galvanic skin conductivity and respiration rate) were measured to compare color with music sensibilities. The personality of the subject were investigated using factor analysis and semantic differential method of 20 items(7 interval scaled). The results showed that red, yellow and violets color provoked active and exciting senses mainly as dance, rock and blues music. While blue, cyan and pink colors ware involved in tranquil and resting emotions deeply as classic and ballade music.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2001.05a
• /
• pp.92-96
• /
• 2001

제품에 대한 소비자의 평가는 제품이 나타내는 전반적인 특성에 대하여 이루어지며, 이 과정에서 인간의 오감이 모두 작용한다. 최근 대두되기 시작하고 있는 다감각 디자인은 형태와 색상을 중심으로 한 시각 중심의 디자인에 시각분만 아니라 청각과 후각 등의 감각요소를 추가하려는 시도를 하고 있다. 제품 디자인에 다감각을 활용하기 위해서는 복합적인 감각자극과 인간의 감성 사이의 관계가 명확하게 이해되어야 하며, 복합자극 이전에 시각 이외의 단순 감각자극에 의한 감성 변화에 대한 이해가 선행되어야 한다. 본 연구는 음향자극에 대한 감성변화를 평가하는 것을 목적으로 하였으며, 선별된 30개 음향을 대상으로 6쌍의 감성어휘를 이용하여 평가한 결과, 음향이 피실험자의 감성에 변화를 발생시키는 것을 확인하였다. 감성의 변화는 음향의 물리적 속성 분만 아니라 사용자 자신의 개인적, 사회적, 문화적 요인에 의해 차이를 보였으며, 이 결과는 감성의 개인적 속성을 확인시켜 주었다.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.16 no.1
• /
• pp.89-94
• /
• 2021

In this paper, we presented the results of analysis with data obtained through EEG measurements to confirm the effect of musical stimulus when performing mathematical tasks. While the subject was solving a mathematical task, favorite and unfavorite music classified according to the subject's preference were presented as musical stimulus and the tasks were divided into memorization task and procedure task. The data measured in the EEG experiments was divided into theta waves, SMR waves and mid-beta waves which are the frequency bands related to concentration to compare the relative power spectrum values. In our results, in the case of comparing no music with favorite music and no music with unfavorite music, a significant difference was observed in the several channels, and the average difference was shown in the channels F3 and F4 of the frontal lobe. In that channels, the power was found to be greater when the music was presented than the case where there was no music. Depending on the subject's preference, it was confirmed that favorite music showed greater brain activity than unfavorite music.

• Journal of Fisheries and Marine Sciences Education
• /
• v.12 no.2
• /
• pp.191-198
• /
• 2000

An experiment was carried out to obtain the fundamental data on the auditory thresholds of fishes for catching method using audible frequency sound, the auditory thresholds of dusky spinefoot Siganus fuscescens(Houttuyn) were measured in the presence of masking noise in the spectrum level range of 74 - 83dB re $1{\mu}Pa/{\sqrt{Hz}}$ by heartbeat conditioning technique using pure tones coupled with a delayed electric shock. The auditory critical ratios were about 23 - 34dB at measurement frequency range. The ratio increased almost linearly with increasing frequency from 200 to 500Hz. The noise spectrum level at the start of masking was about 61 - 73dB within the measurement frequency range. This suggests that hearing of dusky spinefoot is masked in the natural environment with the noise spectrum level above 70dB. The sound pressure level of which the signal sound of 100Hz is recognized by dusky spinefoot under the white noise of 70dB is above 98dB and the critical ratio of them is above 23dB.

• Proceedings of the KSMRM Conference
• /
• 2006.11a
• /
• pp.65-65
• /
• 2006

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.161-168
• /
• 2006

본 연구는 공간적 정보의 청각적 제시 가능성을 확인하기 위해 머리전달함수(head-related transfer function: HRTF)를 통해 생성된 3D 사운드를 가상공간상 대상 위치의 직각형태(orthogonal pattern), 혹은 대각형태(diagonal pattern)의 조합으로 배열하여 투시장치(See-Through HMD)로 증강현실을 경험하고 있는 사용자 과제수행의 정확성을 측정하였다. 본 연구에서 실시한 실험들의 결과를 종합하면, 3D 사운드로 대상의 위치 정보를 제시할 때는 사용자로부터의 방향은 직각으로 위치시키는 정보 배열이 정확성을 확보할 수 있고, 또한 가상적 깊이를 이용하여 정보를 배열하는 것도 그 깊이를 구분할 수 있으나 정확성이 떨어짐을 확인하였다. 특히 보다 현실적인 과제 상황에서의 수행을 비교하기 위해 일차과제(primary task)를 하는 동안 제시된 청각자극 조건에서 이런 정확성의 차이가 마찬가지로 나타났다. 이런 결과를 통해 3D 사운드로 대상의 위치와 같은 공간적 정보를 제시 가능한 최적의 배열 형태를 제안하는데, 이는 어떤 패턴으로 정보를 구조화하여 제시하느냐에 따라 청각적 위치 정보 제시의 성공 여부가 결정된다는 것을 의미한다.

• Korean Journal of Cognitive Science
• /
• v.20 no.2
• /
• pp.109-124
• /
• 2009

When visual and auditory information is presented simultaneously, we perceive visual information dominantly over auditory information. This effect is called the visual dominance effect. This study was to examine the influence of semantic congruence of visual and auditory information on the visual dominance effect. The semantic congruence of visual and auditory information was manipulated. The results showed that the visual dominance effect obtained in error rates was not modulated by semantic congruence, whereas the effect in RT was. It is suggested that this modulation of the influence of semantic congruence on the visual dominance effect would be due to the task type.

• Phonetics and Speech Sciences
• /
• v.13 no.1
• /
• pp.1-15
• /
• 2021

The present study investigated the mental representation and processing of an ambiguous word in the bimodal processing system by manipulating the lexical ambiguity of a visually or auditorily presented word. Homonyms (e.g., '물었다') with more than two meanings and control words (e.g., '고통을') with a single meaning were used in the experiments. The lemma frequency of words was manipulated while the relative frequency of multiple meanings of each homonym was balanced. In both experiments using the lexical decision task, a robust frequency effect and a critical interaction of word type by frequency were found. In Experiment 1, spoken homonyms yielded faster latencies relative to control words (i.e., ambiguity advantage) in the low frequency condition, while ambiguity disadvantage was found in the high frequency condition. A similar interactive pattern was found in visually presented homonyms in the subsequent Experiment 2. Taken together, the first key finding is that interdependent lexico-semantic processing can be found both in the visual and auditory processing system, which in turn suggests that semantic processing is not modality dependent, but rather takes place on the basis of general lexical knowledge. The second is that multiple semantic candidates provide facilitative feedback only when the lemma frequency of the word is relatively low.