• The Journal of the Korea Contents Association
• /
• v.15 no.10
• /
• pp.1-9
• /
• 2015

In this paper, a study on facial movements are analyzed in terms of opposite emotion stimuli by image processing of Kinect facial image. To induce two opposite emotion pairs such as "Sad - Excitement"and "Contentment - Angry" which are oppositely positioned onto Russell's 2D emotion model, both visual and auditory stimuli are given to subjects. Firstly, 31 main points are chosen among 121 facial feature points of active appearance model obtained from Kinect Face Tracking SDK. Then, pixel changes around 31 main points are analyzed. In here, local minimum shift matching method is used in order to solve a problem of non-linear facial movement. At results, right and left side facial movements were occurred in cases of "Sad" and "Excitement" emotions, respectively. Left side facial movement was comparatively more occurred in case of "Contentment" emotion. In contrast, both left and right side movements were occurred in case of "Angry" emotion.

• Journal of Biomedical Engineering Research
• /
• v.15 no.4
• /
• pp.383-388
• /
• 1994

Chaotic analysis of EEG signal responding to auditory stimulus with various carrier frequency and constant triggering frequency is given in this paper. The EEG signal is obtained from the digital 12channel EEG system made in our laboratory. The carrier frequency is varied from 1 kHz to 3 kHz by 0.5 kHz step. Chaos analysis such as pseudo phase space portrait, Lyapunov exponent, and so on is done on the auditory stimulated evoked potential. This result is found to be quite consistent with the well known results from the psychological perception theory.

• Science of Emotion and Sensibility
• /
• v.15 no.4
• /
• pp.441-452
• /
• 2012

Recently, various researches have been attempted to effectively display pseudo-aural senses to the hearing-impaired or the deaf, using vibro-tactile stimulus as well as visual sense. Particularly, it is reported that as complementary senses to support the visual sense, tactile senses displayed by either speakers or vibration motors improve the reality sense significantly but do not nearly improve the emotional sense. Thus, in this study, the thermal sense is selected as another complementary sense to support the pseudo-aural sense display and it is investigated whether the thermal sense could generate a pseudo-aural sense or not. For this purpose, a thermal display module which could effectively display the desired thermal sense is implemented. Then, experiments have been conducted to subjects, which provide them with various types of stimuli combined with the aural, the vibrotactile, and the thermal stimuli along with the visual information. It can be confirmed, through statistical analysis on the data collected from experiments, that subjects could feel a pseudo-thermal sense closer to the real thermal sense which the normal subject feel from both the visual and the aural information, particularly either i) with the thermal stimulus along with the visual information or ii) with both the thermal and the vibrotactile stimuli along with the visual information than only with the visual information. Conclusively, it can be confirmed that the thermal stimulus applied to the skin of the subjects could play a role of effectively displaying pseudo-aural sense related to the thermal sense, as an complementary media for the pseudo-aural display.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.6
• /
• pp.715-721
• /
• 2018

This study examined energy saving and elevating the worker's neuro energy (comfort, concentration, physical, and psychological stability) by compensating for the unpleasant tactile sensation to stimulate auditory and olfactory senses and reduce energy consumption. The experiment was conducted in an environment test room under the test conditions of temperature $25[^{\circ}C]$, relative humidity 50[RH%], illumination 1,000[lux] and air current speed 0.02[m/sec] by stimulating the auditory senses with a 1/f change in rhythm and the olfactory senses with an aroma scent. The experiment utilized the method of EEG, which evaluates human body's psychological status via tactile means, and the method of the vibra image, which evaluates the learning abilities, HRV and human body's psychological status via non-tactile means. The subjects were selected as eight university students (four males and four females) in their 20s, the type that have high relative ${\alpha}$(8~13[Hz]) activation in occipital lobe, which brings the highest level of mind stability and concentration, who had no difficulty in physical activities. The subjects' posture and physical activity was fixed to 1met - when the subjects are seated and relaxing in a comfortable environment - and their clothes condition was standardized as 0.7clo. As a result, the sentimental and psychological stability and concentration were the highest in the multisensory stimulation of jasmine scent and change rhythm of an a=1.106 sound source. In addition, under this condition, the relative $M{\alpha}$ and relative $M{\beta}$ increased by 70.49[%] and 89.72[%], respectively; the HRT decreased by 39.09[%]; and the fatigue and tension/anxiety decreased by 36.85[%] and 15.54[%], respectively.

• Journal of rehabilitation welfare engineering & assistive technology
• /
• v.8 no.2
• /
• pp.95-99
• /
• 2014

Binaural interaction can recognize the same intensity sound by stimulating two ears alternatively, and it can be record auditory brainstem responses (ABR). However, We needs to be researched about binaural interaction in asymmetric binaural acoustic stimulation. 17 normal young hearing university students were participated. Clicks were presented at the intensity of 90 dB nHL to one ear and the click intensity was increased from 0 to 90 dB nHL with a separation of 10 dB to another ear, simultaneous. BI waveform was obtained by subtracting the sum of the asymmetrically evoked potentials from the binaurally evoked potentials; i.e. BI = B - (L + R). Latency and amplitude was measured 'peak to following trough' of IV-V complex of BI waveform. Threshold of BIC (t-BIC) was obtained using amplitude depend on stimulus intensities (paired sample t-test). Latency shifted in 4.65, 4.63, 4.57, 4.58, 4.62, 4.6, 4.48, 4.36, 4.23 ms for peak, 5.57, 5.51, 5.51, 5.59, 5.61, 5.55, 5.44, 5.28, 5.19 ms for trough, and amplitude shifted in .0.32, -0.3, -0.34, -0.32, -0.42, -0.53, -0.54, -0.61, $-0.67{\mu}V$ from 0 to 90 dB nHL in every 10 dB, respectively. t-BIC was observed 40 dB nHL(p=.001).

• Science of Emotion and Sensibility
• /
• v.14 no.4
• /
• pp.537-544
• /
• 2011

Tactile acuity was assessed in groups of control, blind, deaf, and blind caused by complication to investigate the effective tactile stimuli on tactile sensory substitution studies when tactile display is applied to persons with sensory loss of vision or hearing. Two-point discrimination and grating resolution were assessed by compass and JVP dome, respectively, in the hand, arm, neck, lumbar, and knee. In two-point discrimination by compass, control group showed the highest sensitivity in fingers among assessed body areas but did not show any significant difference between male and female. Blind group and deaf group compared to control group did not show any significant difference in fingers but showed lower sensitivity in arm and knee. In grating resolution by JVP dome, control group did not show any significant difference among five fingers as well as between male and female. Blind group showed higher sensitivity in five fingers compared to control group, but deaf group did not show any significant difference from control group. Blind caused by complication group showed lower sensitivity in two-point discrimination and grating resolution compared to control group and blind group. These results suggest that the body area and method of tactile stimulation, and difference in tactile acuity depending on underlying disease of sensory loss should be considered when tactile display is applied for sensory substitution.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.47 no.1
• /
• pp.60-68
• /
• 2010

In case of sensorineural hearing loss, auditory perception can be activated by electrical stimulation of the nervous system via electrode implanted into the cochlea or auditory nerve. Since the tonotopic map of the human auditory nerve has not been definitively identified, the recording of auditory nerve signal with microelectrode is desirable for determining the tonotopic map. This paper proposes the multi-channel analog front-end for auditory nerve signal detection. A channel of the proposed analog front-end consists of an AC coupling circuit, a low-power 4th-order Gm-C LPF, and a single-slope ADC. The AC coupling circuit transfers only AC signal while it blocks DC signal level. Considering the bandwidth of the auditory signal, the Gm-C LPF is designed with OTAs adopting floating-gate technique. For the channel-parallel ADC structure, the single-slope ADC is used because it occupies the small silicon area. Experimental results shows that the AC coupling circuit and LPF have the bandwidth of 100 Hz - 6.95 kHz and the ADC has the effective resolution of 7.7 bits. The power consumption per a channel is $12\;{\mu}W$, the power supply is 3.0 V, and the core area is $2.6\;mm\;{\times}\;3.7\;mm$. The proposed analog front-end was fabricated in a 1-poly 4-metal $0.35-{\mu}m$ CMOS process.

• The Journal of the Acoustical Society of Korea
• /
• v.41 no.1
• /
• pp.58-63
• /
• 2022

This study was conducted to examine the characteristics of pitch perception and temporal resolution through Within-/Cross-Channel Gap Detection Thresholds (WC/CC GDTs) using low-frequency pure tones (such as 264 Hz, 373 Hz and 528 Hz related to C4, C4#, and C5 musical tones. 40 young people and 20 elderly people with normal hearing participated in this study. The results of WC GDTs were approximately 2 ms ~ 4 ms threshold values regardless of frequencies in two groups. There was no statistically significant difference in WC GDTs between groups. In both groups, CC GDTs were larger than WC GDTs, and as the frequency difference increased, the CC GDTs also increased. In particular, in the comparison between groups of CC GDTs, the results of the elderly group were 8 times ~ 10 times larger than that of the young group, and there was a statistically significant difference between the groups. These data also showed a different trend of GDTs in comparison with the previous data obtained from musical stimuli.This study suggests that GDTs may influence pitch perception mechanisms and can be used as psychoacoustic evidence for nonlinear responses of auditory nervous system.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.38C no.12
• /
• pp.1150-1158
• /
• 2013

Artificial cochlear implant system is known as the most efficient and widespread device to patients who have cochlear disorder. However, current commercialized artificial cochleas have inconveniences because of large volume size and high power consumption, requiring further research on improvements in terms of the size, power, and performance. In this paper, we will introduce our fully implantable artificial cochlear implant system, where small-size sensors and actuators are wirelessly connected, focusing on communication system design and its performance simulation.

• Journal of Korea Game Society
• /
• v.4 no.2
• /
• pp.21-28
• /
• 2004

Experience of human is more impressive when it is combined with physical interaction which provides multi-dimensional information including touching on body sense systems as well as seeing and hearing. In the Held of games, concentrations and satisfactions obtained from playing games are more effective when feedbacks come totally on whole body sense systems. In this paper, we have studied physical interactive systems with analysis on traditional physical interactive systems in on-line game area which normally were depending on seeing and hearing senses.