• Proceedings of the KOSOMBE Conference
• /
• v.1993 no.11
• /
• pp.175-179
• /
• 1993

A Study on the speech processing and coding strategy for cochlear implants have been developed to create a speech signal processing system which extracts stimulus parameter including formants, pitch, amplitude information. In this study we have presented the method which extracts characteristic information of speech signal and adapt patients with hearing handicap.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.11a
• /
• pp.842-844
• /
• 2022

각종 유해조수로에 의한 피해가 농가에서 발생하고 있다. 이를 해결하기 위해 기존에 Drone을 이용한 유해조수 퇴치연구가 있엇지만 시간의 제약과 법적인 규제로부터 발생되는 문제점이 발견되어 이를 해결하기 위해 Drone을 Caterpillar 구동형 모바일 로봇으로 대체하였고, 자율주행 기능을 추가하였다. 텐서플로우 객체 검출 딥러닝을 적용하여 유해조수를 학습 및 파악한다. 이 후 유해조수 인식 시 사용자에게 실시간 알림 서비스 및 실시간 스트리밍을 제공하고, 유해조수 퇴치 로봇에 장착된 스피커와 Neo Pixel LED을 이용하여 유해조수의 시각과 청각을 자극하여 퇴치한다. ROS, SLAM과 Object Following을 이용하여 자율주행 로봇을 제어하고 객체를 추적한다.

• Science of Emotion and Sensibility
• /
• v.14 no.4
• /
• pp.503-512
• /
• 2011

Recently in HCI research, emotion recognition is one of the core processes to implement emotional intelligence. There are many studies using bio signals in order to recognize human emotions, but it has been done merely for the basic emotions and very few exists for the other emotions. The purpose of present study is to confirm the difference of autonomic nervous system (ANS) response in three emotions (boredom, pain, and surprise). There were totally 217 of participants (male 96, female 121), we presented audio-visual stimulus to induce boredom and surprise, and pressure by using the sphygmomanometer for pain. During presented emotional stimuli, we measured electrodermal activity (EDA), skin temperature (SKT), electrocardiac activity (ECG) and photoplethysmography (PPG), besides; we required them to classify their present emotion and its intensity according to the emotion assessment scale. As the results of emotional stimulus evaluation, emotional stimulus which we used was shown to mean 92.5% of relevance and 5.43 of efficiency; this inferred that each emotional stimulus caused its own emotion quite effectively. When we analyzed the results of the ANS response which had been measured, we ascertained the significant difference between the baseline and emotional state on skin conductance response, SKT, heart rate, low frequency and blood volume pulse amplitude. In addition, the ANS response caused by each emotion had significant differences among the emotions. These results can probably be able to use to extend the emotion theory and develop the algorithm in recognition of three kinds of emotions (boredom, surprise, and pain) by response measurement indicators and be used to make applications for differentiating various human emotions in computer system.

• Journal of Music and Human Behavior
• /
• v.11 no.1
• /
• pp.1-19
• /
• 2014

The purpose of this study was to investigate the immediate effect of Patterned Sensory Enhancement (PSE) technique on the motor function of the affected upper limb in hemiplegic stroke patients by comparing the use of PSE and simple rhythmic cue. A total of 16 stroke patients were recruited from rehabilitative hospitals. The participants were assigned to the experimental group (n = 8) and control group (n = 8). While performing six different upper limb motions, musical stimuli applying the PSE technique was presented for the experimental group and simple rhythmic cue using the metronome was applied for the control group. The results showed that while the significantly increased range of motion (ROM) was found in the experimental group with the immediate use of PSE (p < .05), the control group did not show no significant change. This study implies that the use of musical elements in cueing for upper limb motion immediately leads to significant improvement in ROM by providing sufficient temporal, spatial, and dynamic information for expected motor performance.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.130-134
• /
• 2008

Touch screen phone which is expected to play a big part of the mobile market for the next few years, has many merits but demerits of inaccurate feedback. It offers audio and tactile feedback to strengthen the weak point. This study aims to see if audio feedback and vibration feedback react upon each other under realistic conditions. We had a qualitative research in perception after using touch screen phone feedback. The result showed that with any feedback users were satisfied more than without any feedback and there was diversity in response. We ran the study again to see the performance level and the projective workload between the kind of feedback and interrupting feedback environment Performance rates were faster with audio feedback and according to the projective workload assessment users felt that task was easier and less annoying with audio-vibration feedback. The results suggest that audio feedback could be more effective than vibration feedback. A future study will figure out the relationship between the factors of qualitative-controlled feedback and learning time and the performance, and the main cause to make people prefer one feedback over another in a realistic world.

• The Journal of the Korea Contents Association
• /
• v.17 no.10
• /
• pp.624-635
• /
• 2017

A variety of methods are used in public advertising to make message persuasive. In order for posters to be more appealing, one good way is to use synesthesia. This study analyzed how synesthesia were used for effective communication. The case analysis is based on the prize winning advertisements chosen by the Korea Broadcast Advertising Corporation. According to the study, synesthesia maximize the efficiency of information delivery. Secondly, in the public campaign posters, sight was the most frequently used sensory element, followed by touch, hearing, smell and taste, respectively. Third, visual tactility was mostly used in nature and environment related posters to effectively deliver the messages. In the topic of social community campaigning, visualization of hearing was applied the most. Lastly, when more than three multisensory stimulations were present in the public campaign, the strongest sense stimulus played the largest part in making message delivery more efficient. The results of this study are expected to provide a scientific basis for future campaign posters that synesthesia expression elements are applied.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.881-886
• /
• 2007

This study was to develope a vibrotactile display system using windows media player from digital audio signal. WMPlayer10SDK system which was plug-in tool by microsoft windows media player provided its video and audio signal information. The audio signal was tried to be change into vibrotactile display. Audio signal had 4 sections such as 8bit, 16bit, 24bit, and 32bit. Each section was computed its frequency and vibrato scale. And data was transferred to 38400bps network port(COM1) for vibration. Using this system was able to develop the music suit which presented tactile feeling of music beyond sound. Therefore, it may provide cross modal technology for fusion technology of human senses.

• Investigative Magnetic Resonance Imaging
• /
• v.10 no.1
• /
• pp.26-31
• /
• 2006

Purpose : To evaluate the effect of global scaling analysis on brain activation for sensory and motor functional MR imaging study. Materials and methods : Four normal subjects without abnormal neurological history were included. Arm extension-flexion movement was used for motor function and 1KHz pure tone stimulation was used for auditory function. Functional magnetic resonance imaging was performed at 3T MRI (GE, Milwaukee, USA) using BOLD-EPI technique and SPM2 was employed for data analysis. On data analysis, the brain activation images were obtained with and without global scaling by fixing other parameters such as motion correction and realignment. Results : The difference in brain activation between no scaling and global scaling was not large in case of right upper extremity movement (p<0.000001). For auditory test, brain activation with global scaling showed larger activation than that of without global scaling (p<0.05). Conclusion : A caution must be taken into account when analyzing functional imaging data with global scaling especially for functional study of small local BOLD signal change.

• Journal of Broadcast Engineering
• /
• v.23 no.6
• /
• pp.914-924
• /
• 2018

In this paper, we implement an Android application for infant language education using marker-based augmented reality. Combining animal word markers (noun), size/color word markers (adjective), and action word markers (verb) in puzzle form to make a simple sentence, the application shows virtual contents related to the content of the sentence. For example, when an animal marker is showed up on a camera, the corresponding animal appears. Additionally, when the motion markers are combined, the animal's appearance changes into an animation in which it acts. When a user touched a marker, user can hear the sound of the word, which gives an auditory effect, and by adding the rotation function, user can see the animation in any direction. Our goal is to increase infants' interest in learning language and also increase the effectiveness of education on the meaning of words and the structure of simple sentences, by encouraging them to actively participate in language learning through visual and auditory stimuli.

• Korean Journal of Cognitive Science
• /
• v.20 no.4
• /
• pp.481-506
• /
• 2009

The purpose of the present research was to examine whether the attention mechanism employs physical or represented location of the cue and target. To achieve this, we have employed the paradigm of facilitation of response as well as inhibition of return. In the experiments, valid and invalid conditions were defined by the position consistency of the cue and the target in the aspect of either physical or represented location. We used auditory cue and visual target in Experiment 1 while visual cue and auditory target in Experiment 2. As a results, in Experiment 1, effect of facilitation of response in valid condition was found when the valid/invalid conditions were defined in the aspect of represented location. In Experiment 2, effect of facilitation of response in valid condition was found when the valid/invalid conditions were defined in the aspect of represented location. In all the other conditions, no effect was found when the conditions were defined in the aspect of physical location. No effects of inhibition of return were found in Experiment 2. These results imply the possibility that attention mechanism operates based on objects' represented location rather than on their physical location. More importantly, the present research suggests that it is necessary to separate represented location from physical location of the target and the cue in the experiment of facilitation of response and inhibition of return in the future.