• The Journal of the Acoustical Society of Korea
• /
• v.21 no.2E
• /
• pp.98-104
• /
• 2002

The present study describes a combination method to recognize the human affective states such as anger, happiness, sadness, or surprise. For this, we extracted emotional features from voice signals and facial expressions, and then trained them to recognize emotional states using hidden Markov model (HMM) and neural network (NN). For voices, we used prosodic parameters such as pitch signals, energy, and their derivatives, which were then trained by HMM for recognition. For facial expressions, on the other hands, we used feature parameters extracted from thermal and visible images, and these feature parameters were then trained by NN for recognition. The recognition rates for the combined parameters obtained from voice and facial expressions showed better performance than any of two isolated sets of parameters. The simulation results were also compared with human questionnaire results.

• Proceedings of the KSME Conference
• /
• 2003.04a
• /
• pp.935-939
• /
• 2003

The emotion recognition is one of the most significant interface technologies which make the high level of human-machine communication possible. The central nervous system stimulated by emotional stimuli affects the autonomous nervous system like a heart, blood vessel, endocrine organs, and so on. Therefore bio-signals like HRV, ECG and EEG can reflect one' emotional state. This study investigates the correlation between emotional states and bio-signals to realize the emotion recognition. This study also covers classification of human emotional states, selection of the effective bio-signal and signal processing. The experimental results presented in this paper show possibility of the emotion recognition.

• Journal of the Korean Society of Industry Convergence
• /
• v.26 no.2_1
• /
• pp.225-230
• /
• 2023

This research addresses sound command based human tracking problems for autonomous cleaning mobile robot in a networked AI space. To solve the problem, the difference among the traveling times of the sound command to each of three microphones has been used to calculate the distance and orientation of the sound from the cleaning mobile robot, which carries the microphone array. The cross-correlation between two signals has been applied for detecting the time difference between two signals, which provides reliable and precise value of the time difference compared to the conventional methods. To generate the tracking direction to the sound command, fuzzy rules are applied and the results are used to control the cleaning mobile robot in a real-time. Finally the experiment results show that the proposed algorithm works well, even though the mobile robot knows little about the environment.

• Journal of Biomedical Engineering Research
• /
• v.27 no.3
• /
• pp.101-109
• /
• 2006

It has been known that there is strong relationship between human voices and the movements of the articulatory facial muscles. In this paper, we utilize this knowledge to implement an automatic speech recognition scheme which uses solely surface electromyogram (EMG) signals. The EMG signals were acquired from three articulatory facial muscles. Preliminary, 10 Korean digits were used as recognition variables. The various feature parameters including filter bank outputs, linear predictive coefficients and cepstrum coefficients were evaluated to find the appropriate parameters for EMG-based speech recognition. The sequence of the EMG signals for each word is modelled by a hidden Markov model (HMM) framework. A continuous word recognition approach was investigated in this work. Hence, the model for each word is obtained by concatenating the subword models and the embedded re-estimation techniques were employed in the training stage. The findings indicate that such a system may have a capacity to recognize speech signals with an accuracy of up to 90%, in case when mel-filter bank output was used as the feature parameters for recognition.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.5A
• /
• pp.440-446
• /
• 2010

Convergence of IT and BT is considered in many area, especially in medical care industry. The example of this trend is a capsule endoscope. But in a capsule endoscope, communication through human body has a few restrictions. At first, the transmit power should be limited not to have a bad effect on human organs and for the battery capacity. Second, the channel characteristic of human body has not been examined exactly. Third, general modulation / demodulation techniques which require a channel estimation cannot be used because of battery limit. There also may be a lot of interference signals because a capsule endoscope uses UWB bandwidth. In this paper, we introduce Chirp Spread Spectrum Differential Binary Phase Shift Keying(CSS-DBPSK) and propose Chirp Spread Spectrum On-Off Keying(CSS-OOK) which don't require a channel estimation and robust to interference signals. Using CSS-DBPSK or CSS-OOK, we can get 5 dB or 2~3 dB of Eb/N0 gain at 10-5 target BER. And if there are interference signals, those gains of CSS-DBPSK and CSS-OOK are increased.

• Transactions on Control, Automation and Systems Engineering
• /
• v.4 no.1
• /
• pp.49-55
• /
• 2002

A decrease in the birthrate and aging are progressing in Japan and several countries. In that society, it is important that physically weak persons such as elderly persons are able to take care of themselves. We have been developing exoskeletal robots for human (especially for physically weak persons) motion support. In this study, the controller controls the angular position and impedance of the exoskeltal robot system using multiple fuzzy-neuro controllers based on biological signals that reflect the human subject's intention. Skin surface electromyogram (EMG) signals and the generated wrist force by the human subject during the elbow motion have been used as input information of the controller. Since the activation level of working muscles tends to vary in accordance with the flexion angle of elbow, multiple fuzzy-neuro controllers are applied in the proposed method. The multiple fuzzy-neuro controllers are moderately switched in accordance with the elbow flexion angle. Because of the adaptation ability of the fuzzy-neuro controllers, the exoskeletal robot is flexible enough to deal with biological signal such as EMG. The experimental results show the effectiveness of the proposed controller.

• The Journal of the Acoustical Society of Korea
• /
• v.23 no.2E
• /
• pp.56-67
• /
• 2004

Despite abundant research outcomes of blind source separation (BSS) in many types of simulated environments, their performances are still not satisfactory to be applied to the real environments. The major obstacle may seem the finite filter length of the assumed mixing model and the nonlinear sensor noises. This paper presents a two-step speech enhancement method with multiple microphone inputs. The first step performs a frequency-domain BSS algorithm to produce multiple outputs without any prior knowledge of the mixed source signals. The second step further removes the remaining cross-channel interference by a spectral cancellation approach using a probabilistic source absence/presence detection technique. The desired primary source is detected every frame of the signal, and the secondary source is estimated in the power spectral domain using the other BSS output as a reference interfering source. Then the estimated secondary source is subtracted to reduce the cross-channel interference. Our experimental results show good separation enhancement performances on the real recordings of speech and music signals compared to the conventional BSS methods.

• Proceedings of the KOSOMBE Conference
• /
• v.1995 no.05
• /
• pp.160-163
• /
• 1995

An optimal EEG and artifact classifier is proposed using neural network operating characteristics. The neural network operating characteristics are two dimensional parametric representations of the right and false identification probabilities of the network classifier. Since the EEG and EP signals acquired from multi -channel electrodes placed on the head surface are often interfered by other relatively large physiological signals such as electromyogram (EMG) or electroculogram (EOG), the removal of the artifact-affected EEGs is one of the key elements in neuro-functional mapping. Conventionally this task has been carried out by human experts spending lots of examination time. Using the neural-network based classification, human expert's efforts and time can be substantially reduced. From experiments, the neural-network based classification performs as good as human experts: variation of decisions between the neural network and human expert appears even smaller than that between human experts.

• Journal of Electrical Engineering and Technology
• /
• v.10 no.1
• /
• pp.364-371
• /
• 2015

In this study, we developed a feasible structure of a textile-based inductive sensor using a machine embroidery method, and applied it to a non-contact type vital sign sensing device based on the principle of magnetic-induced conductivity. The mechanical heart activity signals acquired through the inductive sensor embroidered with conductive textile on fabric were compared with the Lead II ECG signals and with respiration signals, which were simultaneously measured in every case with five subjects. The analysis result showed that the locations of the R-peak in the ECG signal were highly associated with sharp peaks in the signals obtained through the textile-based inductive sensor (r=0.9681). Based on the results, we determined the feasibility of the developed textile-based inductive sensor as a measurement device for the heart rate and respiration characteristics.

• Journal of Digital Contents Society
• /
• v.19 no.4
• /
• pp.821-827
• /
• 2018

Affective computing has gained increasing interest in the recent years with the development of potential applications in Human computer interaction (HCI) and healthcare. Although momentous research has been done on human emotion recognition, however, in comparison to speech and facial expression less attention has been paid to physiological signals. In this paper, Electroencephalogram (EEG) signals from different brain regions were investigated using modified wavelet energy features. For minimization of redundancy and maximization of relevancy among features, mRMR algorithm was deployed significantly. EEG recordings of a publically available "DEAP" database have been used to classify four classes of emotions with Multi class Support Vector Machine. The proposed approach shows significant performance compared to existing algorithms.