• Journal of Korea Multimedia Society
• /
• v.23 no.2
• /
• pp.146-154
• /
• 2020

Negative emotion causes stress and lack of attention concentration. The classification of negative emotion is important to recognize risk factors. To classify emotion status, various methods such as questionnaires and interview are used and it could be changed by personal thinking. To solve the problem, we acquire multi modal bio-signals such as electrocardiogram (ECG), skin temperature (ST), galvanic skin response (GSR) and extract features. The neural network (NN), the deep neural network (DNN), and the deep belief network (DBN) is designed using the multi modal bio-signals to analyze emotion status. As a result, the DBN based on features extracted from ECG, ST and GSR shows the highest accuracy (93.8%). It is 5.7% higher than compared to the NN and 1.4% higher than compared to the DNN. It shows 12.2% higher accuracy than using only single bio-signal (GSR). The multi modal bio-signal acquisition and the deep learning classifier play an important role to classify emotion.

• Nuclear Engineering and Technology
• /
• v.55 no.10
• /
• pp.3844-3853
• /
• 2023

Although radiation and chemotherapy methods for cancer therapy have advanced significantly, surgical resection is still recommended for most cancers. Therefore, intraoperative imaging studies have emerged as a surgical tool for identifying tumor margins. Intraoperative imaging has been examined using conventional imaging devices, such as optical near-infrared probes, gamma probes, and ultrasound devices. However, each modality has its limitations, such as depth penetration and spatial resolution. To overcome these limitations, hybrid imaging modalities and tracer studies are being developed. In a previous study, a multi-modal laparoscope with silicon photo-multiplier (SiPM)-based gamma detection acquired a 1 s interval gamma image. However, improvements in the near-infrared fluorophore (NIRF) signal intensity and gamma image central defects are needed to further evaluate the usefulness of multi-modal systems. In this study, an attempt was made to change the NIRF image acquisition method and the SiPM-based gamma detector to improve the source detection ability and reduce the image acquisition time. The performance of the multi-modal system using a complementary metal oxide semiconductor and modified SiPM gamma detector was evaluated in a phantom test. In future studies, a multi-modal system will be further optimized for pilot preclinical studies.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.46 no.4
• /
• pp.76-81
• /
• 2009

We propose an effective emotion recognition algorithm based on the minimum classification error (MCE) incorporating multi-modal system The emotion recognition is performed based on a Gaussian mixture model (GMM) based on MCE method employing on log-likelihood. In particular, the reposed technique is based on the fusion of feature vectors based on voice signal and galvanic skin response (GSR) from the body sensor. The experimental results indicate that performance of the proposal approach based on MCE incorporating the multi-modal system outperforms the conventional approach.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2006.06a
• /
• pp.57-62
• /
• 2006

휴대용 단말기의 소형화 및 지능화와 더불어 차세대 PC 기반의 유비쿼터스 컴퓨팅에 대한 관심이 높아짐에 따라 최근에는 펜이나 음성 입력 멀티미디어 등 여러 가지 대화 모드를 구비한 멀티 모달 상호작용 (Multi-Modal Interaction MMI)에 대한 연구가 활발히 진행되고 있다. 따라서, 본 논문에서는 잡음 환경에서의 명확한 의사 전달 및 휴대용 단말기에서의 음성-제스처 통합 인식을 위한 인터페이스의 연구를 목적으로 Voice-XML과 Wearable Personal Station(WPS) 기반의 음성 및 내장형 수화 인식기를 통합한 멀티 모달 명령어 인식 시스템 (Multi-Modal Instruction Recognition System : MMIRS)을 제안하고 구현한다. 제안되어진 MMIRS는 한국 표준 수화 (The Korean Standard Sign Language : KSSL)에 상응하는 문장 및 단어 단위의 명령어 인식 모델에 대하여 음성뿐만 아니라 화자의 수화제스처 명령어를 함께 인식하고 사용함에 따라 잡음 환경에서도 규정된 명령어 모델에 대한 인식 성능의 향상을 기대할 수 있다. MMIRS의 인식 성능을 평가하기 위하여, 15인의 피험자가 62개의 문장형 인식 모델과 104개의 단어인식 모델에 대하여 음성과 수화 제스처를 연속적으로 표현하고, 이를 인식함에 있어 개별 명령어 인식기 및 MMIRS의 평균 인식율을 비교하고 분석하였으며 MMIRS는 문장형 명령어 인식모델에 대하여 잡음환경에서는 93.45%, 비잡음환경에서는 95.26%의 평균 인식율을 나타내었다.

• Composites Research
• /
• v.14 no.1
• /
• pp.39-46
• /
• 2001

Experimental studies on the adaptive multi-mode vibration control of composite beams have been performed using neuro-controller. Neuro-controllers require too much computational burden, which blocks wide real-time applications of neuro-controllers. Therefore, in this paper, an adaptive notch filter is proposed to separate a vibration signal into each modal vibration signal. Two neuro-controllers with fewer weights are connected to the corresponding modal signals to generate proper modal control forces. The vibration controls using the adaptive notch filter and neuro-controllers have been performed for two specimens. A and B, which have different natural frequencies because of different positions of tip masses. Significant vibration reduction has been observed in both cases. The vibration control results show that the present neuro-controller has good adaptiveness under the system parameter variations.

• Science of Emotion and Sensibility
• /
• v.14 no.4
• /
• pp.627-636
• /
• 2011

The purpose of this study is to develop the multi-modal interaction system. This system provides realistic and an immersive experience through multi-modal interaction. The system recognizes user behavior, intention, and attention, which overcomes the limitations of uni-modal interaction. The multi-modal interaction system is based upon gesture interaction methods, intuitive gesture interaction and attention evaluation technology. The gesture interaction methods were based on the sensors that were selected to analyze the accuracy of the 3-D gesture recognition technology using meta-analysis. The elements of intuitive gesture interaction were reflected through the results of experiments. The attention evaluation technology was developed by the physiological signal analysis. This system is divided into 3 modules; a motion cognitive system, an eye gaze detecting system, and a bio-reaction sensing system. The first module is the motion cognitive system which uses the accelerator sensor and flexible sensors to recognize hand and finger movements of the user. The second module is an eye gaze detecting system that detects pupil movements and reactions. The final module consists of a bio-reaction sensing system or attention evaluating system which tracks cardiovascular and skin temperature reactions. This study will be used for the development of realistic digital entertainment technology.

• Wind and Structures
• /
• v.37 no.6
• /
• pp.445-460
• /
• 2023

Accurate estimation of modal parameters (i.e., natural frequency, damping ratio) of tall buildings is of great importance to their structural design, structural health monitoring, vibration control, and state assessment. Based on the combination of variational mode decomposition, smoothed discrete energy separation algorithm-1, and Half-cycle energy operator (VMD-SH), this paper presents a method for structural modal parameter estimation. The variational mode decomposition is proved to be effective and reliable for decomposing the mixed-signal with low frequencies and damping ratios, and the validity of both smoothed discrete energy separation algorithm-1 and Half-cycle energy operator in the modal identification of a single modal system is verified. By incorporating these techniques, the VMD-SH method is able to accurately identify and extract the various modes present in a signal, providing improved insights into its underlying structure and behavior. Subsequently, a numerical study of a four-story frame structure is conducted using the Newmark-β method, and it is found that the relative errors of natural frequency and damping ratio estimated by the presented method are much smaller than those by traditional methods, validating the effectiveness and accuracy of the combined method for the modal identification of the multi-modal system. Furthermore, the presented method is employed to estimate modal parameters of a full-scale tall building utilizing acceleration responses. The identified results verify the applicability and accuracy of the presented VMD-SH method in field measurements. The study demonstrates the effectiveness and robustness of the proposed VMD-SH method in accurately estimating modal parameters of tall buildings from acceleration response data.

• Transactions of the Korean Society for Noise and Vibration Engineering
• /
• v.14 no.8
• /
• pp.757-766
• /
• 2004

This paper focuses on the formulation and validation of an automatic strategy to select the optimal location and direction of strain gauges for the measurement of the modal response. These locations and directions are important to render the strain measurements as robust as possible when a random mispositioning of the gauges and gauge failures are expected. The approach relies on the evaluation of the signal-to-noise ratios of the gauge measurements from strain data of finite element. The multi-step optimization strategy including genetic algorithm is used to find the strain gauge locations-directions that maximize the smallest modal strain signal-to-noise ratio in the absence of gauge failure or its expected value when gauge failure is possible. A flat Plate is used to prove the applicability of the proposed methodology and to demonstrate the effects of the essential parameters of the problem such as the mispositioning level, the probability of gauge failure, and the number of gauges.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.19 no.1
• /
• pp.34-39
• /
• 2009

As a subjective recognition effect, human's emotion has impulsive characteristic and it expresses intentions and needs unconsciously. These are pregnant with information of the context about the ubiquitous computing environment or intelligent robot systems users. Such indicators which can aware the user's emotion are facial image, voice signal, biological signal spectrum and so on. In this paper, we generate the each result of facial and voice emotion recognition by using facial image and voice for the increasing convenience and efficiency of the emotion recognition. Also, we extract the feature which is the best fit information based on image and sound to upgrade emotion recognition rate and implement Multi-Modal Emotion recognition system based on feature fusion. Eventually, we propose the possibility of the ubiquitous computing service reasoning method based on Bayesian Network and ubiquitous context scenario in the ubiquitous computing environment by using result of emotion recognition.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2002.05a
• /
• pp.441-447
• /
• 2002

KSR-III(Korea Sounding Rocket - III), which is being developed by Space Technology R&D Division of KARI(Korea Aerospace Research Institute) will be launched in late 2002. It is a three-stage, liquid propellant rocket which can reach 250 km altitude and will carry out observation of ozone layer and scientific experiments, such as microgravity experiment, and atmospheric measurement. KSR-III is believed to be an intermediate to the launch vehicle capable of carrying a satellite to its orbit. Space Test Department of KARI performed GVT(Ground Vibration Test) fer KSR-III EM at Rocket Test Building of KARI. GVT is very important for predicting the behavior of rocket in its operation, developing flight control program and performing aerodynamic analysis. This paper gives an introduction of rocket GVT configuration and information on test procedures, techniques and results of It. In this test. to simulate free-free condition, test object hung in the air laterally by 4 bungee cords specially devised. For the excitation of test object, pure random signal by two electromagnetic shakers was used and total 22 frequency response functions were achieved. Polyreference parameter estimation was performed to identify the modal parameters with MIMO(Multi-Input-Multi-Output) method. As the result of the test, low frequency mode shapes and modal parameters below 60Hz were identified