• Title/Summary/Keyword: Multi modal signal

Search Result 35, Processing Time 0.022 seconds

Reduced wavelet component energy-based approach for damage detection of jacket type offshore platform

  • Shahverdi, Sajad;Lotfollahi-Yaghin, Mohammad Ali;Asgarian, Behrouz
    • Smart Structures and Systems
    • /
    • v.11 no.6
    • /
    • pp.589-604
    • /
    • 2013
  • Identification of damage has become an evolving area of research over the last few decades with increasing the need of online health monitoring of the large structures. The visual damage detection can be impractical, expensive and ineffective in case of large structures, e.g., offshore platforms, offshore pipelines, multi-storied buildings and bridges. Damage in a system causes a change in the dynamic properties of the system. The structural damage is typically a local phenomenon, which tends to be captured by higher frequency signals. Most of vibration-based damage detection methods require modal properties that are obtained from measured signals through the system identification techniques. However, the modal properties such as natural frequencies and mode shapes are not such good sensitive indication of structural damage. Identification of damaged jacket type offshore platform members, based on wavelet packet transform is presented in this paper. The jacket platform is excited by simple wave load. Response of actual jacket needs to be measured. Dynamic signals are measured by finite element analysis result. It is assumed that this is actual response of the platform measured in the field. The dynamic signals first decomposed into wavelet packet components. Then eliminating some of the component signals (eliminate approximation component of wavelet packet decomposition), component energies of remained signal (detail components) are calculated and used for damage assessment. This method is called Detail Signal Energy Rate Index (DSERI). The results show that reduced wavelet packet component energies are good candidate indices which are sensitive to structural damage. These component energies can be used for damage assessment including identifying damage occurrence and are applicable for finding damages' location.

Emotion Recognition and Expression System of User using Multi-Modal Sensor Fusion Algorithm (다중 센서 융합 알고리즘을 이용한 사용자의 감정 인식 및 표현 시스템)

  • Yeom, Hong-Gi;Joo, Jong-Tae;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.1
    • /
    • pp.20-26
    • /
    • 2008
  • As they have more and more intelligence robots or computers these days, so the interaction between intelligence robot(computer) - human is getting more and more important also the emotion recognition and expression are indispensable for interaction between intelligence robot(computer) - human. In this paper, firstly we extract emotional features at speech signal and facial image. Secondly we apply both BL(Bayesian Learning) and PCA(Principal Component Analysis), lastly we classify five emotions patterns(normal, happy, anger, surprise and sad) also, we experiment with decision fusion and feature fusion to enhance emotion recognition rate. The decision fusion method experiment on emotion recognition that result values of each recognition system apply Fuzzy membership function and the feature fusion method selects superior features through SFS(Sequential Forward Selection) method and superior features are applied to Neural Networks based on MLP(Multi Layer Perceptron) for classifying five emotions patterns. and recognized result apply to 2D facial shape for express emotion.

A Survey of Objective Measurement of Fatigue Caused by Visual Stimuli (시각자극에 의한 피로도의 객관적 측정을 위한 연구 조사)

  • Kim, Young-Joo;Lee, Eui-Chul;Whang, Min-Cheol;Park, Kang-Ryoung
    • Journal of the Ergonomics Society of Korea
    • /
    • v.30 no.1
    • /
    • pp.195-202
    • /
    • 2011
  • Objective: The aim of this study is to investigate and review the previous researches about objective measuring fatigue caused by visual stimuli. Also, we analyze possibility of alternative visual fatigue measurement methods using facial expression recognition and gesture recognition. Background: In most previous researches, visual fatigue is commonly measured by survey or interview based subjective method. However, the subjective evaluation methods can be affected by individual feeling's variation or other kinds of stimuli. To solve these problems, signal and image processing based visual fatigue measurement methods have been widely researched. Method: To analyze the signal and image processing based methods, we categorized previous works into three groups such as bio-signal, brainwave, and eye image based methods. Also, the possibility of adopting facial expression or gesture recognition to measure visual fatigue is analyzed. Results: Bio-signal and brainwave based methods have problems because they can be degraded by not only visual stimuli but also the other kinds of external stimuli caused by other sense organs. In eye image based methods, using only single feature such as blink frequency or pupil size also has problem because the single feature can be easily degraded by other kinds of emotions. Conclusion: Multi-modal measurement method is required by fusing several features which are extracted from the bio-signal and image. Also, alternative method using facial expression or gesture recognition can be considered. Application: The objective visual fatigue measurement method can be applied into the fields of quantitative and comparative measurement of visual fatigue of next generation display devices in terms of human factor.

Prototype of Emotion Recognition System for Treatment of Autistic Spectrum Disorder (자폐증 치료를 위한 감성인지 시스템 프로토타입)

  • Chung, Seong Youb
    • Journal of Institute of Convergence Technology
    • /
    • v.1 no.2
    • /
    • pp.1-5
    • /
    • 2011
  • It is known that as many as 15-20 in 10,000 children are diagnosed with autistic spectrum disorder. A framework of the treatment system for children with autism using affective computing technologies was proposed by Chung and Yoon. In this paper, a prototype for the framework is proposed. It consists of emotion stimulating module, multi-modal bio-signal sensing module, treatment module using virtual reality, and emotion recognition module. Primitive experiments on emotion recognition show the usefulness of the proposed system.

  • PDF

An Emotion Recognition and Expression Method using Facial Image and Speech Signal (음성 신호와 얼굴 표정을 이용한 감정인식 몇 표현 기법)

  • Ju, Jong-Tae;Mun, Byeong-Hyeon;Seo, Sang-Uk;Jang, In-Hun;Sim, Gwi-Bo
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2007.04a
    • /
    • pp.333-336
    • /
    • 2007
  • 본 논문에서는 감정인식 분야에서 가장 많이 사용되어지는 음성신호와 얼굴영상을 가지고 4개의(기쁨, 슬픔, 화남, 놀람) 감정으로 인식하고 각각 얻어진 감정인식 결과를 Multi modal 기법을 이용해서 이들의 감정을 융합한다. 이를 위해 얼굴영상을 이용한 감정인식에서는 주성분 분석(Principal Component Analysis)법을 이용해 특징벡터를 추출하고, 음성신호는 언어적 특성을 배재한 acoustic feature를 사용하였으며 이와 같이 추출된 특징들을 각각 신경망에 적용시켜 감정별로 패턴을 분류하였고, 인식된 결과는 감정표현 시스템에 작용하여 감정을 표현하였다.

  • PDF

Automated data interpretation for practical bridge identification

  • Zhang, J.;Moon, F.L.;Sato, T.
    • Structural Engineering and Mechanics
    • /
    • v.46 no.3
    • /
    • pp.433-445
    • /
    • 2013
  • Vibration-based structural identification has become an important tool for structural health monitoring and safety evaluation. However, various kinds of uncertainties (e.g., observation noise) involved in the field test data obstruct automation system identification for accurate and fast structural safety evaluation. A practical way including a data preprocessing procedure and a vector backward auto-regressive (VBAR) method has been investigated for practical bridge identification. The data preprocessing procedure serves to improve the data quality, which consists of multi-level uncertainty mitigation techniques. The VBAR method provides a determinative way to automatically distinguish structural modes from extraneous modes arising from uncertainty. Ambient test data of a cantilever beam is investigated to demonstrate how the proposed method automatically interprets vibration data for structural modal estimation. Especially, structural identification of a truss bridge using field test data is also performed to study the effectiveness of the proposed method for real bridge identification.

UWB Radar and Non-contact Polysomnography (UWB 레이더와 비접촉 수면다원검사)

  • Byun, Sang-Seon
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.10 no.1
    • /
    • pp.33-40
    • /
    • 2015
  • The number of people who are suffering from chronic sleep disorder has been growing dramatically in modern era. In order to diagonse the sleep disorder, sleep doctors perform polysomnography: Patients sleep with attaching several vital sign sensors on their body, and doctors monitor the patients in order to find the exact reason of the sleep disorder. Typical polysmonography makes patients sleep with several sensors on their bodies, which prevents the patients from making a comfortable sleep. Furthermore, it is impossible to have a long-term monitoring since the measurements should be done in sleep hosiptal within a few hours. In order to tackle these problems in the typical polysomnography, we envision the development of a non-contact long-term home polysomnography system using UWB radar and related technologies such as multi-modal signal processing.

Characteristics of Corrective Saccadic Eye Movement with E.O.G. (E.O.G.를 이용한 Corrective Saccadic 안구운동 특성)

  • 김윤수;박상희
    • Journal of Biomedical Engineering Research
    • /
    • v.2 no.1
    • /
    • pp.21-30
    • /
    • 1981
  • In this study, measuring eye movements with E.O.G. to targets beyond 20$^{\circ}$ from fixation point, results are as follows. (1) When the eyes turn toward targets of more than 20$^{\circ}$ eccentricity, the first saccadic eye movement falls short of the target. The presence of image of the target off the fovea(visual error signal) subsequent to such an undershoot elicits, after short interval, corrective saccadic eye movements(usually one) which place the image of the target on the fovea. (2) There are different programming modes at retina for eye movement to targets within and beyond 20$^{\circ}$ from the fixation point. (3) Saccadic system, preparing the direction and amplitude of eye movement completes the corrective saccadic eye movements. (4) Distribution of latency and intersaccadic interval(I.S.I.)are frequently multi modal, with a seperation between modes of 25[msec]. (5) There are two types of saccadic eye movements for the double-step targets. This fact suggests that the visual information is sampled stochastically. (6) The new model of saccadic system including the dissociation of visual functions dependent on retinal eccentricity is required.

  • PDF

Damage detection for a beam under transient excitation via three different algorithms

  • Zhao, Ying;Noori, Mohammad;Altabey, Wael A.
    • Structural Engineering and Mechanics
    • /
    • v.64 no.6
    • /
    • pp.803-817
    • /
    • 2017
  • Structural health monitoring has increasingly been a focus within the civil engineering research community over the last few decades. With increasing application of sensor networks in large structures and infrastructure systems, effective use and development of robust algorithms to analyze large volumes of data and to extract the desired features has become a challenging problem. In this paper, we grasp some precautions and key points of the signal processing approach, wavelet, establish a relative reliable framework, and analyze three problems that require attention when applying wavelet based damage detection approach. The cases studies how to use optimal scales for extracting mode shapes and modal curvatures in a reinforced concrete beam and how to effectively identify damages using maximum curves of wavelet coefficient differences. Moreover, how to make a recognition based on the wavelet multi-resolution analysis, wavelet packet energy, and fuzzy sets is a meaningful topic that has been addressed in this work. The relative systematic work that compasses algorithms, structures and evaluation paves a way to a framework regarding effective structural health monitoring, orientation, decision and action.

Flexible smart sensor framework for autonomous structural health monitoring

  • Rice, Jennifer A.;Mechitov, Kirill;Sim, Sung-Han;Nagayama, Tomonori;Jang, Shinae;Kim, Robin;Spencer, Billie F. Jr.;Agha, Gul;Fujino, Yozo
    • Smart Structures and Systems
    • /
    • v.6 no.5_6
    • /
    • pp.423-438
    • /
    • 2010
  • Wireless smart sensors enable new approaches to improve structural health monitoring (SHM) practices through the use of distributed data processing. Such an approach is scalable to the large number of sensor nodes required for high-fidelity modal analysis and damage detection. While much of the technology associated with smart sensors has been available for nearly a decade, there have been limited numbers of fulls-cale implementations due to the lack of critical hardware and software elements. This research develops a flexible wireless smart sensor framework for full-scale, autonomous SHM that integrates the necessary software and hardware while addressing key implementation requirements. The Imote2 smart sensor platform is employed, providing the computation and communication resources that support demanding sensor network applications such as SHM of civil infrastructure. A multi-metric Imote2 sensor board with onboard signal processing specifically designed for SHM applications has been designed and validated. The framework software is based on a service-oriented architecture that is modular, reusable and extensible, thus allowing engineers to more readily realize the potential of smart sensor technology. Flexible network management software combines a sleep/wake cycle for enhanced power efficiency with threshold detection for triggering network wide operations such as synchronized sensing or decentralized modal analysis. The framework developed in this research has been validated on a full-scale a cable-stayed bridge in South Korea.