• Title/Summary/Keyword: 복합모달

Search Result 46, Processing Time 0.028 seconds

Multimodal Brain Image Registration based on Surface Distance and Surface Curvature Optimization (표면거리 및 표면곡률 최적화 기반 다중모달리티 뇌영상 정합)

  • Park Ji-Young;Choi Yoo-Joo;Kim Min-Jeong;Tae Woo-Suk;Hong Seung-Bong;Kim Myoung-Hee
    • The KIPS Transactions:PartA
    • /
    • v.11A no.5
    • /
    • pp.391-400
    • /
    • 2004
  • Within multimodal medical image registration techniques, which correlate different images and Provide integrated information, surface registration methods generally minimize the surface distance between two modalities. However, the features of two modalities acquired from one subject are similar. So, it can improve the accuracy of registration result to match two images based on optimization of both surface distance and shape feature. This research proposes a registration method which optimizes surface distance and surface curvature of two brain modalities. The registration process has two steps. First, surface information is extracted from the reference images and the test images. Next, the optimization process is performed. In the former step, the surface boundaries of regions of interest are extracted from the two modalities. And for the boundary of reference volume image, distance map and curvature map are generated. In the optimization step, a transformation minimizing both surface distance and surface curvature difference is determined by a cost function referring to the distance map and curvature map. The applying of the result transformation makes test volume be registered to reference volume. The suggested cost function makes possible a more robust and accurate registration result than that of the cost function using the surface distance only. Also, this research provides an efficient means for image analysis through volume visualization of the registration result.

Multi - Modal Interface Design for Non - Touch Gesture Based 3D Sculpting Task (비접촉식 제스처 기반 3D 조형 태스크를 위한 다중 모달리티 인터페이스 디자인 연구)

  • Son, Minji;Yoo, Seung Hun
    • Design Convergence Study
    • /
    • v.16 no.5
    • /
    • pp.177-190
    • /
    • 2017
  • This research aims to suggest a multimodal non-touch gesture interface design to improve the usability of 3D sculpting task. The task and procedure of design sculpting of users were analyzed across multiple circumstances from the physical sculpting to computer software. The optimal body posture, design process, work environment, gesture-task relationship, the combination of natural hand gesture and arm movement of designers were defined. The preliminary non-touch 3D S/W were also observed and natural gesture interaction, visual metaphor of UI and affordance for behavior guide were also designed. The prototype of gesture based 3D sculpting system were developed for validation of intuitiveness and learnability in comparison to the current S/W. The suggested gestures were proved with higher performance as a result in terms of understandability, memorability and error rate. Result of the research showed that the gesture interface design for productivity system should reflect the natural experience of users in previous work domain and provide appropriate visual - behavioral metaphor.

Multi-Emotion Regression Model for Recognizing Inherent Emotions in Speech Data (음성 데이터의 내재된 감정인식을 위한 다중 감정 회귀 모델)

  • Moung Ho Yi;Myung Jin Lim;Ju Hyun Shin
    • Smart Media Journal
    • /
    • v.12 no.9
    • /
    • pp.81-88
    • /
    • 2023
  • Recently, communication through online is increasing due to the spread of non-face-to-face services due to COVID-19. In non-face-to-face situations, the other person's opinions and emotions are recognized through modalities such as text, speech, and images. Currently, research on multimodal emotion recognition that combines various modalities is actively underway. Among them, emotion recognition using speech data is attracting attention as a means of understanding emotions through sound and language information, but most of the time, emotions are recognized using a single speech feature value. However, because a variety of emotions exist in a complex manner in a conversation, a method for recognizing multiple emotions is needed. Therefore, in this paper, we propose a multi-emotion regression model that extracts feature vectors after preprocessing speech data to recognize complex, inherent emotions and takes into account the passage of time.

Simulation of Low Velocity Impact of Honeycomb Sandwich Composite Panels for the BIMODAL Tram Application (바이모달 트램 적용 하니컴 샌드위치 복합재 패널의 저속 충격 해석)

  • Lee, Jae-Youl;Jeong, Jong-Cheol;Shin, Kwang-Bok
    • Composites Research
    • /
    • v.20 no.4
    • /
    • pp.42-50
    • /
    • 2007
  • This paper describes the results of experiments and numerical simulation studies on the low-velocity impact damage of two different sandwich composite panels for application to bodyshell and floor structure of the BIMODAL tram vehicle. Square test samples of 100mm sides were subjected to low-velocity impact loading using an instrumented testing machine at four impact energy levels. Part of this work presented is focused on the finite element analysis of low-velocity impact response onto a sandwich composite panels. It is based on the application of explicit finite element (FE) analysis codes LS-DYNA 3D to study the impact response of sandwich structures under low-velocity impact conditions. Material testing was conducted to determine the input parameters for the metallic and composite material model, and the effective equivalent damage model for the orthotropic honeycomb materials. Numerical and experimental results showed a good agreement for damage area and the depth of indentation of sandwich composite panels created by the impact loading.

Multimodality Image Registration by Optimization of Mutual Information (상호정보 최적화를 통한 다중 모달리티 영상정합)

  • 홍헬렌;김명희
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 2000.11a
    • /
    • pp.180-185
    • /
    • 2000
  • 방사선 치료계획이나 사전수술계획 등에 컴퓨터 사용이 늘어남에 따라 의료영상별 특성에 따른 복합적 처리를 필요로 한다. 본 논문에서는 다중 모달리티 영상으로부터 의미 있는 정보를 제공하기 위하여 상호정보 최적화를 통한 영상정합 방법을 제안한다. 본 방법은 두 영상에서 대응되는 위치의 명암도간 통계적 의존관계와 정보중복성을 계산하는 상호정보(mutual information)를 통해 영상간 변형관계를 추정함으로써 영상을 정합한다. 실험결과로는 뇌 자기공명영상(MRI)과 컴퓨터단층촬영영상(CT)의 상호정보를 최적화하여 정합 결과를 제시한다. 본 방법은 기존 정합방법에서 사용하는 영상분할이나 특징점 추출 등의 전처리 과정 없이 영상 자체 정보를 기반으로 계산함으로써 정합의 정확도를 높일 수 있다.

  • PDF

Predicting User Personality Based on Dynamic Keyframes Using Video Stream Structure (비디오 스트림 구조를 활용한 동적 키프레임 기반 사용자 개성 예측)

  • Mira Lee;Simon S.Woo;Hyedong Jung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.11a
    • /
    • pp.601-604
    • /
    • 2023
  • 기술이 발전함에 따라 복합적인 모달리티 정보를 포함하는 멀티미디어 데이터의 수집이 용이해지면서, 사람의 성격 특성을 이해하고 이를 개인화된 에이전트에 적용하고자 하는 연구가 활발히 진행되고 있다. 본 논문에서는 비디오 스트림 구조를 활용하여 사용자 특성을 예측하기 위한 동적 키프레임 추출 방법을 제안한다. 비디오 데이터를 효과적으로 활용하기 위해서는 무작위로 선택한 프레임에서 특징을 추출하던 기존의 방법을 개선하여 영상 내 시간에 따른 정보와 변화량을 기반으로 중요한 프레임을 선택하는 방법이 필요하다. 본 논문에서는 제 3자가 평가한 Big-five 지표 값이 레이블링된 대표적인 데이터셋인 First Impressions V2 데이터셋을 사용하여 외면에서 발현되는 특징들을 기반으로 영상에서 등장하는 인물들의 성격 특성을 예측했다. 결론에서는 선택된 키프레임에서 멀티 모달리티 정보를 조합하여 성격 특성을 예측한 결과와 베이스라인 모델과의 성능을 비교한다.

Dynamic Property Evaluation of Four-Harness Satin Woven Glass/epoxy Composites for a Composite Bogie Frame (복합소재 대차프레임용 4매 주자직 유리섬유/에폭시 복합소재의 진동특성평가)

  • Kim, Il Kyeom;Kim, Jung Seok;Seo, Sung Il;Lee, Woo Geun
    • Journal of the Korean Society for Railway
    • /
    • v.16 no.1
    • /
    • pp.1-6
    • /
    • 2013
  • In this study, the natural frequency and damping ratio of a four-harness satin woven glass/epoxy composite material are evaluated by means of modal tests and a finite element analysis. To achieve this goal, glass/epoxy beam specimens with different lengths and thicknesses were manufactured via autoclave curing. In the test, the maximum damping ratio was found to occur at the lowest test frequency. As the test frequency increased, the damping ratio decreased exponentially to a critical value. After that value, the damping ratio increased gradually to the maximum test frequency.

Analysis of the Vibration Damping of a Single Lap Joint Beam with Partial Dampers (겹침이음부와 부분층댐퍼가 부착된 보의 진동감쇠해석)

  • 박정일;최낙삼
    • Composites Research
    • /
    • v.12 no.2
    • /
    • pp.26-35
    • /
    • 1999
  • This paper presents the vibration damping characteristic of a single lap joint beam with partial dampers analyzed using the model strain energy method and the harmonic response analysis which were based on a finite element model. The two finite element analysis methods exhibited very similar results of the resonant frequency and system loss factor which were comparable to those by the theoretical analysis. Effects of the location of partial dampers and elastic moduli and thickness of their layers on the system loss factor were studied. The damping effects due to changes of modules and loss factor of the viscoelastic layer in lap joint and partial dampers were also studied. Consequently, the geometrical and material conditions at maximizing the system loss factor were suggested.

  • PDF

Design of the emotion expression in multimodal conversation interaction of companion robot (컴패니언 로봇의 멀티 모달 대화 인터랙션에서의 감정 표현 디자인 연구)

  • Lee, Seul Bi;Yoo, Seung Hun
    • Design Convergence Study
    • /
    • v.16 no.6
    • /
    • pp.137-152
    • /
    • 2017
  • This research aims to develop the companion robot experience design for elderly in korea based on needs-function deploy matrix of robot and emotion expression research of robot in multimodal interaction. First, Elder users' main needs were categorized into 4 groups based on ethnographic research. Second, the functional elements and physical actuators of robot were mapped to user needs in function- needs deploy matrix. The final UX design prototype was implemented with a robot type that has a verbal non-touch multi modal interface with emotional facial expression based on Ekman's Facial Action Coding System (FACS). The proposed robot prototype was validated through a user test session to analyze the influence of the robot interaction on the cognition and emotion of users by Story Recall Test and face emotion analysis software; Emotion API when the robot changes facial expression corresponds to the emotion of the delivered information by the robot and when the robot initiated interaction cycle voluntarily. The group with emotional robot showed a relatively high recall rate in the delayed recall test and In the facial expression analysis, the facial expression and the interaction initiation of the robot affected on emotion and preference of the elderly participants.

Vibration Control of a Composite Plate with Piezoelectric Sensor and Actuator (압전센서와 액츄에이터를 이용한 복합재 평판의 진동제어)

  • 권대규;유기호;이성철
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.05a
    • /
    • pp.207-210
    • /
    • 2002
  • This paper is concerned with the experiments on the active vibration control of a plate with piezoceramic sensors and actuators. The natural frequencies of the composite plate featured by a piezo-film sensor and piezo-ceramic actuator are calculated by using the modal analysis method. Modal coordinates are introduced to obtain the state equations of the structural system. Six natural frequencies were considered in the modelling, because robust control theory which has inherent robustness to structured uncertainty is adopted to suppress the transients vibrations of a glass fiber reinforced(GFR) composite beam. A robust controller satisfying the nominal performance and robust performance is designed using robust theory based on the structured singular value. Simulations were carried out with the designed controller and effectiveness of the robust control strategy was verified by results.

  • PDF