• Title/Summary/Keyword: Multimodal environment

검색결과 73건 처리시간 0.026초

Interactive Shape Analysis of the Hippocampus in a Virtual Environment (가상 환경에서의 해마 모델에 대한 대화식 형상 분석☆)

  • Kim, Jeong-Sik;Choi, Soo-Mi
    • Journal of Internet Computing and Services
    • /
    • 제10권5호
    • /
    • pp.165-181
    • /
    • 2009
  • This paper presents an effective representation scheme for the shape analysis of the hippocampal structure and a stereoscopic-haptic environment to enhance sense of realism. The parametric model and the 3D skeleton represent various types of hippocampal shapes and they are stored in the Octree data structure. So they can be used for the interactive shape analysis. And the 3D skeleton-based pose normalization allows us to align a position and an orientation of the 3D hippocampal models constructed from multimodal medical imaging data. We also have trained Support Vector Machine (SVM) for classifying between the normal controls and epileptic patients. Results suggest that the presented representation scheme provides various level of shape representation and the SVM can be a useful classifier in analyzing the shape differences between two groups. A stereoscopic-haptic virtual environment combining an auto-stereoscopic display with a force-feedback (or haptic) device takes an advantage of 3D applications for medicine because it improves space and depth perception.

  • PDF

Improvement of Lipreading Performance Using Gabor Filter for Ship Environment (선박 환경에서 Gabor 여파기를 적용한 입술 읽기 성능향상)

  • Shin, Do-Sung;Lee, Seong-Ro;Kwon, Jang-Woo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • 제35권7C호
    • /
    • pp.598-603
    • /
    • 2010
  • In this paper, we work for Lipreading using visual information for ship environment. Lipreading is studied for using image information including lips of a speaker at the existing speech recognition system. This technique is a compensation method to increase recognition rate decreasing remarkably in noisy circumstances. Proposed way improved the rate of recognition improving methode of preprocessing using the Gabor Filter for Ship Environment. The experiment were carried out under changing of light with time in the ship environment with lip image. For Comparing with recognition, make a compare with between method of lip region of interest (ROI) before Gabor filtering and after Gabor filtering. In the case of using method of lip ROI before Gabor filtering, the result of the experiments applying to the proposed ways recognition resulting in 44% of recognition.

Seismic damage assessment of a large concrete gravity dam

  • Lounis Guechari;Abdelghani Seghir;Ouassila Kada;Abdelhamid Becheur
    • Earthquakes and Structures
    • /
    • 제25권2호
    • /
    • pp.125-134
    • /
    • 2023
  • In the present work, a new global damage index is proposed for the seismic performance and failure analysis of concrete gravity dams. Unlike the existing indices of concrete structures, this index doesn't need scaling with an ultimate or an upper value. For this purpose, the Beni-Haroun dam in north-eastern Algeria, is considered as a case study, for which an average seismic capacity curve is first evaluated by performing several incremental dynamic analyses. The seismic performance point of the dam is then determined using the N2 method, considering multiple modes and taking into account the stiffness degradation. The seismic demand is obtained from the design spectrum of the Algerian seismic regulations. A series of recorded and artificial accelerograms are used as dynamic loads to evaluate the nonlinear responses of the dam. The nonlinear behaviour of the concrete mass is modelled by using continuum damage mechanics, where material damage is represented by a scalar field damage variable. This modelling, which is suitable for cyclic loading, uses only a single damage parameter to describe the stiffness degradation of the concrete. The hydrodynamic and the sediment pressures are included in the analyses. The obtained results show that the proposed damage index faithfully describes the successive brittle failures of the dam which increase with increasing applied ground accelerations. It is found that minor damage can occur for ground accelerations less than 0.3 g, and complete failure can be caused by accelerations greater than 0.45 g.

A new human-robot interaction method using semantic symbols

  • Park, Sang-Hyun;Hwang, Jung-Hoon;Kwon, Dong-Soo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.2005-2010
    • /
    • 2004
  • As robots become more prevalent in human daily life, situations requiring interaction between humans and robots will occur more frequently. Therefore, human-robot interaction (HRI) is becoming increasingly important. Although robotics researchers have made many technical developments in their field, intuitive and easy ways for most common users to interact with robots are still lacking. This paper introduces a new approach to enhance human-robot interaction using a semantic symbol language and proposes a method to acquire the intentions of robot users. In the proposed approach, each semantic symbol represents knowledge about either the environment or an action that a robot can perform. Users'intentions are expressed by symbolized multimodal information. To interpret a users'command, a probabilistic approach is used, which is appropriate for interpreting a freestyle user expression or insufficient input information. Therefore, a first-order Markov model is constructed as a probabilistic model, and a questionnaire is conducted to obtain state transition probabilities for this Markov model. Finally, we evaluated our model to show how well it interprets users'commands.

  • PDF

Crack Identification Using Evolutionary Algorithms in Parallel Computing Environment (병렬 환경하의 진화 이론을 이용한 결함인식)

  • Sim, Mun-Bo;Seo, Myeong-Won
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • 제26권9호
    • /
    • pp.1806-1813
    • /
    • 2002
  • It is well known that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. To identify the location and depth of a crack in a structure, a classical optimization technique was adopted by previous researchers. That technique overcame the difficulty of finding the intersection point of the superposed contours that correspond to the eigenfrequency caused by the crack presence. However, it is hard to select a trial solution initially for optimization because the defined objective function is heavily multimodal. A method is presented in this paper, which uses continuous evolutionary algorithms(CEAs). CEAs are effective for solving inverse problems and implemented on PC clusters to shorten calculation time. With finite element model of the structure to calculate eigenfrequencies, it is possible to formulate the inverse problem in optimization format. CEAs are used to identify the crack location and depth minimizing the difference from the measured frequencies. We have tried this new idea on a simple beam structure and the results are promising with high parallel efficiency over about 94%.

Real-time Simulation Technique for Visual-Haptic Interaction between SPH-based Fluid Media and Soluble Solids (SPH 기반의 유체 및 용해성 강체에 대한 시각-촉각 융합 상호작용 시뮬레이션)

  • Kim, Seokyeol;Park, Jinah
    • Journal of the Korean Society of Visualization
    • /
    • 제15권1호
    • /
    • pp.32-40
    • /
    • 2017
  • Interaction between fluid and a rigid object is frequently observed in everyday life. However, it is difficult to simulate their interaction as the medium and the object have different representations. One of the challenging issues arises especially in handling deformation of the object visually as well as rendering haptic feedback. In this paper, we propose a real-time simulation technique for multimodal interaction between particle-based fluids and soluble solids. We have developed the dissolution behavior model of solids, which is discretized based on the idea of smoothed particle hydrodynamics, and the changes in physical properties accompanying dissolution is immediately reflected to the object. The user is allowed to intervene in the simulation environment anytime by manipulating the solid object, where both visual and haptic feedback are delivered to the user on the fly. For immersive visualization, we also adopt the screen space fluid rendering technique which can balance realism and performance.

Soft Robots Based on Magnetic Actuator (자성 액추에이터 기반의 소프트 로봇)

  • Nor, Gyu-Lyeong;Choi, Moon Kee
    • Journal of the Korean Institute of Electrical and Electronic Material Engineers
    • /
    • 제34권6호
    • /
    • pp.401-415
    • /
    • 2021
  • Soft robots are promising devices for applications in drug delivery, sensing, and manufacturing. Traditional hard robotics are manufactured with rigid materials and their degrees of motion are constrained by the orientation of the joints. In contrast to rigid counterpart, soft robotics, employing soft and stretchable materials that easily deforms in shape, can realize complex motions (i.e., locomotion, swimming, and grappling) with a simple structure, and easily adapt to dynamic environment. Among them, the magnetic actuators exhibit unique characteristics such as rapid and accurate motion control, biocompatibility, and facile remote controllability, which make them promising candidates for the next-generation soft robots. Especially, the magnetic actuators instantly response to the stimuli, and show no-hysteresis during the recovery process, essential for continuous motion control. Here, we present the state-of-the-art fabrication process of magnetically controllable nano-/micro-composites, magnetically aligning process of the composites, and 1-dimensional/multi-dimensional multimodal motion control for the nextgeneration soft actuators.

Transit Mobility Measures on the Seoul Multimodal Network (대중교통망 이동성지표 개발(네트워크 분석을 중심으로))

  • Noh, Hyun-Soo;Doh, Tcheol-Woong;Kim, Won-Keun;Cho, Chong-Suk;Shin, Seong-Il
    • Journal of Korean Society of Transportation
    • /
    • 제23권8호
    • /
    • pp.7-17
    • /
    • 2005
  • Transportation is from an individual mobility. Various efforts to propose specific values or the individual mobility have been conducted in diverse transportation environment. However, mobility studies for multimodal public transportation are rare especially on not the range of line but area. This study propose a method to calculate transit mobility indices as expanding mobility analysis from point-to-point to area-to-area, considering access time to transit facility, running time and transfer time of passengers. To extract mobility indices, we included walking as a lowest category of mode and set passenger car as a competitive mode to transit mode. This study propose three public transportation mobility indices as 1) how competitive public transportation facility is offered against passenger car 2) how convenient transit mode including walking is provided against passenger car from origin to destination and 3) how many various paths are presented to support passenger's travel between regions. These indices are tested on the Seoul metropolitan area with 10 lines of urban rail and about 420 lines of bus. In addition, we proposed two political applications of proposed mobility indices to increase public transportation mobility between two regions and to maximize the mobility of study area when a line is added in the area.

The Effects of types of Presentation and cognitive load on multimedia learning (멀티미디어 환경에서 정보제시 유형과 인지부하가 정보처리에 미치는 영향)

  • 조경자;송승진;한광희
    • Korean Journal of Cognitive Science
    • /
    • 제13권3호
    • /
    • pp.47-60
    • /
    • 2002
  • The study investigated the effects of types of presentation and cognitive load on multimedia learning. In experiment 1, subject were 90 elementary school students. The subject were assigned in three conditions: Narration and Text (NT) condition, Animation and Narration(AN) condition, Animation and Text(AT) condition. The result showed that AN condition improved the learning performances in comparison with AT condition, NT condition. Experiment 2 was administrated to 87 undergraduate students. They were participated in three conditions, also. The conditions were Animation and Text (AT) condition, Animation and Narration (AN) condition, Animation, Narration and Text (ANT) condition. the results showed that AN condition was greater in AT, ANT condition. The results from a series of these experiments imply that varying the types of presentation of identical learning materials had influences on the performances. Multimedia presentation(animation and verbal conditions) improved the learning performances in comparison with monomedia presentation(verbal condition), and the advantage was raised when learners were provided the learning material in the multimodal and multimedia environment(AN condition). Also, it came out that redundant text identical to narration disrupted learning when learners were in the picture (either animation or illustration) and narration conditions. Likewise, also for adults, performances were improved in the multimodal conditions and redundant text identical to narration was not helpful for learning. These results are evidences for the dual-coding theory and the cognitive load theory.

  • PDF

A Real-time Context Integration System for Multimodal Sensor Networks using XML (XML을 활용한 멀티모달 센서기반 실시간 컨텍스트 통합 시스템)

  • Yang, Sung-Ihk;Hong, Jin-Hyuk;Cho, Sung-Bae
    • 한국HCI학회:학술대회논문집
    • /
    • 한국HCI학회 2008년도 학술대회 1부
    • /
    • pp.141-146
    • /
    • 2008
  • As the interest about ubiquitous environment is increasing, there are many researches about the services in this environment. These services have important issues in interpreting the users' context, using many kinds of sensors, like PDA, GPS and accelerometers. Low level raw data, which sensors like accelerometers calibrates, are hard to use, and to provide real-time services preprocessing and interpreting the data into context, in real-time, is important. This paper describes a context integrate system which can integrate these sensors and also sensors which has raw data, like accelerometers and physiological sensors, and define the context interpret rule with XML. The proposing system reduces programming operations when adding a sensor to the sensor network or modifying the context interpreting rule by using XML. By using this system, we implemented a real-time data monitoring system which can describe the numeric data into graphs, and assist the user to validate the data and results of the preprocess phase, and also support the external services and applications to use the context of the user.

  • PDF