• 제목/요약/키워드: multimodal

검색결과 640건 처리시간 0.025초

W3C 기반 상호연동 가능한 멀티모달 커뮤니케이터 (W3C based Interoperable Multimodal Communicator)

  • 박대민;권대혁;최진혁;이인재;최해철
    • 방송공학회논문지
    • /
    • 제20권1호
    • /
    • pp.140-152
    • /
    • 2015
  • 최근 사용자와 컴퓨터간의 양방향 상호작용을 가능하게 하는 HCI(Human Computer Interaction) 연구를 위해 인간의 의사소통 체계와 유사한 인터페이스 기술들이 개발되고 있다. 이러한 인간과의 의사소통 과정에서 사용되는 커뮤니케이션 채널을 모달리티라고 부르며, 다양한 단말기 및 서비스 환경에 따라 최적의 사용자 인터페이스를 제공하기 위해서 두 개 이상의 모달리티를 활용하는 멀티모달 인터페이스가 활발히 연구되고 있다. 하지만, 멀티모달 인터페이스를 사용하기에는 각각의 모달리티가 갖는 정보 형식이 서로 상이하기 때문에 상호 연동이 어려우며 상호 보완적인 성능을 발휘하는데 한계가 있다. 이에 따라 본 논문은 W3C(World Wide Web Consortium)의 EMMA(Extensible Multimodal Annotation Markup language)와 MMI(Multimodal Interaction Framework)표준에 기반하여 복수의 모달리티를 상호연동할 수 있는 멀티모달 커뮤니케이터를 제안한다. 멀티모달 커뮤니케이터는 W3C 표준에 포함된 MC(Modality Component), IM(Interaction Manager), PC(Presentation Component)로 구성되며 국제 표준에 기반하여 설계하였기 때문에 다양한 모달리티의 수용 및 확장이 용이하다. 실험에서는 시선 추적과 동작 인식 모달리티를 이용하여 지도 탐색 시나리오에 멀티모달 커뮤니케이터를 적용한 사례를 제시한다.

복합운송경로 선정을 위한 평가기준에 관한 연구 (Study on Evaluation Criteria for Multimodal Transport Routing Selection)

  • 김소연;최형림;김현수;박남규;조재형;박용성;조민제
    • 한국항해항만학회:학술대회논문집
    • /
    • 한국항해항만학회 2006년도 춘계학술대회 및 창립 30주년 심포지엄(논문집)
    • /
    • pp.265-271
    • /
    • 2006
  • 전 세계적으로 생산과 판매, 유통이 펼쳐져 세계경제는 글로벌화 되고 국제운송체계는 신속성과 부가가치 서비스를 중요시하는 운송체계로 변화함에 따라 국제운송체계는 해상운송, 항공운송 그리고 철도운송을 시스템적으로 연계하는 국제복합운송 중심체계로 전환되고 있다. 이러한 변화에 따라 생산과 판매, 유통이 적시에 제공되고, 글로벌 네트워크상의 소비자에게 다차원적인 물류서비스를 제공할 수 있는 국제복합운송경로가 필요하지만 국제운송을 위한 정보 연계 및 운송수단 간의 연계 시스템이 미비하여 활성화되지 못하고 있다. 특히 국내에서는 3자 물류업체, 운송업체 둥의 선정기준은 제시되고 있으나, 운송을 계획하고 수행하는 물류전문업체들이 국제복합운송경로를 선정하는데 있어 체계적인 평가기준이 제시되지 못하고 있다. 이에 본 연구에서는 복합운송경로선정에 대한 주요 문헌연구를 정리하고, 업체 담당자들의 인터뷰를 통해 복합운송경로 선정을 위한 평가기준을 도출하고, 이를 계층분석기법(AHP)을 이용하여 측정하여 복합운송경로 선정을 위한 평가기준을 제시하는데 목적이 있다.

  • PDF

통합감각자극이 저체중아의 성장 및 모아 상호작용에 미치는 효과 (The Effects of Multimodal Sensory Stimulation Combined with Chiropractic Therapy on Growth and Mother-Infant Interaction in Infants with Low Birth Weight)

  • 장군자
    • Child Health Nursing Research
    • /
    • 제13권1호
    • /
    • pp.33-42
    • /
    • 2007
  • Purpose: This study was conducted to investigate the effects of multimodal sensory stimulation on growth and mother-infant interaction in infants with low birth weight (LBW). Method: A non-equivalent control group time-series study design was used. The participants were 38 LBW infants and their mothers (19 in the intervention group and 19 in the control group). The data were collected from September 1, 2003 to March 31, 2004. For the mothers in the intervention group, this researcher instructed mothers in the multimodal sensory stimulation therapy, in turn the mothers used these techniques on their infants once a day during the 4-week research period. The researcher measured weight, length, and head circumference of the LBW infants once a week for 4 weeks and made a film of the mother playing with the infant for 5 minutes in the last week of the research period. Results: Compared to the control group, LBW infants in the intervention group showed significant increases in weekly weight gain (F=3.82, p=.012) and had significantly higher scores for mother-infant interaction (t=3.93, p>.000). Conclusion: The results suggest that multimodal sensory stimulation therapy can be used to increase the growth of LBW infants and improve mother-infant interaction.

  • PDF

정신분열병 환자의 인지적/행동적 특성평가를 위한 가상현실시스템 구현 (A Virtual Reality System for the Cognitive and Behavioral Assessment of Schizophrenia)

  • Cho, Won-Geun;Kim, Ho-Sung;Ku, Jung-Hun;Kim, Jae-Hun;Kim, Byoung-Nyun;Lee, Jang-Han;Kim, Sun I.
    • 한국감성과학회:학술대회논문집
    • /
    • 한국감성과학회 2003년도 춘계학술대회 논문집
    • /
    • pp.94-100
    • /
    • 2003
  • Patients with schizophrenia have thinking disorders such as delusion or hallucination, because they have a deficit in the ability which to systematize and integrate information. Therefore, they cannot integrate or systemize visual, auditory and tactile stimuli. In this study we suggest a virtual reality system for the assessment of cognitive ability of schizophrenia patients, based on the brain multimodal integration model. The virtual reality system provides multimodal stimuli, such as visual and auditory stimuli, to the patient, and can evaluate the patient's multimodal integration and working memory integration abilities by making the patient interpret and react to multimodal stimuli, which must be remembered for a given period of time. The clinical study showed that the virtual reality program developed is comparable to those of the WCST and the SPM.

  • PDF

Brain MR Multimodal Medical Image Registration Based on Image Segmentation and Symmetric Self-similarity

  • Yang, Zhenzhen;Kuang, Nan;Yang, Yongpeng;Kang, Bin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권3호
    • /
    • pp.1167-1187
    • /
    • 2020
  • With the development of medical imaging technology, image registration has been widely used in the field of disease diagnosis. The registration between different modal images of brain magnetic resonance (MR) is particularly important for the diagnosis of brain diseases. However, previous registration methods don't take advantage of the prior knowledge of bilateral brain symmetry. Moreover, the difference in gray scale information of different modal images increases the difficulty of registration. In this paper, a multimodal medical image registration method based on image segmentation and symmetric self-similarity is proposed. This method uses modal independent self-similar information and modal consistency information to register images. More particularly, we propose two novel symmetric self-similarity constraint operators to constrain the segmented medical images and convert each modal medical image into a unified modal for multimodal image registration. The experimental results show that the proposed method can effectively reduce the error rate of brain MR multimodal medical image registration with rotation and translation transformations (average 0.43mm and 0.60mm) respectively, whose accuracy is better compared to state-of-the-art image registration methods.

복합운송인(複合運送人)의 책임(責任) 한계(限界)에 대한 형태별(形態別) 분류(分類)와 실무상(實務上) 적용(適用) (A Pattern of Multimodal Transport Liability and its Adaptation on Practice)

  • 김중관
    • 무역상무연구
    • /
    • 제13권
    • /
    • pp.257-281
    • /
    • 2000
  • The world economy is becoming increasingly globalized. The globalization has resulted in far reaching agreements to deepen trade liberalization and enlarge its scope to cover new areas in addition to strengthening its supporting institutional base. Economic growth has developed international trade which has accelerated the development of international carriage of goods in 21st century. The international trade is basically founded on the contract of international sale of goods and backed up by the contract of international carriage of goods and the insurance on the goods carried. It is essential to incorporate each other sections for the efficient development of international trade. As a result of rapid expansion of international carriage of goods, rationalization of transport was required, which has brought about the International Multimodal Transport System through containerization. The approach to liability system will be a right way to solve the insurance problems for the development and enlargement of world trade volume. International multimodal transport system has affected international trade a lot, especially the field of insurance a grate deal. This paper is to analyze contents of liability system on Multimodal Transport with in the UN Convention on International Multimodal Transport of goods.

  • PDF

A Study on the Selection of Means of Transportation in International Logistics

  • Kim, Jin-Hwan
    • 동아시아경상학회지
    • /
    • 제10권2호
    • /
    • pp.55-69
    • /
    • 2022
  • Purpose - This study is a study to investigate the problem of the selection of means of transportation in international logistics by studying the basics of logistics activities, selection factors of transportation methods, and multimodal transportation. Research design, data, methodology - This study is composed of 5 chapters through literature study. Chapter 1 describes the functions and transportation system of international logistics, Chapter 2 selects transportation, Chapter 3 deals with maritime transportation and multimodal transportation, Chapter 4 describes multimodal transportation in terms of customer service, Chapter 5 addresses the implications and conclusions. Results - When looking at the problem of selecting a means of transportation, it is important that the parties involved in the transportation choose which means of transportation for their convenience and profit during the transportation process. Here, there will be factors to consider, including transportation cost, when selecting a means of transportation, and each means of transportation may have characteristics or advantages and disadvantages. Considering all these points, the adoption of multimodal transportation from a customer service point of view may be the answer. Conclusions - This study pays attention to the academic understanding related to the selection of means of transportation and to how usefully this thesis can be used in the selection of transportation related persons, especially shippers, from a practical level.

Multimodal layer surveillance map based on anomaly detection using multi-agents for smart city security

  • Shin, Hochul;Na, Ki-In;Chang, Jiho;Uhm, Taeyoung
    • ETRI Journal
    • /
    • 제44권2호
    • /
    • pp.183-193
    • /
    • 2022
  • Smart cities are expected to provide residents with convenience via various agents such as CCTV, delivery robots, security robots, and unmanned shuttles. Environmental data collected by various agents can be used for various purposes, including advertising and security monitoring. This study suggests a surveillance map data framework for efficient and integrated multimodal data representation from multi-agents. The suggested surveillance map is a multilayered global information grid, which is integrated from the multimodal data of each agent. To confirm this, we collected surveillance map data for 4 months, and the behavior patterns of humans and vehicles, distribution changes of elevation, and temperature were analyzed. Moreover, we represent an anomaly detection algorithm based on a surveillance map for security service. A two-stage anomaly detection algorithm for unusual situations was developed. With this, abnormal situations such as unusual crowds and pedestrians, vehicle movement, unusual objects, and temperature change were detected. Because the surveillance map enables efficient and integrated processing of large multimodal data from a multi-agent, the suggested data framework can be used for various applications in the smart city.

음성/키 패드를 이용한 한글 단어 입력용 멀티모달 인터페이스 (Multimodal interface for Korean inputs using speech and keypad)

  • 김원우;전호현;박성찬
    • 한국HCI학회:학술대회논문집
    • /
    • 한국HCI학회 2007년도 학술대회 1부
    • /
    • pp.417-422
    • /
    • 2007
  • 멀티모달 인터페이스(multimodal interface)는 사람과 기계 사이의 통신을 위해 여러 가지 수단을 사용함을 말한다. 본 고에서는 휴대폰 키 패드를 통한 문자 입력과 마이크를 통한 음성 인식의 두 가지 모드를 함께 사용하여 단어를 입력하는 새로운 인터페이스 방법을 제시함으로써 미래지향적 휴먼 인터페이스의 핵심으로 인지되고 있는 음성인식의 한계, 특히 한국어 인식의 문제점을 해결하고자 한다.

  • PDF

특징점 및 방향 특징에 기반한 멀티모달 지문 매칭 (Multimodal Fingerprint Matching Based on Minutiae Points and Directional Features)

  • 송영철
    • 전기학회논문지
    • /
    • 제58권12호
    • /
    • pp.2529-2531
    • /
    • 2009
  • A simple multimodal fingerprint recognition method based on two types of feature vectors such as minutiae points and directional features is proposed, where Directional Filter Bank (DFB) is used to extract directional features. Experimental results show that the proposed method can effectively combine minutiae- and DFB-based methods and produce a better matching capability in the poor quality fingerprint image.