• Title/Summary/Keyword: 멀티모달 인터페이스

Search Result 51, Processing Time 0.026 seconds

Implementation of Home Appliance Control System with Speech Recognition based User Interfaces in Home Network Environments (홈 네트워크 환경에서 음성인식기반 사용자 인터페이스를 통한 가전기기 제어 시스템 구현)

  • Kim, Youn-Woo;Jang, Hyun-Su;Kim, Gu-Su;Eom, Young-Ik
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2007.05a
    • /
    • pp.735-738
    • /
    • 2007
  • 컴퓨팅 기술의 발전에 따라 유비쿼터스 시대로의 이행이 가속화되고 있다. 이에 따라 홈 네트워크 분야에 대한 연구와 상용화를 위한 노력이 활발해지고 있다. 이와 더불어 가전기기들의 종류는 다양해지고 복잡해지면서 사용자들의 가전기기 이용에 있어 사용법을 익혀야하는 어려움이 있다. 이러한 문제점을 해결하기 위한 일환으로 디지털 장치들을 편하게 사용하기 위한 멀티 모달 사용자 인터페이스가 요구되고 있다. 본 논문에서 네트워크 가전기기 제어가 가능한 홈 네트워크 미들웨어인 UPnP를 사용하여 VoiceXML을 통한 음성인식기반 사용자 인터페이스와 디지털 장치 제어 시스템을 제안하고 구현한 후 실험하였다.

  • PDF

Development of Continuous Speech Recognition System for Multimedia Mobile Terminal Applications (휴대 멀티미디어 단말용 음성인식 시스템 개발)

  • 김승희
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1998.06c
    • /
    • pp.59-62
    • /
    • 1998
  • 본 논문에서는 한국전자통신연구원의 Handy Combi 응용 도메인을 대상으로 한 화자독립 연속음성인식 시스템 개발에 관하여 기술한다. 불특정화자가 자연스럽게 발음한 연속음성을 인식하는 기술은 펜인식 등과 더불어 멀티모달 인터페이스의 핵심 요소로서, 이동 환경에서 사용자의 다양한 요구사항을 처리하는 지능형 에이전트에 구현을 위해 필수적으로 개발되어야 하는 기술이다. 본 논문에서는 연속확률분포를 가지는 Hidden Markov Model(HMM) 기반의 연속음성인식 시스템을 구현하였다. 개발된 시스템은 음성특징벡터로 MFCC를 사용하였으며, 음소 모델의 강인한 훈련을 위해 음성학적 지식에 기반을 둔 tree-based clustering 방식을 도입하였다. 인식단계에서는 인식속도를 개선시키기 위해 beam-search 기법을 적용하였다. 인식 실험 결과, 99.7%의 어절 인식률과 98.8%의 문장 인식률을 얻었으며, 최종적인 문장의 이해도는 99% 이상이었다.

  • PDF

A Bio Edutainment Contents System based on Virtual Reality (가상현실 기반의 바이오 교육 콘텐츠)

  • Lee, Jun;Park, SungJun;Kim, HyungSeok;Kim, Jee-In
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.59-65
    • /
    • 2009
  • An Edutainment Contents help the learners to recognize the problems effectively, grasp and classify important information needed to solve the problems and convey the contents of what they have learned. Owing not only to this game-like fun but also to the educational effect, The Edutainment contents can be usefully applied to education and training in the areas of scientific technology and industrial technology. This study proposes the Edutainment that users can apply to biotechnology by using intuitive multi-modal interfaces. In this study, a stereoscopic monitor is used to make three dimensional molecular structures, and multi-modal interface is used to efficiently control. Based on the system, this study easily solved the docking simulation function, which is one of the important experiments, by applying these game factors. For this, we suggested the level-up concept as a game factor that depends on numbers of objects and users.

  • PDF

Research on Effective Use of A Serious Bio-Game (기능성 Bio-Game의 활용 방안에 관한 연구)

  • Park, Sung-Jun;Lee, Jun;Kim, Jee-In
    • Journal of Korea Game Society
    • /
    • v.9 no.1
    • /
    • pp.93-103
    • /
    • 2009
  • A Serious Game helps the learners to recognize the problems effectively, grasp and classify important information needed to solve the problems and convey the contents of what they have learned. Owing not only to this game-like fun but also to the educational effect, The Serious Game can be usefully applied to education and training in the areas of scientific technology and industrial technology. This study proposes the Serious Game that users can apply to biotechnology by using intuitive multi-modal interfaces. In this study, a stereoscopic monitor is used to make three dimensional molecular structures, and multi-modal interface is used to efficiently control. Based on a such system, this study easily solved the docking simulation function, which is one of the important experiments, by applying these game factors. For this, we suggested the level-up concept as a game factor that depends on numbers of objects and users. The proposed system was evaluated in performance comparison in result time of a new drug design process on AIDS virus with previous approach.

  • PDF

A Study on User Experience Factors of Display-Type Artificial Intelligence Speakers through Semantic Network Analysis : Focusing on Online Review Analysis of the Amazon Echo (의미연결망 분석을 통한 디스플레이형 인공지능 스피커의 사용자 경험 요인 연구 : 아마존 에코의 온라인 리뷰 분석을 중심으로)

  • Lee, Jeongmyeong;Kim, Hyesun;Choi, Junho
    • The Journal of the Convergence on Culture Technology
    • /
    • v.5 no.3
    • /
    • pp.9-23
    • /
    • 2019
  • The artificial intelligence speaker market is in a new age of mounting displays. This study aimed to analyze the difference of experience using artificial intelligent speakers in terms of usage context, according to the presence or absence of displays. This was achieved by using semantic network analysis to determine how the online review texts of Amazon Echo Show and Echo Plus consisted of different UX issues with structural differences. Based on the physical context and the social context of the user experience, the ego network was constructed to draw out major issues. Results of the analysis show that users' expectation gap is generated according to the display presence, which can lead to negative experiences. Also, it was confirmed that the Multimodal interface is more utilized in the kitchen than in the bedroom, and can contribute to the activation of communication among family members. Based on these findings, we propose a user experience strategy to be considered in display type speakers to be launched in Korea in the future.

Service Technology Prospect for Next Generation Smart TV (차세대 스마트TV 서비스 기술 전망)

  • Hong, Jin-Woo
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2012.05a
    • /
    • pp.368-371
    • /
    • 2012
  • Smart TV is approaching as a new media service to integrate the broadcasting and the internet according to the technology evaluation of convergence to broadcasting, telecommunication, and computing. Therefore, This paper looks out the next generation smart TV(Smart TV 2.0) technology based on CPNT which supports those services such as the broadcasting, telecommunication, a convergence of broadcasting & communication, and computer service through multi-screen.

  • PDF

The Status and Research Themes of Speech based Multimodal Interface Technology (음성기반 멀티모달 인터페이스 기술 현황 및 과제)

  • Lee ChiGeun;Lee EunSuk;Lee HaeJung;Kim BongWan;Joung SukTae;Jung SungTae;Lee YongJoo;Han MoonSung
    • Proceedings of the KSPS conference
    • /
    • 2002.11a
    • /
    • pp.111-114
    • /
    • 2002
  • Complementary use of several modalities in human-to-human communication ensures high accuracy, and only few communication problem occur. Therefore, multimodal interface is considered as the next generation interface between human and computer. This paper presents the current status and research themes of speech-based multimodal interface technology, It first introduces about the concept of multimodal interface. It surveys the recognition technologies of input modalities and synthesis technologies of output modalities. After that it surveys integration technology of modality. Finally, it presents research themes of speech-based multimodal interface technology.

  • PDF

FDM을 활용한 차세대 u-Biz로서의 Meta-Biz 주요 유형 선정

  • Kim, Han-Cheol;Gwon, Oh-Byeong;Jo, Mi-Jeom;Park, Hui-Cheol;Lee, Seok-Min;Lee, Jeong-Seon
    • 한국경영정보학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.71-78
    • /
    • 2008
  • 새로운 경영방식을 가능하게 하는 혁신적 정보기술의 하나로서 최근 차세대 인터넷으로 불리는 3차원 온라인 가상공간인 메타버스가 부상하고 있으며, 이를 구현하기 위해 증강현실이나 멀티모달 방식 등으로 자연스러운 인터페이스를 실현하려는 노력이 주목할 만하다. 그러나 아직 메타버스에 대한 학술적 접근이나 메타버스 기반의 u-Biz 혁신에 대한 연구는 미흡한 실정이다. 따라서 본 연구의 목적은 e-Biz와 u-Biz 및 메타버스 현황을 살펴보고, 기존의 비즈니스 유형을 융 복합하여 메타버스 기반의 차세대 u-Biz를 의미하는 메타비즈니스 및 그의 유형을 제안하는 것이다.

  • PDF

Data model of Multimodal Visual Interface (멀티모달 비주얼 인터페이스의 테이터형)

  • Malyanov, Ilya;d'Auriol, Brian J.;Lee, Sung-Young;Lee, Young-Koo
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2011.06b
    • /
    • pp.240-241
    • /
    • 2011
  • Contemporary electronic healthcare systems are getting more and more complex, providing users a broad functionality, but often fail to have accessible interfaces. However, the importance of a good interface is nearly as great as of the rest of the system. Development of an intuitive multimodal interface for a healthcare system is the goal of our research work. This paper discusses data model of the interface.

CPNT Based Next Generation Smart TV Service Technology (CPNT 기반 차세대 스마트TV 서비스 기술)

  • Hong, Jin-Woo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.16 no.6
    • /
    • pp.1209-1216
    • /
    • 2012
  • Smart TV is approaching as a new media service to integrate the broadcasting and the internet according to the technology evaluation of convergence to broadcasting, telecommunication, and computing. Therefore, This paper proposes the next generation smart TV(Smart TV 2.0) technology based on CPNT which supports those services such as the broadcasting, telecommunication, a convergence of broadcasting & communication, and computer service through multi-screen. Also, this paper describes the concept and details of the related technologies.