• Journal of Korea Game Society
• /
• v.10 no.2
• /
• pp.57-66
• /
• 2010

In the prior works on tabletop systems, a projection-based tabletop surface is mostly used to display computer images, and the participants interact with the display surface by hand multi-touching or using some tangible objects. In this research, however, we developed the FishBowl game that employs a scalable tabletop tiled display with infrared camera tracking coupled with PDA mobile interfaces. The focus of this game is to enhance user interactivity and realistic experience by coupling the high-resolution tabletop virtual environment and PDA mobile interface. This paper describes the game design followed by the system design and its detailed implementations. It also discusses the system usability and recommendation for its improvements after interviewing game players and then concludes with future research directions.

• Design Convergence Study
• /
• v.16 no.5
• /
• pp.177-190
• /
• 2017

This research aims to suggest a multimodal non-touch gesture interface design to improve the usability of 3D sculpting task. The task and procedure of design sculpting of users were analyzed across multiple circumstances from the physical sculpting to computer software. The optimal body posture, design process, work environment, gesture-task relationship, the combination of natural hand gesture and arm movement of designers were defined. The preliminary non-touch 3D S/W were also observed and natural gesture interaction, visual metaphor of UI and affordance for behavior guide were also designed. The prototype of gesture based 3D sculpting system were developed for validation of intuitiveness and learnability in comparison to the current S/W. The suggested gestures were proved with higher performance as a result in terms of understandability, memorability and error rate. Result of the research showed that the gesture interface design for productivity system should reflect the natural experience of users in previous work domain and provide appropriate visual - behavioral metaphor.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.07a
• /
• pp.373-374
• /
• 2019

2004년 이후로 무형유산의 중요성이 대두되면서 박물관의 설립 및 전시 콘텐츠의 수요는 증가하고 있으나, 그 콘텐츠를 활용한 ICT응용기술 발전이 미흡하였다. 본 논문에서는 국가무형유산중 하나인 봉산 탈춤을 기반으로 사용자의 상호작용이 가능한 교육형 인터랙션 콘텐츠 응용을 제안한다. 키넥트와 팔에 장착된 자이로 센서들을 활용한 향상된 동작 추적을 기반으로, 사용자는 봉산탈춤의 기본 동작 및 과정을 따라함으로써 봉산탈춤을 학습 할 수 있다.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.6 no.3
• /
• pp.371-379
• /
• 2011

In this paper, we propose a development methodology of interactive stereoscopic image display system. In our case, we consider a multiple touch recognition technique as the interaction method. That's because we want to guarantee multiple user access and interaction to the content without any restriction. In this case, however, some restrictions are occurred on account of the distance between display and participants. For this reason, this paper propose an invisible interaction surfaces which are generated in the air. This surface is utilized as interaction medium instead of the display wall. We also present an effective way to generate and edit interactive stereoscopic images based on Game Engine.

• Journal of the Korea Convergence Society
• /
• v.11 no.11
• /
• pp.175-182
• /
• 2020

In this study, we introduced the technique of matching classical music using deep learning to design soundscape that can help the viewer appreciate painting and proposed an evaluation index to evaluate how well matching painting and music. The evaluation index was conducted with suitability evaluation through the Likeard 5-point scale and evaluation in a multimodal aspect. The suitability evaluation score of the 13 test participants for the deep learning based best match between painting and music was 3.74/5.0 and band the average cosine similarity of the multimodal evaluation of 13 participants was 0.79. We expect multimodal evaluation to be an evaluation index that can measure a new user experience. In addition, this study aims to improve the experience of multisensory artworks by proposing the interaction between visual and auditory. The proposed matching of painting and music method can be used in multisensory artwork exhibition and furthermore it will increase the accessibility of visually impaired people to appreciate artworks.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2002.11a
• /
• pp.66-73
• /
• 2002

범용 가상환경 프레임워크 NAVER를 제안하고, 이를 케이브기반 가상현실환경에 적용하여 자동차 시제품 평가 실험에 활용한 사례를 소개한다. NAVER는 다양한 가상현실 어플리케이션을 구현하기 위한 가상환경 프레임워크로, 확장성이 뛰어나고 재구성이 가능하다. NAVER는 Render Server, Control Server, 그리고 Device Server로 구성되어 있으며, 각 서버는 네트워크로 상호 통신하여 각각의 기능을 수행한다. NAVER는 XML 기반 스크립팅 언어를 지원하여 사용자가 자유롭게 가상환경의 여러 가지 객체와 인터랙션을 정의할 수 있도록 설계되었다. NAVER를 케이브 기반 가상현실환경에 적용하여 자동자 시제품평가 실험에 활용하였다. KIST의 케이브 기반 가상현실환경은 4면의 정방형 스테레오 디스플레이 장치, 햅틱 암마스터 장비, 3차원 음향장비 등으로 구성되어 있어, 사용자에서 시각적인 측면에서 뿐만 아니라 촉각, 청각과 같은 여러가지 측면에서 다중현실감을 제시할 수 있다. 자동차 시제품 평가 실험를 통하여 사용자가 실제 자동차가 아닌 가상의 자동차 시제품을 관찰하고, 만져보고, 주행해 봄으로써 더욱 높은 몰입감과 현실감으로 자동차 조작장치의 조작성을 평가할 수 있음을 입증하였다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2022.06a
• /
• pp.1-3
• /
• 2022

코로나 19 팬데믹으로 인한 4차 산업혁명이 앞당겨지고 초현실, 초실감, 초연결 사회 등의 키워드가 대두되고 언택트(Untact) 시대가 일상생활에 불가항력적으로 접목되면서 몰입감과 흥미성, 유희성을 목적으로 한 콘텐츠들이 다양하게 활성화되었다. 특히, 메타버스(Metaverse) 플랫폼이 빠르게 진화하면서 물리적 현실과 디지털 가상성을 융합한 다중 사용자에게 다양한 경험이 가능한 서비스가 주목받고 있다. 메타버스는 다중 사용자 플랫폼에서 원활한 커뮤니케이션과 대규모 멀티플레이가 가능한 온라인 비디오 게임, 오픈 게임 월드, AR 협업 공간과 호환되는 사회적, 몰입감이 있는 VR(Virtual Reality) 플랫폼 서비스 중 하나이다. 우리는 메타버스 플랫폼 개발 시 필요로 하는 요소기술 및 3D 데이터 획득을 통한 VR 콘텐츠를 설계하고 구현하고자 한다. 1) 콘텐츠 시나리오 및 사용자 인터랙션 설계; 2) 볼류메트릭 캡처를 활용한 실사 기반의 동적(Dynamic) 데이터 생성; 3) 컴퓨터 그래픽 기반 가상공간 설계 및 정적(Static)데이터 요소기술 개발; 4) 가상 현실 공간 데이터와 볼류메트릭 캡처의 실사 데이터 정합; 5) 공간 데이터 시각화 생성 및 모듈형 공간 이동 제어 기능 개발; 최종적으로 6) VR 환경에서의 콘텐츠 구현을 목표로 한다.

• The Journal of the Korea Contents Association
• /
• v.13 no.7
• /
• pp.1-8
• /
• 2013

As yet the use of 3D projection mapping facade has been limited to advertising and performance in the outside. And interactive elements are lacking. In this paper, propose a interaction system which control of projection mapping facade for multi-audience participation using smart devices. The system can be interaction for the multi-façade. And single or multiple can participate in the game. A user test based on the result confirmed an effectiveness of the proposed method. This research showed a practical method in which interaction of projection facade system can be used to user devices. The results of this study can be used as a base module for projection facade interaction system. In addition, It can be utilized for converged content development such as performances, games, education and various applications services.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.13 no.2
• /
• pp.15-23
• /
• 2013

In this paper, we propose a session management and control architecture for N-Screen services, which enable users to change devices and transfer contents among user's devices during service by session transfer and split. In N-Screen services, users may have multiple devices with different attribute such as screen resolution, CPU capability and access network interfaces. Also, since users may change devices during service, or one user may use multiple stream, N-Screen services need to enable the user to share and transfer contents across N-Screen devices. We introduce the management and control servers to provide session split over user multiple devices and session continuity while changing device. Furthermore, the proposed architecture provides the device capabilities aware session continuity. In addition, the proposed scheme minimizes the session transfer delay and content server processing load. We present results that show the effectiveness and usefulness of proposed architecture.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.1
• /
• pp.735-745
• /
• 2023

The purpose of this study is to examine how the control of an agent according to a driver's social status affects user experience factors in a multi-user environment of self-driving vehicles. We conducted a user study where participants viewed four scenarios (route changing/parking x accepting/declining a fellow passenger's command) and answered a survey, followed by a post-hoc interview. Results showed that either the routing scenario or accepting a passenger's command scenario had higher usefulness (convenience, effectiveness, efficiency) than their counterparts. Regardless of the car owner's social status, participants rated AI agents more positively when they met their goals effectively. They also stressed that vehicle owners should always be in control of their agents. This study can provide guidelines for designing future autonomous driving scenarios where an agent interacts with a driver, and passengers.