• 한국CDE학회논문집
• /
• 제16권4호
• /
• pp.277-284
• /
• 2011

In tangible augmented reality (AR) environments for virtual prototyping, the user interacts with virtual products by manipulating tangible objects with his or her hands, but the user often encounter awkward situations in which his or her hands are occluded by augmented virtual objects, which reduces both immersion and ease of interaction. In this paper, we present how to resolve such hand region occlusion in order to enhance natural interaction and immersive visualization. In the AR environment considered, we use two types (product-type and pointer-type) of tangible objects for tangible user interaction with a virtual product of interest. Holding the tangible objects with his or her hands, the user can create input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. We developed a method for resolving hand region occlusion frequently arising during such user interaction, It first detect hand region in a real image and refines the rendered image of the virtual object by subtracting the hand region from the rendered image, Then, it superimposes the refined image onto the real image to obtain an image in which the occlusion is resolved. Incorporated into tangible AR interaction for virtual prototyping of handheld products such as cellular phones and MP3 players, the method has been found by a preliminary user study that it is not only useful to improve natural interaction and immersive visualization of virtual products, but also helpful for making the users experience the products' shapes and functions better.

• 한국CDE학회논문집
• /
• 제16권1호
• /
• pp.1-10
• /
• 2011

In this paper, we propose an AR-based tangible interaction using a finger fixture for virtual evaluation of digital handheld products. To realize tangible interaction between a user and a product in a computer-vision based AR environment, we uses two types of tangible objects: a product-type object and a finger fixture. The product-type object is used to acquire the position and orientation of the product, and the finger fixture is used to recognize the position of a finger tip. The two objects are fabricated by RP technology and AR markers are attached to them. The finger fixture is designed to satisfy various requirements with an ultimate goal that the user holding the finger fixture in his or her index finger can create HMI events by touching specified regions (buttons or sliders) of the product-type object with the finger tip. By assessing the accuracy of the proposed interaction, we have found that it can be applied to a wide variety of digital handheld products whose button size is not less than 6 mm. After performing the design evaluation of several handheld products using the proposed AR-based tangible interaction, we received highly encouraging feedback from users since the proposed interaction is intuitive and tangible enough to provide a feeling like manipulating products with human hands.

• Journal of Electrical Engineering and Technology
• /
• 제9권2호
• /
• pp.762-770
• /
• 2014

Tangible Space Initiative (TSI) is a new framework that can provide a more natural and intuitive Human Computer Interface for users. This is composed of three cooperative components: a Tangible Interface, Responsive Cyber Space, and Tangible Agent. In this paper we present a Tangible Tele-Meeting system in TSI, which allows people to communicate with each other without any spatial limitation. In addition, we introduce a method for registering a Tangible Avatar with a Tangible Agent. The suggested method is based on relative pose estimation between the user and the Tangible Agent. Experimental results show that the user can experience an interaction environment that is more natural and intelligent than that provided by conventional tele-meeting systems.

• 한국실내디자인학회논문집
• /
• 제22권5호
• /
• pp.302-310
• /
• 2013

Many museums have recently employed digital technologies in exhibition installations to provide visitors with interactive experiences with the installations, not just audiences. However, most of them have focused on the adoption of new prototypes or technologies, not considering user experiences of those systems carefully. This study developed an evaluation tool for usability of the tangible user interfaces and conducted a usability study on museum installations emphasizing user interaction and experience. The evaluation tool is composed of 5 features of tangible user interfaces such as tangible, interaction, convenience, representation, spatial interaction and social interaction, and 24 items. The museum we investigated is the Gwacheon National Science Museum, where 8 installations, classified 4 categories, were selected for the usability study. We recruited 6 undergraduate students, who were divided into 2 teams, each team having 3 students. Three students in a team manipulated and experience each installation together and reported their evaluation score through the questionnaire and interviews. The results showed that the score of the usability for the category 3, which requires students to move their bodies for the interaction, is the highest one because it features with spatial interaction. Students expressed much interest in the category 4, which utilizes users' other senses, however, the score of the usability is the lowest because the interaction is temporary and repetitive. Most installations are well designed in terms of control constraints, legibility, lower thresholds, participation encouragement, and open to the public, but pooly designed in terms of multiple access points, configurability, accurate movement, ambient media, and full-body interaction.

• 감성과학
• /
• 제15권4호
• /
• pp.553-564
• /
• 2012

본 연구는 실물형 인터페이스 개념과 특징을 설명하고 있는 선행연구를 대상으로 실물형 인터페이스디자인에 대한 특성을 토출하여 이를 토대로 실물형 인터페이스 디자인 가이드라인을 제안하였다. 도출된 인터페이스 디자인 가이드 라인의 특성은 물리적 조작성, 기기의 용이성 및 편리성, 지각적 표현성, 상황인지 및 공간성, 그리고 사회적 상호작용으로 구분되었으며 25개의 세부항목이 추출되었다. 개발된 가이드라인은 사용자와의 상호작용 측면이 강조된 것으로 이를 실제공간의 체험형 전시물들에 적용하여 평가함으로써 현 실물형 인터페이스 디자인의 특성을 분석하였다. 조사대상으로 선정된 국립과학 박물관의 전시 설치물들 중 실물형 인터페이스 평가가 가능하다고 판단되는 15개의 설치물을 대상으로 개발된 디자인 가이드 라인에 따라 전문가 평가를 하였다. 평가결과 신체모션을 이용한 인터페이스에 대한 점수가 가장 높았으며 이들은 상황인지 및 공간성 영역에서 높은 평가를 받았다. 상황인지 및 공간성은 새로이 확장된 실물형 인터페이스 특성으로 최근 그 중요성이 강조되고 있다. 분석 결과 대부분의 설치물들은 버튼과 조이스틱 위주의 물리적 조작성을 제공하는 설치물이 가장 많았으나 향후 시각, 청각, 촉각 등의 다감각 인터페이스나 사용자가 직접 설치장치들을 재배열하는 인터렉션 개발 등이 필요하였다. 본 연구는 실물형 인터페이스 디자인을 평가할 수 있는 기준을 제시하였다는데 그 의의가 있으며 실물형 인터페이스디자인이 적용된 전시 설치물들이 개발되고 적용됨에 있어 발전 방향을 모색하는데 도움을 줄 것으로 기대한다. 향후 개발된 실물형 인터페이스 디자인 가이드 라인에 따라 전문가 평가뿐만 아니라 실제 사용자들을 대상으로 하는 사용자 경험 평가가 병행되어야 할 것이다.

• 한국디자인학회:학술대회논문집
• /
• 한국디자인학회 2000년도 추계 학술발표대회 논문집
• /
• pp.16-17
• /
• 2000

폭발적인 편재성의 증가로 인해 테크날러지는 이제 인간에게 어디서든 접근 가능한 것이 되었음과 동시에, 모순적이게도 "보이지 않게" 되었다. 그러나, 이러한 모순적인 이중성은 필연적이며 테크날러지의 시대상을 바라보는 데에 더없이 유용하다. 어떻게 하면 이러한 테크날러지와 함께 살아갈 것인가\ulcorner (중략)

• 한국CDE학회논문집
• /
• 제17권6호
• /
• pp.417-425
• /
• 2012

In recent years, great attention has been paid to using simple physical objects as tangible objects to improve user interaction in augmented reality (AR) environments. In this paper, we address AR-based user interaction using tangible objects, which has been used as a key component for virtual design evaluation of engineered products including digital handheld products. We herein consider the use of two types (product-type and pointer-type) of tangible objects. The user creates input events by touching specified parts of the product-type object with the pointer-type object, and the virtual product reacts to the events by rendering its visual and auditory contents on the output devices. The product-type object is used to reflect the geometric shape of a product of interest and to determine its position and orientation in the AR environment. The pointer-type object is used to recognize the reference position of the pointer (or finger) in the same environment. The rapid prototype of the product is employed as a good alternative to the product-type object, but various alternatives to the pointer-type object can be considered according to fabrication process and touching mechanism. In this paper, we present four alternatives to the pointer-type object and investigate their strong and weak points by performing experimental comparison of their various aspects including interaction accuracy, task performance, and qualitative user experience.

• 한국CDE학회논문집
• /
• 제13권3호
• /
• pp.209-216
• /
• 2008

This paper presents a novel approach to design evaluation of portable consumer electronic (PCE) products using augmented reality (AR) based tangible interaction and functional behavior simulation. In the approach, the realistic visualization is acquired by overlaying the rendered image of a PCE product on the real world environment in real-time using computer vision based augmented reality. For tangible user interaction in an AR environment, the user creates input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. For functional behavior simulation, we adopt state transition methodology to capture the functional behavior of the product into a markup language-based information model, and build a finite state machine (FSM) to controls the transition between states of the product based on the information model. The FSM is combined with AR-based tangible objects whose operation in the AR environment facilitates the realistic visualization and functional simulation of the product, and thus realizes faster product design and development. Based on the proposed approach, a product design evaluation system has been developed and applied for the design evaluation of various PCE products with highly encouraging feedbacks from users.

• 디자인학연구
• /
• 제17권2호
• /
• pp.463-470
• /
• 2004

본 연구에서는 비교적 간단한 구현 기술과 저가의 플랫폼으로 가상현실 체험을 해볼 수 있는 콘텐츠를 개발하고자 효과적인 가상현실 경험의 구현 요소를 연구하였으며, 그 요소는 현실감과 몰입감, 환상감의 구현 및 Tangible interaction의 사용으로 요약되었다. 이러한 요소들을 적용하여 경험 디자인 컨셉을 도출하고 상대적 현실감이 높은 실사 비디오 영상의 대화면 프로젝션(projection)과 비전 트레킹(Vision Tracking) 기술을 활용한 플랫폼을 디자인하였으며, Tangible device의 자연스러운 인터렉션을 적용한 가상현실 콘텐츠를 디자인하였다. 디자인 결과물은 전시의 형태로 제시하여 일반 사용자들의 체험 기회를 넓히고자 하였으며, Class Xylophone 2003과 VR Class의 두 가지 사례 연구를 통하여 컨텐츠 및 인터렉션 컨셉의 타당성을 검증하였고 다양한 가상현실 콘텐츠와 그 상업적 활용 가능성을 보여줌으로서 가상현실 분야의 저변 확대에 기여하고자 하였다.

• 한국콘텐츠학회:학술대회논문집
• /
• 한국콘텐츠학회 2009년도 춘계 종합학술대회 논문집
• /
• pp.943-948
• /
• 2009

In the research of HCI (Human-Computer Interaction), we always use the GUI（graphical user interface） of graphics input devices until we invent TUI (tangible user interface) which is used to control the computer by hand-touching or other subjects. In this study, we investigate and classify several TUI for the most part in business with the theory and concept of Tangible Bits by Hiroshi Ishii & Brygg Ullmer in order to research the development of TUI.