• Proceedings of the Korea Society of Design Studies Conference
• /
• 2003.05a
• /
• pp.28-29
• /
• 2003

• Korean Journal of Computational Design and Engineering
• /
• v.13 no.3
• /
• pp.209-216
• /
• 2008

This paper presents a novel approach to design evaluation of portable consumer electronic (PCE) products using augmented reality (AR) based tangible interaction and functional behavior simulation. In the approach, the realistic visualization is acquired by overlaying the rendered image of a PCE product on the real world environment in real-time using computer vision based augmented reality. For tangible user interaction in an AR environment, the user creates input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. For functional behavior simulation, we adopt state transition methodology to capture the functional behavior of the product into a markup language-based information model, and build a finite state machine (FSM) to controls the transition between states of the product based on the information model. The FSM is combined with AR-based tangible objects whose operation in the AR environment facilitates the realistic visualization and functional simulation of the product, and thus realizes faster product design and development. Based on the proposed approach, a product design evaluation system has been developed and applied for the design evaluation of various PCE products with highly encouraging feedbacks from users.

• Journal of the Korean Society for Precision Engineering
• /
• v.21 no.11
• /
• pp.7-11
• /
• 2004

• Korean Journal of Computational Design and Engineering
• /
• v.18 no.5
• /
• pp.374-383
• /
• 2013

Various interaction techniques have been studied for providing the feeling of touch and improve immersion in augmented reality (AR) environments. Tangible AR interaction exploiting two types (product-type and pointer-type) of simple objects has earned great interest for cost-effective design evaluation of digital handheld products. When the sizes of markers attached to the objects are kept big to obtain better marker recognition, the pointer-type object frequently and significantly occludes the product-type object, which deteriorates natural visualization and level of immersion in an AR environment. In this paper, in order to overcome such problems, we propose tangible AR interaction using fingertip touch combined with small-sized markers. The proposed approach facilitates the use of convex polygons to recover the boundaries of AR markers which are partially occluded. It also properly enlarges the pattern area of each AR marker to reduce the sizes of AR markers without sacrificing the quality of marker detection. We empirically verified the quality of the proposed approach, and applied it in the process of design evaluation of digital products. From experimental results, we found that the approach is comparably accurate enough to be applied to the design evaluation process and tangible enough to provide a pseudo feeling of manipulating virtual products with human hands.

• Journal of Computational Design and Engineering
• /
• v.1 no.4
• /
• pp.289-297
• /
• 2014

Although big-sized markers are good for accurate marker recognition and tracking, they are easily occluded by other objects and deteriorate natural visualization and level of immersion during user interaction in AR environments. In this paper, we propose an approach to exploiting the use of rectangular markers to support tangible AR interaction based on fingertip touch using small-sized markers. It basically adjusts the length, width, and interior area of rectangular markers to make them more suitably fit to longish objects like fingers. It also utilizes convex polygons to resolve the partial occlusion of a marker and properly enlarges the pattern area of a marker while adjusting its size without deteriorating the quality of marker detection. We obtained encouraging results from users that the approach can provide better natural visualization and higher level of immersion, and be accurate and tangible enough to support a pseudo feeling of touching virtual products with human hands or fingertips during design evaluation of digital handheld products.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2003.11a
• /
• pp.94-95
• /
• 2003

• Journal of the Korea Computer Graphics Society
• /
• v.9 no.1
• /
• pp.19-27
• /
• 2003

Most interaction schemes in virtual environment are indirect in one way or another. ln particular, without a haptic device (which introduces its own problems due to its cumbersomeness), users must rely on visual (or/and aural) feedback, and can not directly appreciate the 3Dness of the interaction object even with stereoscopy. This causes a drop in object presence because people are used to, for instance, observing objects in one's hand, rotating and manipulating them with physical contact. To alleviate this problem, this paper proposes a hand-held cubic screen, named TangibleScreen, on which the appearance of the target interaction object is projected. We choose the Relief Texture Mapping as the rendering method to correctly generate the viewer dependent textures to be projected on the non-planar surfaces of the TangibleScreen.

• Science of Emotion and Sensibility
• /
• v.15 no.4
• /
• pp.553-564
• /
• 2012

Tangible user interfaces have been developed in the area of Human-Computer Interaction for the last decades, however, the applied domains recently have been extended into the product design and interactive art. Tangible User Interfaces are the combination of digital information and physical objects or environments, thus they provide tangible and intuitive interaction as input and output devices, often combined with Augmented Reality. The research developed a design guideline for tangible user interfaces based on key properties of tangible user interfaces defined previously in five representative research: Tangible Interaction, Intuitiveness and Convenience, Expressive Representation, Context-aware and Spatial Interaction, and Social Interaction. Using the guideline emphasizing user interaction, this research evaluated installation in a science museum in terms of the applied characteristics of tangible user interfaces. The selected 15 installations which were evaluated are to educate visitors for science by emphasizing manipulation and experience of interfaces in those installations. According to the input devices, they are categorized into four Types. TUI properties in Type 3 installation, which uses body motions for interaction, shows the highest score, where items for context-aware and spatial interaction were highly rated. The context-aware and spatial interaction have been recently emphasized as extended properties of tangible user interfaces. The major type of installation in the science museum is equipped with buttons and joysticks for physical manipulation, thus multimodal interfaces utilizing visual, aural, tactile senses etc need to be developed to provide more innovative interaction. Further, more installation need to be reconfigurable for embodied interaction between users and the interactive space. The proposed design guideline can specify the characteristics of tangible user interfaces, thus this research can be a basis for the development and application of installation involving more TUI properties in future.

• Korean Institute of Interior Design Journal
• /
• v.22 no.5
• /
• pp.302-310
• /
• 2013

Many museums have recently employed digital technologies in exhibition installations to provide visitors with interactive experiences with the installations, not just audiences. However, most of them have focused on the adoption of new prototypes or technologies, not considering user experiences of those systems carefully. This study developed an evaluation tool for usability of the tangible user interfaces and conducted a usability study on museum installations emphasizing user interaction and experience. The evaluation tool is composed of 5 features of tangible user interfaces such as tangible, interaction, convenience, representation, spatial interaction and social interaction, and 24 items. The museum we investigated is the Gwacheon National Science Museum, where 8 installations, classified 4 categories, were selected for the usability study. We recruited 6 undergraduate students, who were divided into 2 teams, each team having 3 students. Three students in a team manipulated and experience each installation together and reported their evaluation score through the questionnaire and interviews. The results showed that the score of the usability for the category 3, which requires students to move their bodies for the interaction, is the highest one because it features with spatial interaction. Students expressed much interest in the category 4, which utilizes users' other senses, however, the score of the usability is the lowest because the interaction is temporary and repetitive. Most installations are well designed in terms of control constraints, legibility, lower thresholds, participation encouragement, and open to the public, but pooly designed in terms of multiple access points, configurability, accurate movement, ambient media, and full-body interaction.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2000.11a
• /
• pp.16-17
• /
• 2000

폭발적인 편재성의 증가로 인해 테크날러지는 이제 인간에게 어디서든 접근 가능한 것이 되었음과 동시에, 모순적이게도 "보이지 않게" 되었다. 그러나, 이러한 모순적인 이중성은 필연적이며 테크날러지의 시대상을 바라보는 데에 더없이 유용하다. 어떻게 하면 이러한 테크날러지와 함께 살아갈 것인가\ulcorner (중략)