Browse > Article
http://dx.doi.org/10.7315/CADCAM.2013.374

Tangible AR Interaction based on Fingertip Touch Using Small-Sized Markers  

Jung, Ho-Kyun (Department of Industrial Engineering, Chosun University)
Park, Hyungjun (Department of Industrial Engineering, Chosun University)
Abstract
Various interaction techniques have been studied for providing the feeling of touch and improve immersion in augmented reality (AR) environments. Tangible AR interaction exploiting two types (product-type and pointer-type) of simple objects has earned great interest for cost-effective design evaluation of digital handheld products. When the sizes of markers attached to the objects are kept big to obtain better marker recognition, the pointer-type object frequently and significantly occludes the product-type object, which deteriorates natural visualization and level of immersion in an AR environment. In this paper, in order to overcome such problems, we propose tangible AR interaction using fingertip touch combined with small-sized markers. The proposed approach facilitates the use of convex polygons to recover the boundaries of AR markers which are partially occluded. It also properly enlarges the pattern area of each AR marker to reduce the sizes of AR markers without sacrificing the quality of marker detection. We empirically verified the quality of the proposed approach, and applied it in the process of design evaluation of digital products. From experimental results, we found that the approach is comparably accurate enough to be applied to the design evaluation process and tangible enough to provide a pseudo feeling of manipulating virtual products with human hands.
Keywords
Augmented reality; Fingertip touch; Marker tracking; Small-sized markers; Tangible objects; User interaction;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Comport, A.I., Marchand, E., Pressigout, M. and Chaumette, F., 2006, Real-time Markerless Tracking for Augmented Reality: The Virtual Visual Servoing Framework, IEEE Transactions on Visualization and Computer Graphics, 12, pp.615-628.   DOI   ScienceOn
2 Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T. and Schmalstieg, D., 2010, Real-Time Detection and Tracking for Augmented Reality on Mobile Phones, IEEE Transactions on Visualization and Computer Graphics, 16, pp.355-368.   DOI   ScienceOn
3 Park, H. and Moon, H.C., 2008, Design Evaluation of Portable Electronic Products Using AR-Based Interaction and Simulation, Transactions of the Society of CAD/CAM Engineers, 13(3), pp.209-216.
4 Park, H. and Moon, H.C., 2011, AR-based Tangible Interaction using a Finger Fixture for Digital Handheld Products, Transactions of the Society of CAD/CAM Engineers, 16(1), pp.1-10.
5 Park, H., Park, S.J. and Jung, H.K., 2012, Comparison of User Interaction Alternatives in a Tangible Augmented Reality Environment, Transactions of the Society of CAD/CAM Engineers Conference, 17(6), pp.417-425.
6 Khoshelham, K., 2011, Accuracy Analysis of Kinect Depth Data, Proceedings of ISPRS Workshop on Laser Scanning.
7 Derek Bradley and Gerhard Roth, 2007, Adaptive Thresholding Using the Integral Image, ACM Journal of Graphics, GPU, & Game Tools, 12(2).
8 Teichrieb, V., Lima, J., Apolinario, E., Farias, T., Bueno, M., Kelner, J. and Santos, I., 2007, A Survey of Online Monocular Markerless Augmented Reality, International Journal of Modeling and Simulation for the Petroleum Industry, 1(1), pp.1-7.
9 Moon, H.C. and Park, H., 2011, Resolving Hand Region Occlusion in Tangible Augmented Reality Environments, Transactions of the Society of CAD/CAM Engineers, 16(4), pp.277-284.
10 Lee, K., 1999, Principles of CAD/CAM/CAE Systems, Addison Wesley, Berkeley.
11 Burdea, G.C. and Coiffet, P., 2003, Virtual Reality Technology, John Wiley & Sons, USA.
12 Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K. and Tachibana, K., 2000, Virtual Object Manipulation on a Table-top AR Environment, Proceedings of the International Symposium on Augmented Reality (ISAR), pp.111-119.
13 Park, H., Bea, C.Y. and Lee, K.H., 2007, Virtual Prototyping of Consumer Electronic Products by Embedding HMI Functional Simulation into VR Techniques, Transactions of the Society of CAD/ CAM Engineers, 12(2), pp.87-94.
14 Bullinger, H.J., Breining, R. and Baucer, W., 1999, Virtual Prototyping - State of the Art in Product Design, Proceedings of the 26th International Conference on computers & Industrial Engineering, pp.103-107.
15 Azuma, R.T., 1997, A Survey of Augmented Reality, Presence: Teleoperators and Virtual Environments, 6(4), pp.355-385.
16 Billinghurt, M., Kato, H. and Poupyrev, I., 2001, Collaboration with Tangible Augmented Reality Interfaces, Proceedings of HCI International, pp.234-241.
17 ARToolKit, http://www.hitl.washington.edu/ARTool- Kit
18 Kim, M. and Eom, K., 2010, A Survey of Markerless Object Recognition and Tracking for Augmented Reality, Communications of the Korean Institute of Information Scientists and Engineers, 28(8), pp.54-66.