AR-based Tangible Interaction Using a Finger Fixture for Digital Handheld Products

손가락 고정구를 이용한 휴대용 전자제품의 증강현실기반 감각형 상호작용

  • Received : 2010.07.06
  • Accepted : 2010.12.06
  • Published : 2011.02.01

Abstract

In this paper, we propose an AR-based tangible interaction using a finger fixture for virtual evaluation of digital handheld products. To realize tangible interaction between a user and a product in a computer-vision based AR environment, we uses two types of tangible objects: a product-type object and a finger fixture. The product-type object is used to acquire the position and orientation of the product, and the finger fixture is used to recognize the position of a finger tip. The two objects are fabricated by RP technology and AR markers are attached to them. The finger fixture is designed to satisfy various requirements with an ultimate goal that the user holding the finger fixture in his or her index finger can create HMI events by touching specified regions (buttons or sliders) of the product-type object with the finger tip. By assessing the accuracy of the proposed interaction, we have found that it can be applied to a wide variety of digital handheld products whose button size is not less than 6 mm. After performing the design evaluation of several handheld products using the proposed AR-based tangible interaction, we received highly encouraging feedback from users since the proposed interaction is intuitive and tangible enough to provide a feeling like manipulating products with human hands.

Keywords

References

  1. Lee, K., Principles of CAD/CAM/CAE Systems, Addison Wesley, Berkeley, 1999.
  2. Ulrich, K. T. and Eppinger, S. D., Product Design and Development, McGraw Hill, New York, 2004.
  3. Bullinger, H. J., Breining, R. and Baucer, W., "Virtual Prototyping - State of the Art in Product Design," Proceedings of the 26th International Conference on Computers & Industrial Engineering, pp. 103-107, 1999.
  4. Zorriassantine, F., Wykes, C., Parkin, R. and Gindy, N., "A Survey of Virtual Prototyping Techniques for Mechanical Product Development," Journal of Engineering Manufacture, Vol. 217, pp. 513-530, 2003. https://doi.org/10.1243/095440503321628189
  5. Burdea, G. C. and Coiffet, P., Virtual Reality Technology, John Wiley & Sons, USA, 2003.
  6. Ottosson, S., "Virtual Reality in the Product Development Process," Journal of Engineering Design, Vol. 13, No. 2, pp. 159-172, 2002. https://doi.org/10.1080/09544820210129823
  7. Greenberg, S. and Fitchett, C., "Phidgets: Easy Development of Physical Interfaces Through Physical Widgets", Proceedings of the ACM UIST, pp. 209-218, 2001.
  8. Hartmann, B., Klemmer, S. R., Bernstein, M. and Mehta, N., "d.tools: Visually Prototyping Physical UIs Through Statecharts," Proceedings of ACM Symposium on User Interface Software and Technology (UIST), 2005.
  9. Ishii, H. and Ullmer, B., "Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms," Proceedings of Conference of Human Factors in Computing Systems (CHI), pp. 234-241, 1997.
  10. ARToolKit, http://www.hitl.washington.edu/ARTool-Kit.
  11. Azuma, R. T., "A Survey of Augmented Reality," Presence: Teleoperators and Virtual Environments, Vol. 6, No. 4, pp. 355-385, 1997.
  12. Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K. and Tachibana, K., "Virtual Object Manipulation on a table-top AR Environment," Proceedings of the International Symposium on Augmented Reality (ISAR), pp. 111-119, 2000.
  13. Billinghurt, M., Kato, H. and Poupyrev, I., "Collaboration with Tangible Augmented Reality Interfaces," Proceedings of HCI International, pp. 234-241, 2001.
  14. Verlinden, J., de Smit, A., Peeters, A. W. J. and van Gelderen, M. H., "Development of a Flexible Augmented Prototyping System," Journal of WSCG, Vol. 11, pp. 496-503, 2003.
  15. Lee, W. and Park, J., "Augmented Foam: Touchable and Graspable Augmented Reality for Product Design Simulation," Bulletin of Japanese Society for the Design Science, Vol. 52, pp. 17-26, 2006.
  16. Nam, T. J., "Sketch-based Rapid Prototyping Platform for Hardware-software Integrated Interactive Products," Proceedings of Conference on Human Factors in Computing Systems (CHI), pp. 1689-1692, 2005.
  17. 박형준, 문희철, "증가현실 기반 상호작용과 시뮬레이션을 이용한 휴대용 전자제품의 설계품평," 한국CAD/CAM 학회 논문집, Vol. 13, No. 3, pp. 209-216, 2008.
  18. Thompson, B. S., Creative Engineering Design, Okemos Press, USA, 1997.
  19. CATIA Version 5, http://www.ibm.com/catia
  20. Rhino3D, http://www.rhino3d.com
  21. RapidForm, http://www.rapidform.com
  22. 문희철, 박형준, "휴대용 제품의 증강현실 기반 가 상시작에서의 손 가림 현상 해결 방안," 한국 CAD/CAM 학회 학술발표회 논문집, pp. 15-20, 2009.