The Transactions of The Korean Institute of Electrical Engineers (전기학회논문지)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Touchless User Interface for Real-Time Mobile Devices

실시간 비접촉 모바일 제어 기법

  • Received : 2010.12.16
  • Accepted : 2011.01.24
  • Published : 2011.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

A touchless user interface system is proposed for real-time mobile devices in this work. The proposed system first recognizes the position of pattern to interact various applications based on the scene taken from mobile camera. Then, the proposed system traces the route of the pattern, which estimates the motion of pattern based on the mean-shift method. Based on this information, we control menu and keypad for the various applications. Differ from other user interface systems, the proposed system provides the new experience to even for the user of low-end mobile without additional hardware. Simulation results demonstrate that the proposed algorithm provides better interaction performances than the conventional method, while achieving real-time user interacting for mobile devices.

Keywords

References

  1. ITU-T, E.161 : Arrangement of digits, letters and symbols on telephones and other devices that can be used for gaining access to a telephone network, Feb., 2001.
  2. F. Golshani, "TUI or GUI-It's a Matter of Somatics," IEEE Multimedia, vol.14, no.1, pp.104-104, Jan. 2007. https://doi.org/10.1109/MMUL.2007.24
  3. Jefferson Y. Han, "Low-cost multi-ouch sensing through frustrated total internal reflection," in Proceedings of the 18th annual ACM symposium on User interface software and technology, Oct. 2005.
  4. J. I.-Siplia, M. Moberg, and O. Viiki, "Multi-Lingual Speaker-Independent Voice User Interface For Mobile Devices," in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, May 2006.
  5. J. Rekimoto, "Tilting operations for small screen interfaces," in Proc. ACM Symposium on User Interfac Software and Technology, pp. 167-168, Nov. 1996.
  6. E. Hjelmas and B. K. Low, "Face detection: A survey," Computer Vision and Image Understanding, vol. 83, no.3, pp. 236-274, Sep. 2001. https://doi.org/10.1006/cviu.2001.0921
  7. J. Brand and J. S. Mason, "A comparative assessment of three approaches to pixel-level human skin-detection," in Proc. International Conference on Pattern Recognition, pp. 1056-1059, Sep. 2000.
  8. P. Kakumanu, S. Makrogiannis, and N. Bourbakis,"A survey of skin-color modeling and detection methods," Pattern Recognition, vol. 40, no. 3, pp. 1106-1122, Mar. 2007. https://doi.org/10.1016/j.patcog.2006.06.010
  9. M. Rohs, "Real-World Interaction with Camera Phones," in Proc. International Symposium on Ubiquitous Computing Systems, Nov. 2004.
  10. J. Hannuksela, P. Sangi, and J. Heikkila, "A Vision-Based Approach for Controlling User Interfaces of Mobile Devices," in Proc. IEEE CVPR, Jun. 2005.
  11. S. A. Drab and N. M. Artner, "Motion detection as interaction technique for games & applications on mobile devices," in Proc. Pervasive Mobile Interaction Devices Workshop, May 2005.
  12. A. Bulbul, Z. Cipiloglu, and T. Capin, "A Face Tracking Algorithm for User Interaction in Mobile Devices," in Proc. International Conference on CyberWorlds, Sep. 2009.
  13. O. Gallo, S. M. Arteaga, and J. E. Davis, "A camera-based pointing interface for mobile devices," in Proc. International Conference on Image Processing, Oct. 2008.
  14. J. P. Lewis, "Fast normalized cross-correlation," Vision Interface, pp. 120-123, 1995.
  15. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. on Pattern Anal. Mach. Intell., vol. 25 , no. 5, pp. 564-577, May 2003 https://doi.org/10.1109/TPAMI.2003.1195991
  16. O. Gallo, S. M. Arteaga, and J. E. Davis, "A camera-based pointing interface for mobile devices," in Proc. International Conference on Image Processing, Oct. 2008.