Browse > Article
http://dx.doi.org/10.5370/KIEE.2011.60.2.435

Touchless User Interface for Real-Time Mobile Devices  

Jung, Il-Lyong (고려대 공대 전자전기공학과)
Nikolay, Akatyev (고려대 공대 전자전기공학과)
Jang, Won-Dong (고려대 공대 전자전기공학과)
Kim, Chang-Su (고려대 공대 전기전자전파공학부)
Publication Information
The Transactions of The Korean Institute of Electrical Engineers / v.60, no.2, 2011 , pp. 435-440 More about this Journal
Abstract
A touchless user interface system is proposed for real-time mobile devices in this work. The proposed system first recognizes the position of pattern to interact various applications based on the scene taken from mobile camera. Then, the proposed system traces the route of the pattern, which estimates the motion of pattern based on the mean-shift method. Based on this information, we control menu and keypad for the various applications. Differ from other user interface systems, the proposed system provides the new experience to even for the user of low-end mobile without additional hardware. Simulation results demonstrate that the proposed algorithm provides better interaction performances than the conventional method, while achieving real-time user interacting for mobile devices.
Keywords
User Interface; User interaction; Touchless UI;
Citations & Related Records

Times Cited By SCOPUS : 0
연도 인용수 순위
  • Reference
1 J. P. Lewis, "Fast normalized cross-correlation," Vision Interface, pp. 120-123, 1995.
2 D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. on Pattern Anal. Mach. Intell., vol. 25 , no. 5, pp. 564-577, May 2003   DOI   ScienceOn
3 O. Gallo, S. M. Arteaga, and J. E. Davis, "A camera-based pointing interface for mobile devices," in Proc. International Conference on Image Processing, Oct. 2008.
4 S. A. Drab and N. M. Artner, "Motion detection as interaction technique for games & applications on mobile devices," in Proc. Pervasive Mobile Interaction Devices Workshop, May 2005.
5 A. Bulbul, Z. Cipiloglu, and T. Capin, "A Face Tracking Algorithm for User Interaction in Mobile Devices," in Proc. International Conference on CyberWorlds, Sep. 2009.
6 O. Gallo, S. M. Arteaga, and J. E. Davis, "A camera-based pointing interface for mobile devices," in Proc. International Conference on Image Processing, Oct. 2008.
7 E. Hjelmas and B. K. Low, "Face detection: A survey," Computer Vision and Image Understanding, vol. 83, no.3, pp. 236-274, Sep. 2001.   DOI   ScienceOn
8 P. Kakumanu, S. Makrogiannis, and N. Bourbakis,"A survey of skin-color modeling and detection methods," Pattern Recognition, vol. 40, no. 3, pp. 1106-1122, Mar. 2007.   DOI   ScienceOn
9 M. Rohs, "Real-World Interaction with Camera Phones," in Proc. International Symposium on Ubiquitous Computing Systems, Nov. 2004.
10 J. Hannuksela, P. Sangi, and J. Heikkila, "A Vision-Based Approach for Controlling User Interfaces of Mobile Devices," in Proc. IEEE CVPR, Jun. 2005.
11 F. Golshani, "TUI or GUI-It's a Matter of Somatics," IEEE Multimedia, vol.14, no.1, pp.104-104, Jan. 2007.   DOI   ScienceOn
12 J. Brand and J. S. Mason, "A comparative assessment of three approaches to pixel-level human skin-detection," in Proc. International Conference on Pattern Recognition, pp. 1056-1059, Sep. 2000.
13 Jefferson Y. Han, "Low-cost multi-ouch sensing through frustrated total internal reflection," in Proceedings of the 18th annual ACM symposium on User interface software and technology, Oct. 2005.
14 J. I.-Siplia, M. Moberg, and O. Viiki, "Multi-Lingual Speaker-Independent Voice User Interface For Mobile Devices," in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, May 2006.
15 J. Rekimoto, "Tilting operations for small screen interfaces," in Proc. ACM Symposium on User Interfac Software and Technology, pp. 167-168, Nov. 1996.
16 ITU-T, E.161 : Arrangement of digits, letters and symbols on telephones and other devices that can be used for gaining access to a telephone network, Feb., 2001.