Browse > Article
http://dx.doi.org/10.5909/JBE.2016.21.1.11

Human-Object Interaction Framework Using RGB-D Camera  

Baeka, Yong-Hwan (Hanyang University, Department of Computer and Software)
Lim, Changmin (Hanyang University, Department of Computer and Software)
Park, Jong-Il (Hanyang University, Department of Computer and Software)
Publication Information
Journal of Broadcast Engineering / v.21, no.1, 2016 , pp. 11-23 More about this Journal
Abstract
Recent days, touch interaction interface is the most widely used interaction interface to communicate with digital devices. Because of its usability, touch technology is applied almost everywhere from watch to advertising boards and it is growing much bigger. However, this technology has a critical weakness. Normally, touch input device needs a contact surface with touch sensors embedded in it. Thus, touch interaction through general objects like books or documents are still unavailable. In this paper, a human-object interaction framework based on RGB-D camera is proposed to overcome those limitation. The proposed framework can deal with occluded situations like hovering the hand on top of the object and also moving objects by hand. In such situations object recognition algorithm and hand gesture algorithm may fail to recognize. However, our framework makes it possible to handle complicated circumstances without performance loss. The framework calculates the status of the object with fast and robust object recognition algorithm to determine whether it is an object or a human hand. Then, the hand gesture recognition algorithm controls the context of each object by gestures almost simultaneously.
Keywords
human-object interaction; hand gesture interface; RGB-D camera; object recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Andrew D. Wilson, "Depth-sensing video cameras for 3d tangible tabletop interaction," Proceedings of Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07), pp. 201-204, 2007.
2 Matt Adcock, Stuart Anderson, and Bruce Thomas, "RemoteFusion: real time depth camera fusion for remote collaboration on physical tasks," Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Application in Industry (VRCAI'13), pp. 235-242, 2013.
3 Zoran Zivkovic, "Improved adaptive Gaussian mixture model for background subtraction," Proceedings of the 17th International Conference on Pattern Recognition (ICPR'04), Vol. 2, pp. 28-31, 2004.
4 Michael J. Swain, and Dana H. Ballard, “Color indexing,“ International Journal of Computer Vision, Vol. 7(1), pp. 11-32, 1991.   DOI
5 Berrnt Schile, and James L. Crowley, “Recognition without Correspondence using Multidimensional Receptive Field Histograms,“ International Journal of Computer Vision, Vol. 36(1), pp. 31-50, 2000.   DOI
6 Oskar Linde, and Tony Lindeberg, "Object recognition using composed receptive field histograms of higher dimensionality," Proceedings of the 17th International Conference on Pattern Recognition (ICPR'04), Vol. 2, pp. 1-6, 2004.
7 Oskar Linde, and Tony Lindeberg, “Composed complex-cue histograms: An investigation of the information content in receptive field based image descriptors for object recognition,“ Computer Vision and Image Understanding, Vol. 116(4), pp. 538-560, 2012.   DOI
8 David G. Lowe, "Object recognition from local scale-invariant features," Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV'99), Vol. 2, pp. 1150-1157, 1999.
9 David G. Lowe, “Distinctive image features from scale-invariant keypoints,“ International Journal of Computer Vision, Vol. 60(2), pp. 91-110, 2004.   DOI
10 Herbert Bay, Tinne Tuytelaars, and Luc Van Gool, "Surf: Speeded up robust features," Computer Vision-ECCV 2006, pp. 404-417, 2006.
11 Herbert Freeman, and Ruth Shapira, “Determining the minimum-area encasing rectangle for an arbitrary closed curve,“ Communications of the ACM, Vol. 18(7), pp. 409-413, 1975.   DOI
12 Junyeong Choi, Byung-Kuk Seo, Daeseon Lee, Hanhoon Park, and Jong-Il Park, "RGB-D camera-based hand shape recognition for human-robot interaction," 44th International Symposium on Robotics (ISR'13), pp. 1-2, 2013.