Browse > Article
http://dx.doi.org/10.14400/JDC.2014.12.3.255

Photo Retrieval System using Kinect Sensor in Smart TV Environment  

Choi, Ju Choel (Dept. of Business Incubator Kyung Hee University)
Publication Information
Journal of Digital Convergence / v.12, no.3, 2014 , pp. 255-261 More about this Journal
Abstract
Advances of digital device technology such as digital cameras, smart phones and tablets, provide convenience way for people to take pictures during his/her life. Photo data is being spread rapidly throughout the social network, causing the excessive amount of data available on the internet. Photo retrieval is categorized into three types, which are: keyword-based search, example-based search, visualize query-based search. The commonly used multimedia search methods which are implemented on Smart TV are adapting the previous methods that were optimized for PC environment. That causes some features of the method becoming irrelevant to be implemented on Smart TV. This paper proposes a novel Visual Query-based Photo Retrieval Method in Smart TV Environment using a motion sensing input device known as Kinect Sensor. We detected hand gestures using kinect sensor and used the information to mimic the control function of a mouse. The average precision and recall of the proposed system are 81% and 80%, respectively, with threshold value was set to 0.7.
Keywords
Multimedia Search; Social Networking Service; Visual Query; Smart TV; Kinect Sensor;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Facebook - http://www.facebook.com/
2 Instagram - http://instagram.com/
3 flickr - http://www.flickr.com/
4 M. Crampes, J. Oliveira-Kumar, S. Ranwez, J. Villerd, Visualizing social photos on a Hasse Diagram for eliciting relations and indexing new photos, IEEE Trans. Visualization and Computer Graphics, pp. 985-992, 2009.
5 K.-S. Lee, J.-G. Jung, K.-J. Oh, G.-S. Jo, U2Mind: visual semantic relationships query for retrieving photos in social network, Proceedings of the Third international conference on Intelligent information and database systems, pp. 20-22, 2011.
6 Y.-H. Lei, Y-Y. Chen, B-C.Chen L.Iida, W.H. Hsu, Where is who: Large-scale photo retrieval by facial attributes and canvas layout. In ACM SIGIR, pp. 701-710. 2012.
7 H.-N. Kim, A. E. Saddik, K.-S. Lee, Y.-H. Lee, G.-S. Jo, Photo search in a personal photo diary by drawing face position with people tagging, Proceedings of the 16th international conference on Intelligent user interfaces, pp. 13-16, 2011.
8 C. Wang, Z. Li, L. Zhang, MindFinder: Image search by interactive sketching and tagging. 19th international conference on World wide web, pp. 1309-1312, 2010.
9 H. Xu, J. Wang, X. S. Hua, S. Li, Image search by concept map, 33rd international ACM SIGIR conference on Research and development in information retrieval, pp. 275-282, 2010.
10 C. J. Choel, S.-B. Park, Social Photo Retrieval and Its Application in Smart TV, International Conference on Information Science and Applications, pp. 1-2, 2013.
11 W.-P. Lee, C. Kaoli, J.Y. Huang, A smart TV system with body-gesture control, tag-based rating and context-aware recommendation, Knowledge-Based Systems, vol.56, pp. 167-178, 2014   DOI   ScienceOn
12 openCV - http://opencv.org/
13 kinect sensor - http://www.microsoft.com/en-us/kinectforwindows/discover/features.aspx