Broadcasting and Media Magazine (방송과미디어)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

착용형 증강현실 기반 상호작용을 위한 비접촉식 손 자세 추정 기술의 현황과 전망

  • Published : 2014.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

Keywords

References

  1. 3 Gear Systems, [Online]. Available: http://http://www.threegear.com/
  2. Creative Senz3D, [Online]. Available: http://us.creative.com/p/web-cameras/creative-senz3d
  3. Kinect for windows, [Online]. Available: http://www.microsoft.com/en-us/kinectforwindows/
  4. Leap motion controller, [Online]. Available: https://www.leapmotion.com/
  5. Myo, [Online]. Available: https://www.thalmic.com/en/myo/
  6. R. T. Azuma, "A survey of augmented reality," Presence, vol. 6, no. 4, pp. 355 -385, 1997.
  7. L. Ballan, A. Taneja, J. Gall, L. Van Gool, and M. Pollefeys, "Motion capture of hands in action using discriminative salient points," in Computer Vision ECCV 2012, ser. Lecture Notes in Computer Science, A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, Eds. Springer Berlin Heidelberg, 2012, vol. 7577, pp. 640- 653.
  8. H. Benko, R. Jota, and A. Wilson, "Miragetable: Freehand interaction on a projected augmented reality tabletop," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '12.New York, NY, USA: ACM, 2012, pp. 199 -208.
  9. F. Coleca, S. Klement, T. Martinetz, and E. Barth, "Real-time skeleton tracking for embedded systems," pp. 86 671X -86 671X- 8, 2013.
  10. F. Coleca, T. Martinetz, and E. Barth, "Gesture interfaces with depth sensors," in Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, ser. Lecture Notes in Computer Science, M. Grzegorzek, C. Theobalt, R. Koch, and A. Kolb, Eds. Springer Berlin Heidelberg, 2013, vol. 8200, pp. 207 -227.
  11. M. de La Gorce, D. Fleet, and N. Paragios, "Model-based 3d hand pose estimation from monocular video," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 33, no. 9, pp. 1793- 1805, Sept 2011.
  12. M. de La Gorce, N. Paragios, and D. Fleet, "Model-based hand tracking with texture, shading and self-occlusions," in Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, June 2008, pp. 1 -8.
  13. M. de La Gorce and N. Paragios, "A variational approach to monocular hand-pose estimation," Computer Vision and Image Understanding, vol. 114, no. 3, pp. 363-372, 2010. https://doi.org/10.1016/j.cviu.2009.09.004
  14. L. Dipietro, A. Sabatini, and P. Dario, "A survey of glove-based systems and their applications," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 38, no. 4, pp. 461 -482, July 2008.
  15. P. Douvantzis, I. Oikonomidis, N. Kyriazis, and A. Argyros, "Dimensionality reduction for efficient single frame hand pose estimation," in Computer Vision Systems, ser. Lecture Notes in Computer Science, M. Chen, B. Leibe, and B. Neumann, Eds. Springer Berlin Heidelberg, 2013, vol. 7963, pp. 143 -152.
  16. A. Erol, G. Bebis, M. Nicolescu, R. D. Boyle, and X. Twombly, "Vision-based hand pose estimation: A review," Computer Vision and Image Understanding, vol. 108, no. 12, pp. 52-73, 2007, special Issue on Vision for Human- Computer Interaction. https://doi.org/10.1016/j.cviu.2006.10.012
  17. G. Hackenberg, R. McCall, and W. Broll, "Lightweight palm and finger tracking for real-time 3d gesture control," in Virtual Reality Conference (VR), 2011 IEEE, March 2011, pp. 19 26.
  18. H. Hamer, K. Schindler, E. Koller-Meier, and L. Van Gool, "Tracking a hand manipulating an object," in Computer Vision, 2009 IEEE 12th International Conference on, Sept 2009, pp. 1475- 1482.
  19. C. Harrison, H. Benko, and A. D. Wilson, "Omnitouch: Wearable multitouch interaction everywhere," in Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, ser. UIST '11. New York, NY, USA: ACM, 2011, pp. 441- 450.
  20. O. Hilliges, S. Izadi, A. D. Wilson, S. Hodges, A. Garcia-Mendoza, and A. Butz, "Interactions in the air: Adding further depth to interactive tabletops," in Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, ser. UIST '09. New York, NY, USA: ACM, 2009, pp. 139- 148.
  21. O. Hilliges, D. Kim, S. Izadi, M. Weiss, and A. Wilson, "Holodesk: Direct 3d interactions with a situated see-through display," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '12. New York, NY, USA: ACM, 2012, pp. 2421 -2430.
  22. C. Keskin, F. Kirac, Y. Kara, and L. Akarun, "Real time hand pose estimation using depth sensors," in Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, Nov 2011, pp. 1228 -1234.
  23. C. Keskin, F. Kra, Y. Kara, and L. Akarun, "Hand pose estimation and hand shape classification using multi-layered randomized decision forests," in Computer Vision ECCV 2012, ser. Lecture Notes in Computer Science, A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, Eds. Springer Berlin Heidelberg, 2012, vol. 7577, pp. 852- 863.
  24. D. Kim, O. Hilliges, S. Izadi, A. D. Butler, J. Chen, I. Oikonomidis, and P. Olivier, "Digits: Freehand 3d interactions anywhere using a wrist-worn gloveless sensor," in Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, ser. UIST '12. New York, NY, USA: ACM, 2012, pp. 167 -176.
  25. J. Lee, A. Olwal, H. Ishii, and C. Boulanger, "Spacetop: Integrating 2d and spatial 3d interactions in a see-through desktop environment," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '13. New York, NY, USA: ACM, 2013, pp. 189 -192.
  26. M. Lee, R. Green, and M. Billinghurst, "3d natural hand interaction for ar applications," in Image and Vision Computing New Zealand, 2008. IVCNZ 2008. 23rd International Conference, Nov 2008, pp. 1 -6.
  27. T. Lee and T. Hollerer, "Handy ar: Markerless inspection of augmented reality objects using fingertip tracking," in Wearable Computers, 2007 11th IEEE International Symposium on, Oct 2007, pp. 83 -90.
  28. C. Li and K. Kitani, "Pixel-level hand detection in ego-centric videos," in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, June 2013, pp. 3570 -3577.
  29. J. Lin, Y. Wu, and T. Huang, "Modeling the constraints of human hand motion," in Human Motion, 2000. Proceedings. Workshop on, 2000, pp. 121 -126.
  30. S. Melax, L. Keselman, and S. Orsten, "Dynamics based 3d skeletal hand tracking," in Proceedings of Graphics Interface 2013, ser. GI '13. Toronto, Ont., Canada, Canada: Canadian Information Processing Society, 2013, pp. 63 -70.
  31. P. Mistry and P. Maes, "Sixthsense: A wearable gestural interface," in ACM SIGGRAPH ASIA 2009 Sketches, ser. SIGGRAPH ASIA '09. New York, NY, USA: ACM, 2009, pp. 11:1 -11:1.
  32. S. Mitra and T. Acharya, "Gesture recognition: A survey," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 37, no. 3, pp. 311 -324, May 2007. https://doi.org/10.1109/TSMCC.2007.893280
  33. I. Oikonomidis, N. Kyriazis, and A. Argyros, "Full dof tracking of a hand interacting with an object by modeling occlusions and physical constraints," in Computer Vision (ICCV), 2011 IEEE International Conference on, Nov 2011, pp. 2088- 2095.
  34. I. Oikonomidis, N. Kyriazis, and A. Argyros, "Tracking the articulated motion of two strongly interacting hands," in Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, June 2012, pp. 1862 -1869.
  35. I. Oikonomidis, N. Kyriazis, and A. A. Argyros, "Efficient model-based 3d tracking of hand articulations using kinect." in BMVC, 2011, pp. 1 -11.
  36. I. Oikonomidis, N. Kyriazis, and A. Argyros, "Markerless and efficient 26-dof hand pose recovery," in Computer Vision ACCV 2010, ser. Lecture Notes in Computer Science, R. Kimmel, R. Klette, and A. Sugimoto, Eds. Springer Berlin Heidelberg, 2011, vol. 6494, pp. 744- 757.
  37. V. F. Pamplona, L. A. Fernandes, J. L. Prauchner, L. P. Nedel, and M. M. Oliveira, "The image-based data glove," in Proc. of the 10th Symposium on Virtual and Augmented Reality, SVR, 2008.
  38. G. Park, T. Ha, and W. Woo, "Hand tracking with a near-range depth camera for virtual object manipulation in an wearable augmented reality," in Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments, ser. Lecture Notes in Computer Science, R. Shumaker and S. Lackey, Eds. Springer International Publishing, 2014, vol. 8525, pp. 396-405.
  39. T. Piumsomboon, A. Clark, and M. Billinghurst, "Physically-based Interaction for Tabletop Augmented Reality Using a Depth-sensing Camera for Environment Mapping," in Proc. Image and Vision Computing New Zealand (IVCNZ-2011), Auckland, Dec 2011, pp. 161 -166.
  40. V. Prisacariu and I. Reid, "Pwp3d: Real-time segmentation and tracking of 3d objects," in Proceedings of the 20th British Machine Vision Conference, September 2009.
  41. V. A. Prisacariu and I. Reid, "3d hand tracking for human computer interaction," Image and Vision Computing, vol. 30, no. 3, pp. 236- 250, 2012, best of Automatic Face and Gesture Recognition 2011.
  42. J. Romero, H. Kjellstrom, and D. Kragic, "Monocular real-time 3d articulated hand pose estimation," in Humanoid Robots, 2009. Humanoids 2009. 9th IEEE-RAS International Conference on, Dec 2009, pp. 87 -92.
  43. J. Romero, H. Kjellstrom, and D. Kragic, "Hands in action: real-time 3d reconstruction of hands in interaction with objects," in Robotics and Automation (ICRA), 2010 IEEE International Conference on, May 2010, pp. 458 -463.
  44. D. W. Seo and J. Y. Lee, "Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences," Expert Systems with Applications, vol. 40, no. 9, pp. 3784 -3793, 2013. https://doi.org/10.1016/j.eswa.2012.12.091
  45. R. Sodhi, H. Benko, and A. Wilson, "Lightguide: Projected visualizations for hand movement guidance," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '12. New York, NY, USA: ACM, 2012, pp. 179 188.
  46. T. Starner, S. Mann, B. Rhodes, J. Levine, J. Healey, D. Kirsch, R. W. Picard, and A. Pentland, "Augmented reality through wearable computing," Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 386 -398, 1997. https://doi.org/10.1162/pres.1997.6.4.386
  47. A. State, F. Coleca, E. Barth, and T. Martinetz, "Hand tracking with an extended self-organizing map," in Advances in Self-Organizing Maps, ser. Advances in Intelligent Systems and Computing, P. A. Estvez, J. C. Prncipe, and P. Zegers, Eds. Springer Berlin Heidelberg, 2013, vol. 198, pp. 115- 124.
  48. B. Stenger, A. Thayananthan, P. H. Torr, and R. Cipolla, "Estimating 3d hand pose using hierarchical multi-label classification," Image and Vision Computing, vol. 25, no. 12, pp. 1885 -1894, 2007. https://doi.org/10.1016/j.imavis.2005.12.018
  49. J. Suarez and R. Murphy, "Hand gesture recognition with depth images: A review," in RO-MAN, 2012 IEEE, Sept 2012, pp. 411- 417.
  50. D. Tang, H. J. Chang, A. Tejani, and T.-K. Kim, "Latent regression forest: Structured estimation of 3d articulated hand posture." (in press)
  51. D. Tang, T.-H. Yu, and T.-K. Kim, "Real-time articulated hand pose estimation using semi-supervised transductive regression forests," in Computer Vision (ICCV), 2013 IEEE International Conference on, Dec 2013, pp. 3224 -3231.
  52. J. P. Wachs, M. Kolsch, H. Stern, and Y. Edan, "Vision-based hand-gesture applications," Commun. ACM, vol. 54, no. 2, pp. 60-71, Feb. 2011.
  53. R. Wang, S. Paris, and J. Popovic, "6d hands: Markerless hand-tracking for computer aided design," in Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, ser. UIST '11. New York, NY, USA: ACM, 2011, pp. 549- 558.
  54. R. Y. Wang and J. Popovic, "Real-time hand-tracking with a color glove," in ACM SIGGRAPH 2009 Papers, ser. SIGGRAPH '09. New York, NY, USA: ACM, 2009, pp. 63:1- 63:8.
  55. A. D. Wilson, "Robust computer vision-based detection of pinching for one and two-handed gesture input," in Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, ser. UIST '06. New York, NY, USA: ACM, 2006, pp. 255 -258.
  56. A. D. Wilson, "Using a depth camera as a touch sensor," in ACM International Conference on Interactive Tabletops and Surfaces, ser. ITS '10. New York, NY, USA: ACM, 2010, pp. 69 -72.