Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

Investigating Smart TV Gesture Interaction Based on Gesture Types and Styles

  • Ahn, Junyoung (Hongik University, Department of Industrial Engineering) ;
  • Kim, Kyungdoh (Hongik University, Department of Industrial Engineering)
  • Received : 2016.10.21
  • Accepted : 2017.02.20
  • Published : 2017.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: This study aims to find suitable types and styles for gesture interaction as remote control on smart TVs. Background: Smart TV is being developed rapidly in the world, and gesture interaction has a wide range of research areas, especially based on vision techniques. However, most studies are focused on the gesture recognition technology. Also, not many previous studies of gestures types and styles on smart TVs were carried out. Therefore, it is necessary to check what users prefer in terms of gesture types and styles for each operation command. Method: We conducted an experiment to extract the target user manipulation commands required for smart TVs and select the corresponding gestures. To do this, we looked at gesture styles people use for every operation command, and checked whether there are any gesture styles they prefer over others. Through these results, this study was carried out with a process selecting smart TV operation commands and gestures. Results: Eighteen TV commands have been used in this study. With agreement level as a basis, we compared the six types of gestures and five styles of gestures for each command. As for gesture type, participants generally preferred a gesture of Path-Moving type. In the case of Pan and Scroll commands, the highest agreement level (1.00) of 18 commands was shown. As for gesture styles, the participants preferred a manipulative style in 11 commands (Next, Previous, Volume up, Volume down, Play, Stop, Zoom in, Zoom out, Pan, Rotate, Scroll). Conclusion: By conducting an analysis on user-preferred gestures, nine gesture commands are proposed for gesture control on smart TVs. Most participants preferred Path-Moving type and Manipulative style gestures based on the actual operations. Application: The results can be applied to a more advanced form of the gestures in the 3D environment, such as a study on VR. The method used in this study will be utilized in various domains.

Keywords

References

  1. Baudel, T. and Beaudouin-Lafon, M., Charade: remote control of objects using free-hand gestures, Communications of the ACM, 36(7), 28-35, 1993. https://doi.org/10.1145/159544.159562
  2. Bolt, R.A. and Herranz, E., Two-handed gesture in multi-modal natural dialog, In Proceedings of the 5th annual ACM symposium on User interface software and technology, 7-14, ACM, 1992.
  3. Cesar, P. and Chorianopoulos, K., The evolution of TV systems, content, and users toward interactivity, Foundations and Trends in Human-Computer Interaction, 2(4), 279-373, 2009.
  4. Choi, E., Kwon, S., Lee, D., Lee, H. and Chung, M.K., Can user-derived gesture be considered as the best gesture for a command?: Focusing on the commands for smart home system, In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 56(1), 1253-1257, 2012.
  5. Karam, M. and Schraefel, M.C., A taxonomy of gestures in human computer interactions, 2005.
  6. Kettebekov, S., Exploiting prosodic structuring of coverbal gesticulation, In Proceedings of the 6th international conference on Multimodal interfaces, ACM, 105-112, 2004.
  7. Kim, H.J., A study on plan for top-down gestures design through gesture interaction case analysis. Journal of Digital Design, 14(2), 439-449, 2014. https://doi.org/10.17280/jdd.2014.14.2.041
  8. Krum, D.M., Omoteso, O., Ribarsky, W., Starner, T. and Hodges, L.F., Speech and gesture multimodal control of a whole Earth 3D visualization environment, 2002.
  9. Lee, H.R. and Lee, W.H., A Study on user experience design for efficient control of Smart TV. Journal of the Korea Society of Computer and Information, 18(1), 43-53, 2013. https://doi.org/10.9708/jksci.2013.18.1.043
  10. Lee, S.H., Sohn, M.K., Kim, D.J., Kim, B. and Kim, H., Smart tv interaction system using face and hand gesture recognition, In Consumer Electronics (ICCE), 2013 IEEE International Conference, 173-174, 2013.
  11. Lee, S.S., Maeng, S., Kim, D., Lee, K.P., Lee, W., Kim, S. and Jung, S., FlexRemote: Exploring the effectiveness of deformable user interface as an input device for TV, In International Conference on Human-Computer Interaction, Springer Berlin Heidelberg, 62-65, 2011.
  12. Liang, J. and Green, M., JDCAD: A highly interactive 3D modeling system, Computers & Graphics, 18(4), 499-506, 1994. https://doi.org/10.1016/0097-8493(94)90062-0
  13. Miller, G.A., The magical number seven, plus or minus two: some limits on our capacity for processing information, Psychological Review, 63(2), 81, 1956. https://doi.org/10.1037/h0043158
  14. Park, W. and Han, S.H., Intuitive multi-touch gestures for mobile web browsers, Interacting with Computers, 25(5), 335-350, 2013. https://doi.org/10.1093/iwc/iws026
  15. Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C., McCullough, K.E. and Ansari, R., Multimodal human discourse: gesture and speech, ACM Transactions on Computer-Human Interaction (TOCHI), 9(3), 171-193, 2002. https://doi.org/10.1145/568513.568514
  16. Shin, D.H., Hwang, Y. and Choo, H., Smart TV: are they really smart in interacting with people? Understanding the interactivity of Korean Smart TV, Behaviour & Information Technology, 32(2), 156-172, 2013. https://doi.org/10.1080/0144929X.2011.603360
  17. Shin, Y.K. and Choe, J.H., Remote Control Interaction for Individual Environment of Smart TV. Journal of the Korea Contents Association, 11(11), 70-78, 2011. https://doi.org/10.5392/JKCA.2011.11.11.070
  18. Vatavu, R.D., User-defined gestures for free-hand TV control, In Proceedings of the 10th European conference on Interactive tv and video, ACM, 45-48, 2012.
  19. Vatavu, R.D. and Zaiti, I.A., Leap gestures for TV: insights from an elicitation study, In Proceedings of the 2014 ACM international conference on Interactive experiences for TV and online video, ACM, 131-138, 2014.
  20. Wang, S.C., Chung, T.C. and Yan, K.Q., A new territory of multi-user variable remote control for interactive TV, Multimedia Tools and Applications, 51(3), 1013-1034, 2011. https://doi.org/10.1007/s11042-009-0435-0
  21. Wobbrock, J.O., Aung, H.H., Rothrock, B. and Myers, B.A., Maximizing the guessability of symbolic input, In CHI'05 extended abstracts on Human Factors in Computing Systems, ACM, 1869-1872, 2005.
  22. Zhai, S. and Milgram, P., Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices, In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 320-327, 1998.