Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

Towards Establishing a Touchless Gesture Dictionary based on User Participatory Design

  • Song, Hae-Won (Graduate School of NID Fusion Technology, Seoul National University of Science and Technology) ;
  • Kim, Huhn (Department of Mechanical System Design Engineering, Seoul National University of Science and Technology)
  • Received : 2012.07.14
  • Accepted : 2012.07.30
  • Published : 2012.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: The aim of this study is to investigate users' intuitive stereotypes on non-touch gestures and establish the gesture dictionary that can be applied to gesture-based interaction designs. Background: Recently, the interaction based on non-touch gestures is emerging as an alternative for natural interactions between human and systems. However, in order for non-touch gestures to become a universe interaction method, the studies on what kinds of gestures are intuitive and effective should be prerequisite. Method: In this study, as applicable domains of non-touch gestures, four devices(i.e. TV, Audio, Computer, Car Navigation) and sixteen basic operations(i.e. power on/off, previous/next page, volume up/down, list up/down, zoom in/out, play, cancel, delete, search, mute, save) were drawn from both focus group interview and survey. Then, a user participatory design was performed. The participants were requested to design three gestures suitable to each operation in the devices, and they evaluated intuitiveness, memorability, convenience, and satisfaction of their derived gestures. Through the participatory design, agreement scores, frequencies and planning times of each distinguished gesture were measured. Results: The derived gestures were not different in terms of four devices. However, diverse but common gestures were derived in terms of kinds of operations. In special, manipulative gestures were suitable for all kinds of operations. On the contrary, semantic or descriptive gestures were proper to one-shot operations like power on/off, play, cancel or search. Conclusion: The touchless gesture dictionary was established by mapping intuitive and valuable gestures onto each operation. Application: The dictionary can be applied to interaction designs based on non-touch gestures. Moreover, it will be used as a basic reference for standardizing non-touch gestures.

Keywords

References

  1. Cho, S. I., Hong S. Y., Hong, J. Y., Yang, K. I., Jang, G. Y. and Choi, J. H., Study on Input Method of Smart TV Depending on Operation Command, HCI 2012, 631-634, 2012.
  2. Epps, J., Lichman, S. and Wu, M., A Study of Hand Shape Use in Tabletop Gesture Interaction, CHI Conference on Human Factors in Computing Systems, 748-753, Montreal, Quebec, Canada, April 22-27, 2006.
  3. Helman, I. S., Jane, P. W. and Yael, E., Optimal Consensus Intuitive Hand Gesture Vocabulary Design, IEEE International Conference on Semantic Computing, 96-103, 2008.
  4. Hummels, C. and Stapers, P. J., Meaningful Gestures for Human Computer Interaction: Beyond Hand Postures, Proceeding of the 3rd International Conference on Automatic Face & Gesture Recognition, 591-596, Nara, Japan, April 14-16.IEEE Computer Society Press, Los Alamitos, CA. 1998.
  5. Jaime, R., Yang. L. and Edward, L., User-defined Motion Gesture for Mobile Interaction, CHI'11 Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, 2011.
  6. Karam, M. and Schraefel, M. C., A Taxonomy of Gestures in Human Computer Interaction, Technical Report ECSTR-IAM05-009, Electronics and Computer science, University of Southampton, 2005.
  7. Kim, D. H. and Kim, D. J., An Intelligent Smart Home Control Using Body Gestures, In the Proceedings of International Conference on Hybrid Information Technology, IEEE. Korea. 2006.
  8. Kim, D. H., Cho, S. H., Cheon, Y, J. and Kim, D. J., A Hand Gesture Recognition Method for An Intelligent Smart Home TV Remote Control System, Korean Institute of Information Science and Engineers. vol. 34, No. 2(C), 2007.
  9. Kim, H., Interacting with Touchless Gestures: Taxonomy and Requirements, Journal of the Ergonomics Society of Korea, This volume, 2012.
  10. Kim, H. and Song, H. W., The Safety Usability of Operating In-Vehicle Information System with Touch Gesture, Applied Ergonomics, To be appeared in 2012.
  11. Kim, H. S., Hwang, S. W. and Moon, H. J., A Study on Vision Based Gesture Recognition Interface Design for Digital TV, Journal of Korean Society of Design Science, Vol. 20, No. 3, 257-268, 2007.
  12. Kray, C., Nesitt, D, Dawson, J. and Rohs, M., User-Defined Gestures for Connecting Mobile Phone, Public Display, and Table Tops, In Proceeding Mobile HCI, 239-248, 2010.
  13. Lee, S., Kim, S., Jin, B., Choi, E., Kim, B., Jia, X., Kim, D. and Lee, K., How Users Manipulate Deformable Displays as Input Devices, CHI 2010, pp.1647-1656, April 10-15, Atlanta, GA, USA, 2010.
  14. Morris, M., Wobbrock, J. and Wilson, A., Understanding Users Preferences for surface gestures, In Proceeding GI, pp. 261-268, Canadian Information Processing Society, 2010.
  15. Nielsen, M. Storring, M., Moeslund, T. B. and Granum, E., A Procedure for Developing Intuitive and Ergonomic Gesture Interface for HCI, In: Gesture-Based Communication in Human-Computer Interaction, 105-106, 2004.
  16. Pavlovic, I. V., Sharna, R. and Huang, S. T., Visual Interpretation of Hand Gestures for Human-Computer Interaction, IEEE Transactions on Patiern Analysis and Machine Intelligence, Vol. 19, No. 7, 1997.
  17. Saffer, D., Designing Gestural Interfaces, O'Reilly Media, Inc., 2009.
  18. Song, H. W., Establishing a Design Guide of Gestures for Touchless Interactions, Unpublished Master's Thesis in Seoul National University of Science and Technology, 2012.
  19. Stossel, C., Familiarity as a factor in designing finger gestures for elderly users, Mobile HCI'09, Bonn, Germany, September 15-18, 2009.
  20. Stossel, C. and Blessing, L., Mobil Device Interaction Gestures for Older Users, Nordi CHI, Reykjavik, Iceland, October 16-20, 2010.
  21. Wigdor, D. and Wixon, D., Brave NUI World, Morgan Kaufmann, 2011.
  22. Wobbrock, J. O., Morris, M. R. and Wilson, A. D., User-defined Gestures for Surface Computing, In Pros, CHI, ACM Press, 1083-1092, 2009.