Journal of Korean Institute of Industrial Engineers (대한산업공학회지)

Korean Institute of Industrial Engineers (대한산업공학회)
권호 표지
DOI QR코드

DOI QR Code

Design of Hand Gestures for Smart Home Appliances based on a User Centered Approach

스마트홈 내 기기와의 상호작용을 위한 사용자 중심의 핸드 제스처 도출

  • Choi, Eun-Jung (Department of Industrial and Management Engineering Pohang University of Science and Technology) ;
  • Kwon, Sung-Hyuk (Department of Industrial and Management Engineering Pohang University of Science and Technology) ;
  • Lee, Dong-Hun (Department of Industrial and Management Engineering Pohang University of Science and Technology) ;
  • Lee, Ho-Jin (Department of Industrial and Management Engineering Pohang University of Science and Technology) ;
  • Chung, Min-K. (Department of Industrial and Management Engineering Pohang University of Science and Technology)
  • 최은정 (포항공과대학교 산업경영공학과) ;
  • 권성혁 (포항공과대학교 산업경영공학과) ;
  • 이동훈 (포항공과대학교 산업경영공학과) ;
  • 이호진 (포항공과대학교 산업경영공학과) ;
  • 정민근 (포항공과대학교 산업경영공학과)
  • Received : 2012.03.05
  • Accepted : 2012.05.19
  • Published : 2012.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

With the progress of both wire and wireless home networking technology, various projects on smart home have been carried out in the world (Harper, 2003), and at the same time, new approaches to interact with smart home systems efficiently and effectively have also been investigated. A gesture-based interface is one of these approaches. Especially with advance of gesture recognition technologies, a variety of research studies on gesture interactions with the functions of IT devices have been conducted. However, there are few research studies which suggested and investigated the use of gestures for controlling smart home appliances. In this research the gestures for selected smart home appliances are suggested based on a user centered approach. A total of thirty-eight functions were selected, and a total of thirty participants generated gestures for each function. Based on the Nielsen (2004), Lee et al. (2010) and Kuhnel et al. (2011), the gesture with the highest frequency for each function (Top gesture) has been suggested and investigated.

Keywords

References

  1. Akers, D. (2006), Wizard of oz for participatory design : Inventing a gestural interface for 3d selection of neural pathway estimates, AbstractsCHI.
  2. Bhuiyan, M. and Picking, R. (2011), A gesture controlled user interface for inclusive design and evaluative study of its usability, Journal of software engineering and applications, 4, 513-521. https://doi.org/10.4236/jsea.2011.49059
  3. Chen, Q., Cordea, M. D., Petriu, E. M., VarkonyiKoczy, A. R., and Whalen, T. E. (2009), Human-computer interaction for smart environment applications using hand-gestures and facial expressions, International Journal of Advanced Media and Communication, 3, 95-109. https://doi.org/10.1504/IJAMC.2009.026854
  4. Choi, J., Shin, D., and Shin, D. (2005), Research and implementation of the context-aware middleware for controlling home appliance, IEEE Transactions on Consumer Electronics, 51(1), 301-306. https://doi.org/10.1109/TCE.2005.1405736
  5. Dipietro, L. and Sabatini, A. M. (2008), A survey of glove-based systems and their applications, IEEE transactions on systems, man, and cybernetics-part C : Applications and reviews, 38(4), 461- 482.
  6. Do, J. H., Jung, J. W., Jung, S. H., Jang, H., and Bien, X. (2006), Advanced soft remote control system using hand gesture, MICAI : advanced in artificial intelligence, 4293, 745-755.
  7. Epps, J., Lichman, S., and Wu, M.(2006), A study of hand shape use in tabletop gesture interaction, Proceedings of abstractsCHI, 748-753.
  8. Grandhi S. A., Joue, G., Mittelberg, I., and Jarke, M. (2010), Designing touchless gesture-based interfaces for human computer interaction : Insights from coverbal gestures, Proceedings of CHI.
  9. Harper, R. (2003), Inside the Smart Home, Springer.
  10. Henz, N., Locken, A., Boll, S., Hesselmann, T., and Pielot M. (2010), Free-hand gestures for music playback : deriving gestures with a user-centered process, Proceedings of the international conference on Mobile and Ubiquitous Multimedia.
  11. Hurtienne, J., Weber, K., and Blessing, L. (2008), Prior experience and intuitive use: Image schemas in user centered design, In : Langdon, P., Clarkson, J., Robinson, P. (Eds.), Designing Inclusive Futures Springer, London, 107-116.
  12. James, A. and Sebe, N. (2007), Multimodal human-computer interaction : A survey, Computer Vision and Image Understanding, 108(1-2), 116-134. https://doi.org/10.1016/j.cviu.2006.10.019
  13. Kim, H. J., Jeoung, K. H., Kim, S. K., and Han, T. D. (2011), Ambient Wall : Smart wall display interface which can be controlled by simple gesture for smart home, SIGGRAPH Asia.
  14. Kohler, M. R. J. (1997), System Architecture and Techniques for Gesture Recognition in Unconstraint Environments, Proceedings of Intelligent conference on virtual systems and multimedia, 137-146.
  15. Kuhnel, C., Westermann, T., Hemmert, F., Kratz, S., Muller, A., and Moller, S. (2011), I'm home : Defining and evaluating a gesture set for smart-home control, International Journal of Human-Computer Studies, 693-704.
  16. Lee, D., Lee, H., and Chung, M. K. (2011), An analysis of time use on activities of daily living : Considering korean adults in seoul, Journal of the Korean Institute of Industrial Engineers, 37(2), 105-117. https://doi.org/10.7232/JKIIE.2011.37.2.105
  17. Lee S., Kim, S., Jin, B., Choi, E., Kim, B., Jia, X., Kim, D., and Lee, K. (2010), How users manipulate deformable displays as input devices, Proceedings of CHI, 1647-1656.
  18. Liu, J., Pinelle, D., Sallam, S., Subramanian, S., and Gutwin, C. (2006), TNT : Improved rotation and translation on digital tables, Proceedings of Graphic Interface, 25-32.
  19. Mauney, D., Howarth, J, Wirtanen, A., and Capra, M. (2010), Cultural similarities and differences in user-defined gesrtures for touchscreen user Interfaces, Proceedings of CHI.
  20. Mitchell, T. and Heap, I. (2011), SoundGrasp : A gestural interface for the performance of live Music, Proceedings of the International Conference on New Interfaces for Musical Expression.
  21. NeBelrath, R., Lu, C., Schulz, C.H., Frey, J., and Alexandersson, J. (2011), A gesture based system for context-sensitive interaction with smart homes, Deutscher AAL-Kongress.
  22. Ng, W., Ng, C., Noordin, N. K., and Ali, B. M. (2011), Gesture based automating household appliances, Human Computer Interaction, Interaction techniques and environments lecture notes in computer science, 67(62), 285-293.
  23. Nielsen, M., Moeslund, T., Storring, T., and Granum, E. (2003), A procedure for developing intuitive and ergonomic gesture interfaces for man-machine interaction, Technical Report CVMT 03-01.
  24. Nielsen, M., Storring, T., Moeslund, T., and Granum, E. (2004), A procedure for developing intuitive and ergonomic gesture interfaces for HCI, In Gesture-Based Communication in Human-Computer Interaction, 105-106.
  25. Norman, D. (1998), Affordances and design, Proceeding of ACM SIGCHI Human Factors (Open discussion).
  26. Ouchi, K., Esaka, N, Tamura, Y, Hiraharam, M., and Doi, M. (2005), Magic Wand : An intuitive gesture remote control for home appliances, Proceedings of the international conference on Active Media Technology, 274.
  27. Pan, G., Wu, J., Zhang, D., Wu, Z., Yang, Y., and Li, S. (2010), GeeAir : A universal multimodal remote control device for home appliances, Personal and Ubiquitous Computing, 14(8), 723-735. https://doi.org/10.1007/s00779-010-0287-7
  28. Park, W. (2012), A multi-touch gesture vocabulary design methodolgy for mobile devices, Doctoral thesis, Division of Mechanical and Industrial Engineering POSTECH, Pohang, Korea.
  29. Rahman, A. S. M. M., Hossain, M. A., Parra, J., and Saddik, A. E. (2009), Motion-Path based Gesture Interaction with Smart Home Services, Proceeding of the 1st ACM international conference on Multimedia.
  30. Saffer, D. (2008), Designing Gestural Interfaces : Touchscreens and interactive devices, O'Reilly Media, Inc.
  31. Wilson, A. and Shafer, S. (2003), Xwand : UI for intelligent spaces, Proceedings of the SIGCHI conference on Human factors in computing systems, 1(5), 545-552.
  32. Seifried, T., Haller, M., Scott, S. D., Perteneder, F., Rendl, C., Sakamoto, D., and Inami, M. (2009), Cristal : A collaborative home media and device controller based on a multi-touch display, Proceedings of the international conference on interactive tabletops and surfaces, 37-44.
  33. Stephen, S. (2006), The Goal : Smart People, Not Smart Homes, 4th International Conference on Smarthomes and health Telematics (ICOST2006), 19, 3-6.
  34. Stern, H. I., Wachs, J. P., and Edan, Y. (2008), Optimal consensus intuitive hand gesture vocabulary design, IEEE International Conference on Semantic Computing, 96-103.
  35. Tao G., Pung, H. K., and Zhang, D. O. (2004), Toward an OSGi-based infrastructure for context-aware application, IEEECS and IEEECom Soc, 66-74.
  36. Tversky, B., Kugelmass, S., and Winter, A. (1991), Cross-cultural and developmental trends in graphic productions, Cognitive Psychology, 23(4), 515-557. https://doi.org/10.1016/0010-0285(91)90005-9
  37. Wexelblat, A. (1998), Research challenges in gesture : Open issues and unsolved problems. Proceeding of Int. Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction, 1-11.
  38. Wobbrock, J. O., Morris, M. R., and Wilson, A. D. (2009), User-defined gestures for surface computing, Proceedings of CHI., 1083-1092.

Cited by

  1. Mouse Gesture Design Based on Mental Model vol.39, pp.3, 2013, https://doi.org/10.7232/JKIIE.2013.39.3.163
  2. Mobile Interaction Using Smartphones and Kinect in a Global Space vol.40, pp.1, 2014, https://doi.org/10.7232/JKIIE.2014.40.1.100
  3. AHD: Thermal Image-Based Adaptive Hand Detection for Enhanced Tracking System vol.6, pp.2169-3536, 2018, https://doi.org/10.1109/ACCESS.2018.2810951