DOI QR코드

DOI QR Code

Development of Finger Gestures for Touchscreen-based Web Browser Operation

터치스크린 기반 웹브라우저 조작을 위한 손가락 제스처 개발

  • Nam, Jong-Yong (Package Engineering Team1, Hyundai-Kia Corporate Research & Development Division) ;
  • Choe, Jae-Ho (Department of Industrial & Systems Engineering, Daejin University) ;
  • Jung, Eui-S. (Division of Industrial Systems and Information Engineering, Korea University)
  • 남종용 (현대자동차 남양연구소) ;
  • 최재호 (대진대학교 산업시스템공학과) ;
  • 정의승 (고려대학교 경영정보공학과)
  • Published : 2008.11.30

Abstract

Compared to the existing PC which uses a mouse and a keyboard, the touchscreen-based portable PC allows the user to use fingers, requiring new operation methods. However, current touchscreen-based web browser operations in many cases involve merely having fingers move simply like a mouse and click, or not corresponding well to the user's sensitivity and the structure of one's index finger, making itself difficult to be used during walking. Therefore, the goal of this study is to develop finger gestures which facilitate the interaction between the interface and the user, and make the operation easier. First, based on the frequency of usage in the web browser and preference, top eight functions were extracted. Then, the users' structural knowledge was visualized through sketch maps, and the finger gestures which were applicable in touchscreens were derived through the Meaning in Mediated Action method. For the front/back page, and up/down scroll functions, directional gestures were derived, and for the window closure, refresh, home and print functions, letter-type and icon-type gestures were drawn. A validation experiment was performed to compare the performance between existing operation methods and the proposed one in terms of execution time, error rate, and preference, and as a result, directional gestures and letter-type gestures showed better performance than the existing methods. These results suggest that not only during the operation of touchscreen-based web browser in portable PC but also during the operation of telematics-related functions in automobile, PDA and so on, the new gestures can be used to make operation easier and faster.

Keywords

References

  1. 김기성, 이상선 (2006), 소형 디스플레이의 손가락 기반 터치스크린 UI에 관한 연구, 한국디자인학회 2006 춘계학술대회, 10-11
  2. 박재규, 정의승, 명노해 (2005), 웹브라우저 상에서의 Mouse gesture의 개발, 한국HCI학회, HCI2005 학술대회
  3. Bourges-Waldegg, P. and Scrivener, S. A. R. (2000), Applying and testing an approach to design for culturally diverse user groups, Interacting with Computers, Vol.13, No.2, 111-126 https://doi.org/10.1016/S0953-5438(00)00029-1
  4. Buxton, W. (1995), Touch, gesture and marking. Chapter7 in R.M. Baeker, J. Grudin, W. Buxton and S. Greenberg (Eds.), Readings in human computer interaction: Towards the year 2000, San Francisco:Morgan Kaufmann Publishers
  5. Cnet news (2002), Building a better computer mouse, [online] http://news.com.com (Accessed 2002. 10. 2)
  6. David, M., (1992), Hand and Mind: What Gestures Reveal about Thought, New ed Edition, University of Chicago Press, 75-78
  7. Green, P., Levison, W., Paelke, G. and Serafin, C. (1994), Suggested Human Factors Design Guidelines for Driver Information Systems, Technical Report UMTRI-93-21
  8. Hummels, C. and Stapers, P. J. (1998), Meaningful Gestures for Human Computer Interaction: Beyond Hand Postures, Proceedings of the 3rd International Conference on Automatic Face & Gesture Recognition (FG'98), Nara, Japan, April 14-16. IEEE Computer Society Press, Los Alamitos, CA. 591-596
  9. Mozilla Firefox, (2007), Mouse Gestures: Supported Gestures, [online] http://optimoz.mozdev.org/gestures/defaultmappings.html
  10. Norman, D. A. (1998), The psychology of everyday things, New York: Basic Books
  11. Pinheiro, J. Q. (1998), Determinants of Cognitive Maps of the World as Expressed in Sketch Maps, Journal of Environment Psychology, Vol.18, No.3, 321-339 https://doi.org/10.1006/jevp.1998.0100
  12. Wickens, C. D., Yili Liu, J. D. L. and Gordon Becker, S. E. (2004), An Introduction to Human Factors Engineering, 2nd Edition, Prentice- Hall Inc

Cited by

  1. Mouse Gesture Design Based on Mental Model vol.39, pp.3, 2013, https://doi.org/10.7232/JKIIE.2013.39.3.163
  2. Interacting with Touchless Gestures: Taxonomy and Requirements vol.31, pp.4, 2012, https://doi.org/10.5143/JESK.2012.31.4.475
  3. A Comparison of the Characteristics between Single and Double Finger Gestures for Web Browsers vol.31, pp.5, 2012, https://doi.org/10.5143/JESK.2012.31.5.629