Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

Multi-Modal Controller Usability for Smart TV Control

  • Yu, Jeongil (Department of Industrial Management Engineering, Korea University) ;
  • Kim, Seongmin (Department of Industrial Management Engineering, Korea University) ;
  • Choe, Jaeho (Department of Industrial & Management Engineering, Daejin University) ;
  • Jung, Eui S. (Department of Industrial Management Engineering, Korea University)
  • Received : 2013.11.19
  • Accepted : 2013.12.04
  • Published : 2013.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: The objective of this study was to suggest a multi-modal controller type for Smart TV Control. Background: Recently, many issues regarding the Smart TV are arising due to the rising complexity of features in a Smart TV. One of the specific issues involves what type of controller must be utilized in order to perform regulated tasks. This study examines the ongoing trend of the controller. Method: The selected participants had experiences with the Smart TV and were 20 to 30 years of age. A pre-survey determined the first independent variable of five tasks(Live TV, Record, Share, Web, App Store). The second independent variable was the type of controllers(Conventional, Mouse, Voice-Based Remote Controllers). The dependent variables were preference, task completion time, and error rate. The experiment consist a series of three experiments. The first experiment utilized a uni-modal Controller for tasks; the second experiment utilized a dual-modal Controller, while the third experiment utilized a triple-modal Controller. Results: The first experiment revealed that the uni-modal Controller (Conventional, Voice Controller) showed the best results for the Live TV task. The second experiment revealed that the dual-modal Controller(Conventional-Voice, Conventional-Mouse combinations) showed the best results for the Share, Web, App Store tasks. The third experiment revealed that the triple-modal Controller among all the level had not effective compared with dual-modal Controller. Conclusion: In order to control simple tasks in a smart TV, our results showed that a uni-modal Controller was more effective than a dual-modal controller. However, the control of complex tasks was better suited to the dual-modal Controller. User preference for a controller differs according the Smart TV functions. For instance, there was a high user preference for the uni-Controller for simple functions while high user preference appeared for Dual-Controllers when the task was complex. Additionally, in accordance with task characteristics, there was a high user preference for the Voice Controller for channel and volume adjustment. Furthermore, there was a high user preference for the Conventional Controller for menu selection. In situations where the user had to input text, the Voice Controller had the highest preference among users while the Mouse Type, Voice Controller had the highest user preference for performing a search or selecting items on the menu. Application: The results of this study may be utilized in the design of a controller which can effectively carry out the various tasks of the Smart TV.

Keywords

References

  1. Bolt, R.A., "Put-that-there": Voice and gesture at the graphics interface, ACM, 14(3), 262-270, 1980.
  2. Cohen, P.R., Johnston, M., McGee, D., Oviatt, S.L., Clow, J. and Smith, I.A., The efficiency of multimodal interaction: a case study, In ICSLP, 1998.
  3. Cohen, P.R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I. and Clow, J., Quickset: Multimodal interaction for distributed applications, In Proceedings of the fifth ACM international conference on Multimedia, 31-40, 1997.
  4. Display Search Home page.http://www.displaysearch_releases/PR_20121026.php
  5. Jaimes, A. and Sebe, N., Multimodal human computer interaction: a survey, Computer Vision and Image Understanding, 108(1-2), 116-134, 2007. https://doi.org/10.1016/j.cviu.2006.10.019
  6. Karray, F., Alemzadeh, M., Saleh, J.A. and Arab, M.N., Human-Computer Interaction: Overview on State of the Art, International Journal on Smart and Intelligent System, 1(1), 137-159, 2008. https://doi.org/10.21307/ijssis-2017-283
  7. Kiger, J.I., The depth/breadth trade-off in the design of menu-driven user interfaces, International Journal of Man-Machine Studies, 20(2), 201-213, 1984. https://doi.org/10.1016/S0020-7373(84)80018-8
  8. Kiyomi, S., Shoicho, A., Shigeo, A., Kuniko, Y. and Akira, O., Evaluation of Viewing Distance Vs. TV Size on Visual Fatigue in a Home Viewing Environment, Consumer Electronics Digest of Technical Papers International Conference, 1-2, Las Vegas. 2009.
  9. Lim, Y.J., Park, J.K., Eui, S.J., David, C.H., Kim, T.I., Choi, K.S. and Lee, S.H., Comparative Study on Advamced TV Interface Types in the Smart Media World, 9th International Conference on Ubiquitous and Computing, 343- 348, Fukuoka. Japan. 2012.
  10. Obrenovic, Z. and Starcevic, D., Modeling Multimodal Human Computer Interaction, IEEE, 37(9), 65-72, 2004.
  11. Oviatt, S., DeAngeli, A. and Kuhn, K., Integration and synchronization of input modes during multimodal human-computer interaction, In Referring Phenomena in a Multimedia Context and their Computational Treatment, 1-13, 1997.
  12. Oviatt, S., Ten myths of multimodal interaction, Communications of the ACM, 41(11), 74-81, 1999.
  13. Shin, D.H., Hwang, Y.S. and Choo, H.S., Smart TV: are they really smart in interacting with people? Understanding the interactivity of Korean Smart TV, Behaviour & Information Technology, 32(2), 156-172, 2013. https://doi.org/10.1080/0144929X.2011.603360
  14. Stivers, T. and Sidnell, J., Introduction: multimodal interaction, Semiotica, 2005(156), 1-20, 2005. https://doi.org/10.1515/semi.2005.2005.155.1-4.1
  15. Vatavu, R.D., User-Defined Gestures for Free-Hand TV Control. Proceeding of the 10th European conference on interactive tv and video, 45-48, Berlin. Germany. 2012.

Cited by

  1. Effective quality factors of multimodal interaction in simple and complex tasks of using a smart television vol.76, pp.5, 2017, https://doi.org/10.1007/s11042-016-3333-2
  2. The Effects of Multi-Modality on the Use of Smart Phones vol.33, pp.3, 2014, https://doi.org/10.5143/JESK.2014.33.3.241