Browse > Article
http://dx.doi.org/10.4218/etrij.15.0114.0076

Multimodal Interface Based on Novel HMI UI/UX for In-Vehicle Infotainment System  

Kim, Jinwoo (IT Convergence Technology Research Laboratory, ETRI)
Ryu, Jae Hong (IT Convergence Technology Research Laboratory, ETRI)
Han, Tae Man (IT Convergence Technology Research Laboratory, ETRI)
Publication Information
ETRI Journal / v.37, no.4, 2015 , pp. 793-803 More about this Journal
Abstract
We propose a novel HMI UI/UX for an in-vehicle infotainment system. Our proposed HMI UI comprises multimodal interfaces that allow a driver to safely and intuitively manipulate an infotainment system while driving. Our analysis of a touchscreen interface-based HMI UI/UX reveals that a driver's use of such an interface while driving can cause the driver to be seriously distracted. Our proposed HMI UI/UX is a novel manipulation mechanism for a vehicle infotainment service. It consists of several interfaces that incorporate a variety of modalities, such as speech recognition, a manipulating device, and hand gesture recognition. In addition, we provide an HMI UI framework designed to be manipulated using a simple method based on four directions and one selection motion. Extensive quantitative and qualitative in-vehicle experiments demonstrate that the proposed HMI UI/UX is an efficient mechanism through which to manipulate an infotainment system while driving.
Keywords
Multimodal interface; human-machine interface; user interface; user experience; gesture recognition; speech recognition; multitasking; in-vehicle infotainment; IVI; GENIVI; MMI; HMI; UI; UX;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 H.M. Kim et al., "Dual Autostereoscopic Display Platform for Multi-user Collaboration with Natural Interaction," ETRI J., vol. 34, no. 3, June 2012, pp. 466-469.   DOI
2 D. Lee and S. Lee, "Vision-Based Finger Action Recognition by Angle Detection and Contour Analysis," ETRI J., vol. 33, no. 3, June 2011, pp. 415-422.   DOI
3 L. Hackenberg et al., "International Evaluation of NLU Benefits in the Domain of In-Vehicle Speech Dialog Systems," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Eindhoven, Netherlands, Oct. 28-30, 2013, pp. 114-120.
4 T.M. Gable et al., "Advanced Auditory Cues on Mobile Phones Help Keep Drivers' Eyes on the Road," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Eindhoven, Netherlands, Oct. 28-30, 2013, pp. 66-73.
5 T. Kujala, J. Silvennoinen, and A. Lasch, "Visual-Manual In-Car Tasks Decomposed - Text Entry and Kinetic Scrolling as the Main Sources of Visual Distraction," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Eindhoven, Netherlands, Oct. 28-30, 2013, pp. 82-89.
6 I. Politis, S. Brewster, and F. Pollick, "Evaluating Multimodal Driver Displays of Varying Urgency," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Eindhoven, Netherlands, Oct. 28-30, 2013, pp. 92-99.
7 G. Burnett et al., "A Study of Unidirectional Swipe Gestures on In-Vehicle Touch Screens," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Eindhoven, Netherlands, Oct. 28-30, 2013, pp. 22-29.
8 A. Riener et al., "Standardization of the In-Car Gesture Interaction Space," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Eindhoven, Netherlands, Oct. 28-30, 2013, pp. 14-21.
9 C. Jablonski, "An Augmented Reality Windshield from GM," Mar. 19, 2010. Accessed Jan. 20, 2015. http://www.zdnet.com/article/anaugmented-reality-windshield-from-gm/
10 R. Ecker et al., "Visual Cues Supporting Direct Touch Gesture Interaction with In-Vehicle Information Systems," Proc. Int. Conf. Automotive User Interfaces Interactive Veh. Appl., Pittsburgh, PA, USA, Nov. 11-12, 2010, pp. 80-87.
11 M.A. Perez, "Safety Implications of Infotainment System Use in Naturalistic Driving," J. Prevention, Assessment, Rehabil., vol. 41, Feb. 2012, pp. 4200-4204.
12 H.S. Park et al., "In-Vehicle AR-HUD System to Provide Driving-Safety Information," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1038-1047.   DOI
13 N. Parimal et al., "Application of Sensors in Augmented Reality Based Interactive Learning Environments," IEEE Int. Conf. Sens. Technol., Kolkata, India, Dec. 18-21, 2012, pp. 173-178.
14 S. Khan, "SVP Infotainment and Connected Drive," BMW Case Study, BMW Group Corp., 2008. Accessed May. 10, 2014. http://www.genivi.org/sites/default/files/BMW_Case_Study_Download_040914.pdf
15 Developer Center, GestureList, Leapmotion Corp., 2014. Accessed Dec. 14, 2014. https://developer.leapmotion.com/documentation/skeletal/cpp/api/Leap.Gesture.html
16 Naver Developer Center, Map API, Naver Corp., 2014. Accessed Dec. 14, 2014. http://developer.naver.com/wiki/pages/JavaScript
17 P. Seewald et al., "D13.2: Results of HMI and Feedback Solutions Evaluations," EcoDriver, SP1: Supporting Drivers in Eco-driving, Tech. Rep. D13.2, Ver. 10, Nov. 2013.
18 3D Connexion Support team, Space Navigator for Notebooks, 3D Connextion Corp., 2014. Accessed Nov. 14, 2014. http://www.3dconnexion.eu/products/spacenavigator-for-notebooks.html
19 SCS Software, Euro Truck Simulator 2, SCS Software Corp., Accessed Mar. 17, 2015. http://www.eurotrucksimulator2.com/world.php
20 S. Franzen and M. Babapour, "HMI Certification - a Critical Review of Methods for Safety and Deficiency Evaluation of HMI Solutions for IVIS," Chalmers University of Technology, Dept. Des. & Human Factors, July 2011.
21 NHTSA, "The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data," National Highway Safety Administration, Washington, DC, USA, Rep. DOT HS 810 594, 2006.