Browse > Article
http://dx.doi.org/10.15701/kcgs.2021.27.5.13

Cooking with a smart speaker: User experience of cooking with a voice-only recipe service  

Jung, Gumin (Hallym University)
Jeong, Heisawn (Hallym University)
Publication Information
Journal of the Korea Computer Graphics Society / v.27, no.5, 2021 , pp. 13-23 More about this Journal
Abstract
This study examined how users use smart speakers in cooking situations. Skilled and unskilled participants cooked a new recipe while following voice instructions delivered by a smart speaker. The results from video recordings of their cooking, think-aloud protocols, and interviews showed that the smart speakers freed users' hands, allowing them to cook while checking recipes. The lack of visual information did not pose a serious challenge to the cooking task, but impacted cooking quality. The implications for VUI-based recipe service designs are discussed.
Keywords
Smart Speaker; Recipe Service; Think-aloud; Voice User Interface; Hands-free;
Citations & Related Records
연도 인용수 순위
  • Reference
1 B. Hatscher, M. Luz, L. E. Nacke, N. Elkmann, V. Muller, and C. Hansen, "GazeTap: towards hands-free interaction in the operating room", Multimodal Interfaces and Machine Learning for Multimodal Interaction, pp.243-251, 2017.
2 J. E. Tornros, & A. K. Bolling, "Mobile phone use-effects of handheld and handsfree phones on driving performance", Accident Analysis & Prevention, Vol.37, No.5, pp.902-909, 2005.   DOI
3 Jiyu Choi, Gyusang Han, "Structural Analysis of Cooking Recipe Texts - Based on Kimchi Jjigae Recipe", The Korean Journal of Community Living Science, Vol.28, No.2, pp.191-201, 2017.   DOI
4 Dongwon Kang, Ki-Young Nam, "Design Criteria for Smart Speakers Multi-modal Interface based on VUI and GUI Characteristics", Korean Society of Design Science, pp.6-7, 2019.
5 W. Kintsch., & J. Keenan,"Reading rate and retention as a function of the number of propositions in the base structure of sentences", Cognitive Psychology, Vol.5, No.3, pp.257-274, 1973.   DOI
6 R. Hamada, S. Satoh, J. Okabe, S. Sakai, I. Ide, & H. Tanaka, "Cooking Navi: Assistant for daily coo king in kitchen", International Multimedia Conference, pp.371-374, 2005.
7 W. G. Chase, & H. A. Simon, "Perception in chess", Cognitive Psychology, Vol.4, No.1, pp.55-81, 1973.   DOI
8 J. Nielsen, & T. K. Landauer, "A mathematical model of the finding of usability problems", Conference on Human Factors in Computing Systems, ACM, pp. 206-213, 1993.
9 K. A. Ericsson, & H. A. Simon, "Protocol Analysis: Verbal Reports as Data", MIT Press, 1984.
10 E. Nouri, A. Fourney, R. Sim, & R. W. White, "Supporting complex tasks using multiple devices", In Proceedings of WSDM'19 Task Intelligence Workshop, 2019.
11 D. Wickens, "Statistics." Ergonomics in Design, Vol. 6, No. 4, pp.18-22, 1998.   DOI
12 Q. Tran, G. Calcaterra, & E. Mynatt, "How an older and a younger adult adopted a cooking memory aid", Proceedings of HCII: Human Computer Interaction International, 2005.
13 Bobin Kim, Eunjin Lee, Dongwook Kim, Minkyo Lim, Misook Yu, So yeon Kim, "Proposal for an SNS-based sauce-mixing device for improvement of single consumers cooking environment - Centering on a behavior survey of single people", The HCI Society of Korea, pp.225-229, 2014.
14 L. Le Bigot, L. Caroux, C. Ros, A. Lacroix, & V. Botherel, "Investigating memory constraints on recall of options in interactive voice response system messages", Behaviour & Information Technology, Vol.32, No.2, pp.106-116, 2013.   DOI
15 F. I. Craik, & E. Bialystok, "Planning and task management in older adults: Cooking breakfast", Memory & Cognition, Vol.34, No.6, pp.1236-1249, 2006.   DOI
16 P. Henstam, "How many participants are needed when usability testing physical products?", Dissertation, 2018.
17 J. Nielsen, "How many test users in a usability study?", Nielsen Norman Group, 2012.
18 L. Cooke, "Assessing concurrent think-aloud protocol as a usability test method: A technical communication approach", IEEE Transactions on Professional Communication, Vol.53, No.3, pp.202-215, 2010.   DOI
19 K. J. Turley-Ames, & M. M. Whitfield, "Strategy training and working memory task performance", Journal of Memory and Language, Vol.49, No.4, pp.446-468, 2003.   DOI
20 Won Moon Song, Myung Won Kim, "Performance Improvement of Speech Recognition Using Context and Usage Pattern Information", Korea Information Processing Society, Vol.5, No.108, pp.553-560, 2006.
21 Harksoo Kim, "Natural Language Processing Techniques of Spoken Assistant Systems based on Artificial Intelligence", Communications of the Korean Institute of Information Scientists and Engineers, Vol.35, No.8, pp.9-18, 2017.
22 G. Shalene, "For the disabled, smart homes are home sweet home", Fortune, 2015.
23 C. Pearl, "Designing Voice User Interfaces", O'Reilly Media, 2016.
24 K. Doman, C. Y. Kuai, T. Takahashi, I. Ide, & H. Murase, "Video CooKing: Towards the synthesis of multimedia cooking recipes", In International Conference on Multimedia Modeling, pp.135-145, 2011.