Journal of the Korea Convergence Society (한국융합학회논문지)

Korea Convergence Society (한국융합학회)
권호 표지
DOI QR코드

DOI QR Code

"Hey Alexa, Would You Create a Color Palette?" UX/UI Designers' Perspectives on Using Natural Language to Interact with Future Intelligent Design Assistants

"알렉사, 색상 팔레트를 만들어줄 수 있어?" 지능형 디자인 비서와 자연어로 협업을 수행할 UX/UI 디자이너의 생각

  • Bertao, Renato Antonio (Department of Smart Experience Design, Graduate School of Techno Design, Kookmin University) ;
  • Joo, Jaewoo (Department of Marketing, College of Business Administration, Kookmin University)
  • Received : 2021.08.24
  • Accepted : 2021.11.20
  • Published : 2021.11.28
Download PDF
⟨ Previous Next ⟩

Abstract

Artificial Intelligence (AI) has been inserted into people's lives through Intelligent Virtual Assistants (IVA), like Alexa. Moreover, intelligent systems have expanded to design studios. This research delves into designers' perspectives on developing AI-based practices and examines the challenges of adopting future intelligent design assistants. We surveyed UX/UI professionals in Brazil to understand how they use IVAs and AI design tools. We also explored a scenario featuring the use of Alexa Sensei, a hypothetical voice-controlled AI-based design assistant mixing Alexa and Adobe Sensei characteristics. The findings indicate respondents have had limited opportunities to work with AI, but they expect intelligent systems to improve the efficiency of the design process. Further, majority of the respondents predicted that they would be able to collaborate creatively with AI design systems. Although designers anticipated challenges in natural language interaction, those who already adopted IVAs were less resistant to the idea of working with Alexa Sensei as an AI design assistant.

AI (인공지능)는 알렉사와 같은 지능형 가상 비서 (IVA)을 통해서 이미 우리의 삶에 침투했으며 디자인 작업에도 도입될 가능성이 높다. 본 연구에서는 AI를 활용하여 개발될 지능형 디자인 비서에 (intelligent design assistant) 대해서, 디자이너들이 어떠한 생각을 가지고 있는지 이해하고자 한다. 이를 위해서 브라질의 UX/UI 디자이너들에게 지능형 가상 비서와 AI 디자인 도구에 관한 설문 조사를 실시했으며, 추가로 알렉사와 (Alexa) 어도비 센세이를 (Adobe Sensei) 결합하여 음성 기반 AI 디자인 비서인 알렉사 센세이를 (Alexa Sensei) 가상의 시나리오로 만든 뒤, 이에 관한 설문도 함께 실시했다. 설문조사 결과, 브라질 디자이너들은 AI와 협업할 기회는 제한되어 있었으나 AI가 디자인 프로세스의 효율성을 개선해줄 것으로 기대한다는 사실을 알아냈다. 또한 응답자의 대다수는 AI 설계 시스템과 창의적으로 협력할 수 있을 것이라고 예측했다. 자연어를 통한 의사소통에는 한계가 있을 것으로 바라보았지만, 이미 지능형 가상 비서를 사용한 경험이 있는 디자이너들은 음성 기반 AI 디자인 비서에 대한 거부감이 낮다는 점도 함께 밝혀졌다.

Keywords

Acknowledgement

The survey findings related to the current adoption of AI tools (Fig. 3 & 4) were explored in-depth in a paper presented at the 14th EAD Conference. Although the research was based on the same dataset, the study did not explore natural language interaction issues. The authors would like to express sincere gratitude to the Brazilian UX/UI designers who answered the online survey and shared their perspectives on adopting AI technologies. We deeply appreciate their time and insights.

References

  1. Gartner. (2019). Gartner predicts 25 percent of digital workers will use virtual employee assistants daily by 2021. Newsroom. [Online]. https://www.gartner.com/en/newsroom/press-releases/2019-01-09-gartner-predicts-25-percent-of-digital-workers-will-u
  2. G. Dove, K. Halskov, J. Forlizzi & J. Zimmerman. (2017, May). UX design innovation: Challenges for working with machine learning as a design material. Conference on Human Factors in Computing Systems - Proceedings. (pp. 278-288). Denver: CHI. DOI : 10.1145/3025453.3025739
  3. A. Main & M. Grierson. (2020). Guru, partner, or pencil sharpener? Understanding designers' attitudes towards intelligent creativity support tools. Computer Science. ArXiv ID: 2007.04848v1 [cs.AI].
  4. A. Pfeiffer. (2018). Creativity and technology in the age of AI. Pfeiffer Consulting. [Online]. https://www.pfeifferreport.com/wp-content/uploads/2018/10/Creativity-and-technology-in-the-age-of-AI.pdf
  5. V. Petrock. (2020). Voice assistant and smart speaker users 2020 - More time at home means more time to talk. Insider Intelligence. [Online]. https://www.emarketer.com/content/voice-assistant-and-smart-speaker-users-2020
  6. A. de Barcelos Silva et al. (2020). Intelligent personal assistants: A systematic literature review. Expert Systems with Applications, 147 (113193), 1-14. DOI : 10.1016/j.eswa.2020.113193
  7. R. Knote, A. Janson, M. Sollner, & J. M. Leimeister. (2019, January). Classifying smart personal assistants: An empirical cluster analysis. Proceedings of the 52nd Hawaii International Conference on System Sciences, (6, pp. 2024-2033). Hawaii: HICSS. DOI : 10.24251/hicss.2019.245
  8. AWS. (2021). Alexa for business - Use Alexa for work. [Online]. https://aws.amazon.com/alexaforbusiness/
  9. T. Ammari, J. Kaye, J. Y. Tsai & F. Bentley. (2019). Music, search, and IoT: How people (really) use voice assistants. ACM Transactions on Computer-Human Interaction, 26(3), 17-1. DOI : 10.1145/3311956
  10. M. Tabassum et al. (2019). Investigating users' preferences and expectations for always-listening voice assistants. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3(4), 1-23. DOI : 10.1145/3369807
  11. L. Burbach, P. Halbach, N. Plettenberg, J. Nakayama, M. Ziefle, & A. Calero Valdez. (2019, July) 'Hey, Siri', 'Ok, Google', 'Alexa'. Acceptance-relevant factors of virtual voice-assistants. IEEE International Professional Communication Conference. (pp. 101-111). Aachen: IEEE. DOI : 10.1109/ProComm.2019.00025
  12. P. Kowalczuk. (2018). Consumer acceptance of smart speakers: a mixed methods approach. Journal of Research in Interactive Marketing, 12(4), 418-431. DOI : 10.1108/JRIM-01-2018-0022
  13. G. McLean & K. Osei-Frimpong. (2019). Hey Alexa ... examine the variables influencing the use of artificial intelligent in-home voice assistants. Computers in Human Behavior, 99(January), 28-37. DOI : 10.1016/j.chb.2019.05.009
  14. G. Lopez, L. Quesada & L. A. Guerrero. (2018). Alexa vs. Siri vs. Cortana vs. Google Assistant: A comparison of speech-based natural user interfaces. Advances in Intelligent Systems and Computing, 592, 241-250. DOI : 10.1007/978-3-319-60366-7_23
  15. P. R. Doyle, J. Edwards, O. Dumbleton, L. Clark & B. R. Cowan. (2019, October). Mapping perceptions of humanness in intelligent personal assistant interaction. Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, (pp. 1-12). Taipei: MobileHCI 2019. DOI : 10.1145/3338286.3340116
  16. Y. Wu et al. (2020). See what I'm saying? Comparing intelligent personal assistant use for native and non-native language speakers. ACM, arXiv ID: 2006.06328 [cs.HC]. DOI : 10.1145/3379503.3403563
  17. T. Bogers et al. (2019). A study of usage and usability of intelligent personal assistants in Denmark. Information in Contemporary Society. iConference 2019. Lecture Notes in Computer Science, 11420(LNCS), 79-90. DOI : 10.1007/978-3-030-15742-5_7
  18. T. Garcia Ferrari. (2019). Design and the Fourth Industrial Revolution. Dangers and opportunities for a mutating discipline. The Design Journal, 20(sup1,) S2625-S2633. DOI : 10.1080/14606925.2017.1352774
  19. M. Bernal, J. R. Haymaker, & C. Eastman. (2015). On the role of computational support for designers in action. Design Studies, 41, 163-182. DOI : 10.1016/j.destud.2015.08.001
  20. P. Pavliscak. (2016). Algorithms as the new material of design. UX Matters. [Online]. https://www.uxmatters.com/mt/archives/2016/06/algorithms-as-the-new-material-of-design.php
  21. L. Chen et al. (2019). An artificial intelligence based data-driven approach for design ideation. Journal of Visual Communication and Image Representation, 61, 10-22. DOI : 10.1016/j.jvcir.2019.02.009
  22. C. Cautela, M. Mortati, C. Dell'Era, & L. Gastaldi. (2019). The impact of artificial intelligence on design thinking practice: Insights from the ecosystem of startups. Strategic Design Research Journal, 12(1), 114-134. DOI : 10.4013/sdrj.2019.121.08
  23. R. Verganti, L. Vendraminelli, & M. Iansiti. (2020). Innovation and design in the age of Artificial Intelligence. Journal of Product Innovation Management, 37(3), 212-227. DOI : 10.1111/jpim.12523
  24. J. J. Liu & K. Nah. (2019). A study on the role change of designers in the age of Artificial Intelligence. Journal of the Korean Society of Design Culture, 25(4), 339-349. DOI : 10.18208/ksdc.2019.25.4.339
  25. J. McCormack, P. Hutchings, T. Gifford, M. Yee-King, M. T. Llano, & M. D'Inverno. (2020). Design considerations for real-time collaboration with creative artificial intelligence. Organised Sound, 25(1), 41-52. DOI : 10.1017/S1355771819000451
  26. J. Liao, P. Hansen & C. Chai. (2020). A framework of artificial intelligence augmented design support. Human-Computer Interaction, 35(5-6), 511-544. DOI : 10.1080/07370024.2020.1733576
  27. W. J. Jeong & S. I. Kim. (2018). A study on the role of designer in the 4th Industrial Revolution-Focusing on design process and AI based design software. Journal of Digital Convergence, 16(8), 279-285. DOI : 10.14400/JDC.2018.16.8.279
  28. E. F. Churchill, P. van Allen, & M. Kuniavsky. (2018, November-December). Designing AI. Interactions, 34-37.
  29. R. Girling. (2017). AI and the future of design: What will the designer of 2025 look like? Oreilly. [Online]. https://www.oreilly.com/ideas/ai-and-the-future-of-design-what-will-the-designer-of-2025-look-like
  30. Adobe. (2021). Power incredible experiences with AI. Adobe Sensei. [Online]. https://www.adobe.com/sensei.html
  31. M. Annunziata. (2019). Creativity and AI: Adobe Sensei as assistant, teacher and muse. Forbes. [Online]. https://www.forbes.com/sites/marcoannunziata/2019/07/16/creativity-and-ai-adobe-sensei-as-assistant-teacher-and-muse/?sh=13a0f4b36750
  32. V. Singh & N. Gu. (2012). Towards an integrated generative design framework. Design Studies, 33(2), 185-207. DOI : 10.1016/j.destud.2011.06.001
  33. R. Ramirez, M. Mukherjee, S. Vezzoli, & A. M. Kramer. (2015). Scenarios as a scholarly methodology to produce 'interesting research'. Futures, 71, 70-87. DOI : 10.1016/j.futures.2015.06.006
  34. H. Kosow & R. Gassner. (2008). Methods of future and scenario analysis - Overview, assessment, and selection criteria. Bonn: German Development Institute / Deutsches Institut fur Entwicklungspolitik (DIE).
  35. Z. Ma, T. Gill, & Y. Jiang. (2015) Core versus peripheral innovations: The effect of innovation locus on consumer adoption of new products. Journal of Marketing Research, 52(3), 309-324. DOI : 10.1509/jmr.13.0337
  36. G. Hastings, Design colours you love. khroma [Online]. http://khroma.co
  37. X. Chen, S. Kim, & J. Joo. (2019). How do we nudge people to choose aesthetically pleasing products? Archives of Design Research, 32(1), 61-73. DOI : 10.15187/adr.2019.02.32.1.61
  38. T. T. Nguyen & J. Joo. (2019). Digital strikes back: Reading digital clocks decreases new product adoption. Archives of Design Research, 32(2). 103-114. DOI : 10.15187/adr.2019.05.32.2.103
  39. M. C. Claudy, R. Garcia & A. O'Driscoll, (2015) Consumer resistance to innovation-a behavioral reasoning perspective. Journal of the Academy of Marketing Science, 43(4), 528-544. DOI : 10.1007/s11747-014-0399-0
  40. M. Biswas, M. Romeo, A. Cangelosi & R. B. Jones. (2020). Are older people any different from younger people in the way they want to interact with robots? Scenario based survey. Journal on Multimodal User Interfaces, 14(1), 61-72. DOI : 10.1007/s12193-019-00306-x
  41. J. W. Creswell. (2009). Research design: Qualitative, quantitative, and mixed methods approaches. Thousand Oaks: Sage Publications.
  42. J. M. Corbin & A. Strauss. (1990). Grounded theory research: Procedures, canons, and evaluative criteria. Qualitative Sociology, 13(1), 3-21. DOI : 10.1007/BF00988593
  43. C. G. Mont, C. M. Del Pozo, C. M. Pinto & A. V. M. del C. Alcocer. (2020). Artificial Intelligence for social good in Latin America and the Caribbean: The regional landscape and 12 country snapshots. Banco Interamericano de Desarollo.
  44. R. Budiu & P. Laubheimer. (2018). Intelligent assistants have poor usability: A user study of Alexa, Google Assistant, and Siri. Nielsen Norman Group. [Online]. https://www.nngroup.com/articles/intelligent-assistant-usability/