Browse > Article
http://dx.doi.org/10.33851/JMIS.2021.8.4.243

Design and Implementation of Procedural Self-Instructional Contents and Application on Smart Glasses  

Yoon, Hyoseok (Division of Computer Engineering, Hanshin University)
Kim, Seong Beom (Division of Computer Engineering, Hanshin University)
Kim, Nahyun (Division of Computer Engineering, Hanshin University)
Publication Information
Journal of Multimedia Information System / v.8, no.4, 2021 , pp. 243-250 More about this Journal
Abstract
Instructional contents are used to demonstrate a technical process to teach and walkthrough certain procedures to carry out a task. This type of informational content is widely used for teaching and lectures in form of tutorial videos and training videos. Since there are questions and uncertainties for what could be the killer application for the novel wearables, we propose a self-instruction training application on a smart glass to utilize already-available instruction videos as well as public open data in creative ways. We design and implement a prototype application to help users train by wearing smart glasses specifically designed for two concrete and hand-constrained use cases where the user's hands need to be free to operate. To increase the efficiency and feasibility of the self-instruction training, we contribute to the development of a wearable killer application by integrating a voice-based user interface using speech recognizer, public open data APIs, and timestamp-based procedural content navigation structure into our proof-of-concept application.
Keywords
Self-instruction; Smart glasses; Training; Wearables;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. K. Kim, H. Yoon, C. Shin, J. Choi, and Y. Lee, "Brief paper: Design and implementation of a smart glass application for XR assisted training of core nursing skills," Journal of Multimedia Information System, vol. 7, no. 4, pp. 277-280, Dec. 2020.   DOI
2 D. Besserer, J. Baurle, A. Nikic, F. Honold, F. Schussel, and M. Weber, "Fitmirror: a smart mirror for positive affect in everyday user morning routines, " in Proceedings of the workshop on multimodal analyses enabling artificial agents in human-machine interaction, pp. 48-55, Nov. 2016.
3 G. T, DeSimone, "Virtual fitness: Choosing a program that is right for you," ACSM's Health & Fitness Journal, vol. 24, no. 4, pp. 3-4, Jul./Aug. 2020.
4 E. Papadaki, S. Ntoa, I. Adami, and C. Stephanidis, "Let's cook: An augmented reality system towards developing cooking skills for children with cognitive impairments," in Proceedings of International Conference on Smart Objects and Technologies for Social Good, pp. 237-247, Nov. 2017.
5 N. Idehara and Y. Idehara, "CuisiNavi: Cooking guiding system with gesture recognition," in Proceedings of the Virtual Reality International Conference, pp. 1-4, Apr. 2018.
6 H. van der Meij, "Reviews in instructional video," Computers & Education, vol. 114, pp. 164-174, Nov. 2017.   DOI
7 L.-H. Lee and P. Hui, "Interaction methods for smart glasses: a survey," IEEE Access, vol. 6, pp. 28712-28732, May 2018.   DOI
8 H. Yoon and J. Son, "Collocated wearable interaction for audio book application on smartwatch and hearables," Journal of Multimedia Information System, vol. 7, no. 2, pp. 107-114, Jun. 2020.   DOI
9 L. Fiorella and R. E. Mayer, "What works and doesn't work with instructional video," Computers in Human Behavior, vol. 89, pp. 465-470, Dec. 2018.   DOI
10 S. K. Kim, Y. Lee, H. Yoon, and J. Choi, "Adaptation of extended reality smart glasses for core nursing skill training among undergraduate nursing students: usability and feasibility study," Journal of Medical Internet Research, vol. 23, pp. 1438-8871, Mar. 2021.
11 H. Yoon, S. K. Kim, Y. Lee, and J. Choi, "Google glasssupported cooperative training for health professionals: a case study based on using remote desktop virtual support," Journal of Multidisciplinary Healthcare, vol. 14, pp. 1451-1462, Jun. 2021.   DOI
12 R. Miotto, M. Danieletto, J. R. Scelza, B. A. Kidd, and J. T. Dudley, "Reflecting health: smart mirrors for personalized medicine," NPJ digital medicine, vol. 1, no. 1, Article number 62, Nov. 2018.
13 D. T. Bui, T. Barnett, H. T. Hoang, and W. Chinthammit, "Tele-mentoring using augmented reality technology in healthcare: a systematic review," Australasian Journal of Education Technology, vol. 37, no. 4, pp. 68-88, May 2021.
14 H. Yoon, "Opportunities and challenges of smartglassassisted interactive telementoring," Applied System Innovation, vol. 4, no. 3, Aug. 2021.
15 H. S. Park, G. A. Lee, B.-K. Seo, and M. Billinghurst, "User experience design for a smart-mirror-based personalized training system," Multimedia Tools and Applications, vol. 80, pp. 31159-31181, Dec. 2021.   DOI