Browse > Article
http://dx.doi.org/10.33851/JMIS.2021.8.4.295

Analysis of Intermediary Roles and Technical Components for Smartglass-Assisted Interactive Remote Collaboration  

Yoon, Hyoseok (Division of Computer Engineering, Hanshin University)
Kim, Siyeon (Division of Computer Engineering, Hanshin University)
Oh, Haneol (Division of Computer Engineering, Hanshin University)
Lim, Hong Ji (Division of Computer Engineering, Hanshin University)
Publication Information
Journal of Multimedia Information System / v.8, no.4, 2021 , pp. 295-300 More about this Journal
Abstract
Recent advances in Internet-of-Things and wearable computing have established computationally sufficient infrastructure to remove the barriers of physical locations. The recent COVID-19 pandemic has accelerated the use of remote collaboration, work-from-home, teleconferencing, online education, digital twin, and metaverse enriched with various configurations of augmented reality, virtual reality, mixed reality, and extended reality. Beyond specialized niche wearable applications in the medical and entertainment domains, we aim to identify the underlying characteristics of smartglass-enabled killer applications for everyday use. In this paper, we analyze intermediary roles in remote collaboration consisting of authoritative supervisors, synergetic collaborators, and speculative explorers. We also propose technical components for smartglass-assisted interactive remote collaboration composed of personal tracking, teleconference, and interaction components. More specifically, the application tasks of each intermediary role and objectives of three functional components are defined and elaborated.
Keywords
Extended reality; Intermediary roles; Remote collaboration; Smartglass; Telementoring; Wearables;
Citations & Related Records
연도 인용수 순위
  • Reference
1 H. Yoon, H. Kim, and W. Woo, "Personal companion: Personalized user interface for u-service discovery, selection and interaction," in Proceedings of International Conference on Universal Access in Human-Computer Interaction, Beijing, China, pp. 1052-1061, Jul. 2007.
2 E. K. Choe, N. B. Lee, B. Lee, W. Pratt, and J. A. Kientz, "Understanding quantified-selfers' practices in collecting and exploring personal data," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, Ontario, Canada, pp. 1143-1152, April 2014.
3 S. K. Kim, Y. Lee, H. Yoon, and J. Choi, "Adaptation of extended reality smart glasses for core nursing skill training among undergraduate nursing students: Usability and feasibility study," Journal of Medical Internet Research, vol. 23, no. 3, e24313, Mar. 2021.   DOI
4 E. Rojas-Munoz, M. E. Cabrera, C. Lin, D. Andersen, V. Popescu, K. Anderson, B. L. Zarzaur, B. Mullis, and J. P. Wachs, "The system for telementoring with augmented reality (STAR): A head-mounted display to improve surgical coaching and confidence in remote areas," Surgery, vol. 167, pp. 724-731, 2020.   DOI
5 N. Osmers, M. Prilla, O. Blunk, G. George Brown, M. Janssen, and N. Kahrl, "The role of social presence for cooperation in augmented reality on head mounted devices: A literature review," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Article 457, May 2021.
6 S. Kim, G. Lee, M. Billinghurst, and W. Huang, "The combination of visual communication cues in mixed reality remote collaboration," Journal on Multimodal User Interfaces, vol. 14, no. 4, pp. 321-335, 2020.   DOI
7 S. Erridge, D. K. T. Yeung, H. R. H. Patel, and S. Purkayastha, "Telementoring of surgeons, a systematic review," Surgical Innovation, vol. 26, pp.95-111, 2018.   DOI
8 Y. Lee, B. Yoo, and S.-H. Lee, "Sharing ambient objects using real-time point cloud streaming in web-based XR remote collaboration," in Proceedings of the 26th International Conference on 3D Web Technology, Article 4, Pisa, Italy, pp. 1-9, Nov. 2021.
9 H. Yoon, "Opportunities and challenges of smartglass-assisted interactive telementoring," Applied System Innovation, vol. 4, no. 3, Article 56, Aug. 2021.
10 M. Rohs and P. Zweifel, "A conceptual framework for camera phone-based interaction techniques," in Proceedings of International Conference on Pervasive Computing, Munich, Germany, pp. 171-189, May 2005.
11 H. Yoon, Y. Y. Doh, M. Y. Yi, and W. Woo, "A conceptual framework for augmented smart coach based on quantified holistic self," in Proceedings of International Conference on Distributed, Ambient, and Pervasive Interactions, Heraklion, Crete, Greece, pp. 498-508, Jun. 2014.
12 E. K. Choe and B. Lee, "Toward supporting personalized tracking experiences in healthcare," Interactions, vol. 27, no. 1, pp. 84-87, Jan.-Feb. 2020.   DOI
13 P. Wang, S. Zhang, X. Bai, M. Billinghurst, L. Zhang, S. Wang, D. Han, H. Lv, and Y. Yan, "A gesture- and head-based multimodal interaction platform for MR remote collaboration," The International Journal of Advanced Manufacturing Technology, vol. 105, pp. 3031-3043, 2019.   DOI
14 T. Ong, H. Wilczewski, S. Paige, H. Soni, B. Welch, and B. Bunnell, "Extended reality for enhanced telehealth during and beyond COVID-19: Viewpoint," JMIR Serious Games, vol. 9, no. 3, e26520, Jul.-Sep. 2021.   DOI
15 K. Klinker, M. Wiesche, and H. Krcmar, "Digital transformation in health care: Augmented reality for hands-free service innovation," Information Systems Frontiers, vol. 22, pp. 1419-1431, 2020.   DOI
16 A. Semsar, H. McGowan, Y. Feng, H. R. Zahiri, A. Park, A. Kleinsmith, and H. M. Mentis, "Quality of and attention to instructions in telementoring," Proceedings of the ACM Human-Computer Interaction, vol. 4, pp. 1-21, 2020.
17 J. A. Greenberg, E. Schwarz, J. Paige, J. Dort, and S. Bachman, "At-home hands-on surgical training during COVID19: Proof of concept using a virtual telementoring platform," Surgical Endoscopy, vol. 35, pp. 1963-1969, 2021.   DOI
18 F. Kleiman, S. Meijer, and M. Janssen, "Gaming for meaningful interactions in teleworking lessons learned during the COVID-19 pandemic from integrating gaming in virtual meetings," Digital Government: Research and Practice, vol. 1, no. 4, Article 31, Dec. 2020.
19 P. Wang, X. Bai, M. Billinghurst, S. Zhang, W. He, D. Han, Y. Wang, H. Min, W. Lan, an S. Han, "Using a head pointer or eye gaze: The effect of gaze on spatial AR remote collaboration for physical tasks," Interacting with Computers, vol. 32, no. 1, pp. 153-169, Aug. 2020.   DOI
20 Y. Yuan, J. Cao, R. Wang, and S. Yarosh, "Tabletop games in the age of remote collaboration: Design opportunities for a socially connected game experience," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, Article 436, 2021.
21 J.-H. Kim, G.-S. Hong, B.-G. Kim, and D. P. Dogra, "deepGesture: Deep learning-based gesture recognition scheme using motion sensors," Displays, vol. 55, pp. 38-45, Dec. 2018.   DOI
22 D. T. Bui, T. Barnett, H. T. Hoang, and W. Chinthammit, "Tele-mentoring using augmented reality technology in healthcare: a systematic review," Australasian Journal of Education Technology, vol. 37, no. 4, pp. 68-88, May 2021.
23 H. Yoon, S. K. Kim, Y. Lee, and J. Choi, "Google glass-supported cooperative training for health professionals: A case study based on using remote desktop virtual support," Journal of Multidisciplinary Healthcare, vol. 14, pp.1451-1462, Jun. 2021.   DOI
24 L. R. Rochlen, R. Levine, A. R. Tait, "First-person point-of-view-augmented reality for central line insertion training," Simulation in Healthcare, vol. 12, no. 1, pp. 57-62, Feb. 2017.   DOI