Browse > Article
http://dx.doi.org/10.3837/tiis.2017.02.019

Augmented-Reality Survey: from Concept to Application  

Kim, Soo Kyun (Department of Game Engineering, Paichai University)
Kang, Shin-Jin (School of Games, Hongik University)
Choi, Yoo-Joo (Department of New Media Content, Seoul Media Institute of Technology)
Choi, Min-Hyung (Department of Computer Science and Engineering, University of Colorado Denver)
Hong, Min (Department of Computer Software Engineering, Soonchunhyang University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.11, no.2, 2017 , pp. 982-1004 More about this Journal
Abstract
The recent advances in the field of augmented reality (AR) have shown that the technology is a fundamental part of modern immersive interactive systems for the achievement of user engagement and a dynamic user experience. This survey paper presents the descriptions of a variety of the new AR explorations, and the issues that are relevant to the contemporary development of the fundamental technologies and applications are discussed. Most of the literature regarding the pertinent topics-taxonomy, the core tracking and sensing technologies, the hardware and software platforms, and the domain-specific applications-are then chronologically surveyed, and in varying detail, this is supplemented with the cited papers. This paper portrays the diversity of the research regarding the AR field together with an overview of the benefits and the limitations of the competing and complementary technologies.
Keywords
Realistic display; Tracking; AR-hardware platforms; AR applications; Augmented Reality;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Zhihan Lv, Alaa Halawani, Shengzhong Feng, Shafiq ur Rehman and Haibo Li, "Touch-less interactive augmented reality game on vision-based wearable device," Personal and Ubiquitous Computing , vol. 19, Issue 3, pp. 551-567, 2015.   DOI
2 Joaquin ,Cubillo Sergio Martin, Manuel Castro and Ivica Boticki, "Preparing augmented reality learning content should be easy: UNED ARLE-an authoring tool for augmented reality learning environments," Computer Applications in Engineering Education, vol. 23, Issue 5, pp. 778-789, 2015.   DOI
3 Anuruddha Hettiarachchi and Daniel Wigdor, "Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality," in Proc. of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 1957-1967, 2016.
4 Gheric Speiginer, Blair MacIntyre , Jay Bolter, Hafez Rouzati, Amy Lambeth, Laura Levy, Laurie Baird, Maribeth Gandy, Matt Sanders and 4 more, "The Evolution of the Argon Web Framework Through Its Use Creating Cultural Heritage and Community-Based Augmented Reality Applications," Human-Computer Interaction: Users and Contexts, Volume 9171 of the series Lecture Notes in Computer Science, pp.112-124, 2015.
5 Lamees Mahmoud Mohd Said Al Qassem, Hessa Al Hawai, Shayma Al Shehhi, M. Jamal Zemerly and Jason W. P. Ng, "AIR- EDUTHCH: Augmented immersive reality (AIR) technology for high school Chemistry education," in Proc. of 2016 IEEE Global Engineering Education Conference (EDUCON), DOI: 10.1109/EDUCON.2016.7474650, Electronic ISSN: 2165-9567, 2016.   DOI
6 STAR 1200XLD
7 Microsoft HoloLens
8 Google Magic Leap
9 I. Sutherland, "A head-mounted three dimensional display," in Proc. of the Fall Joint Computer Conference, pp. 757-764, Dec. 9-11, 1968.
10 google glasses
11 Gear VR
12 Ihsan Rabbi and Sehat Ullah, "A Survey on Augmented Reality Challenges and Tracking," Acta Graphica ,vol. 24, no 1-2, 2013.
13 VA-ST Smart Specs
14 Saagara AR
15 L. Gun, "CityViewAR outdoor AR visualization," in Proc. of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction, pp. 97, 2012.
16 Bentley Systems
17 JBKnowledge Smart Reality
18 BIMevoke 3D Guided Maintenance application
19 Virtual and augmented reality in surgical training: an interview with Dr Shafi Ahmed
20 AccuVein Vein Viewing System
21 Feng Zhou, Henry Been-Lirn Duh and Mark Billinghurst, "Trends in augmented reality tracking, interaction and display: A Review of Ten Years of ISMAR," in Proc. of ISMAR '08: Proc. 7th International Symposium on Mixed and Augmented Reality, pp. 193-202, September, 2008.
22 Franceli L. Cibrian, Deysi H. Ortega, Lizbeth Escobedo and Monica Tentori, "Reflections from a Long-term Deployment Study to Design Novel Interactive Surfaces for Children with Autism," Ambient Intelligence for Health, Volume 9456 of the series Lecture Notes in Computer Science, pp. 167-176, 2015.
23 Steve Bourgeois , Boris Meden , Vincent Gay-Bellile , Mohamed Tamaazousti and Sebastian Knodel, "Modeling, Tracking, Annotating and Augmenting a 3D Object in less than 5 Minutes," Vision and Content Engineering Laboratory, Point Courrier 94, Gif-sur-Yvette, F-91191 France, 2016.
24 Robin De Croon, Joris Klerkx and Erik Duval, "A Proof-of-Concept Visualization to Increase Comprehension of Personal Medication Schemes," in Proc. of 2016 10th International Conference On Pervasive Computing Technologies For Healthcare (PervasiveHealth), pp.1-8, 2016.
25 Julio Cabero and Julio Barroso, "Posibilidades educativas de la Realidad Aumentada," NEW APPROACHES IN EDUCATIONAL RESEARCH, vol. 5, no. 1, pp. 46-52, 2016.
26 Ohan Oda, Carmine Elvezio, Mengu Sukan, Steven Feiner and Barbara Tversky, "Virtual Replicas for Remote Assistance in Virtual and Augmented Reality," in Proc. of UIST '15 Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 405-415, 2015.
27 Marianna Kopsida, Ioannis Brilakis and Patricio Antonio Vela, "A Review of Automated Construction Progress Monitoring and Inspection Methods," in Proc. of the 32nd CIB W78 Conference 2015, pp.421-431, 2015.
28 D.W.F. van Krevelen and R. Poelman, "A survey of augmented reality technologies, applications and limitations," The International Journal of Virtual Reality, vol 9, no.2, pp.1-20, 2010.
29 Feiner, Steven and MacIntyre, Blair and Seligmann, Doree, "Annotating the real world with knowledge-based graphics on a see-through head-mounted display," in Proc. of the conference on Graphics interface'92, pp. 78-85, 1992.
30 Ronald T. Azuma, "A survey of augmented reality," Presence: Teleoperators and Virtual Environments, vol. 6, no.4, pp.355-385, August, 1997.   DOI
31 B. Lee and J. Chun, "Interactive manipulation of augmented objects in marker-less AR using vision based hand interaction," in Proc. of 7th International Conference on Information Technology, pp. 398-403, 2010.
32 G. Hua and A. Akbarzadeh, "A robust elastic and partial matching metric for face recognition," in Proc. of 2009 IEEE 12th International Conference on Computer Vision, pp. 2082-2089, September , 2009.
33 D.G. Lowe, "Distinctive image features from scale-invariant keypoints," International journal of computer vision, vol. 60, no. 2, pp. 91-110, 2004.   DOI
34 H. Bay, T. Tuytelaars and L. Van Gool, "Surf: Speeded up robust features," in Proc. of European Conference on Computer Vision, 2006.
35 Ethan Rublee, Vincent Rabaud, Kurt Konolige and Gary R. Bradski, "ORB: An efficient alternative to SIFT or SURF," in Proc. of 2011 International conference on computer vision, IEEE, pp. 2564-2571, 2011.
36 M. Ozuysal, P. Fua and V. Lepetit, "Fast Keypoint Recognition in Ten Lines of Code," in Proc. of IEEE Conference of Computer Vision and Pattern Recognition, July.2007.
37 Tan W, Liu U and Dong Z, "Robust monocular SLAM in dynamic environments," in Proc. of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp. 209-218, 2013.
38 J.S. Bang and U.J. Choi, "The Trend of Technology and Prospect of Augmented Reality," Emerging Issue Report, KISTI, 2008.
39 Kaikai Liu and Xiaolin Li, "Enabling Context-Aware Indoor Augmented Reality via Smartphone Sensing and Vision Tracking," ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 12, Issue 1, no. 15, 2015.
40 George Koutromanos, Alivisos Sofos and Lucy Avraamidou, "The use of augmented reality games in education: a review of the literature," Educational Media International, vol. 52, Issue 4, pp. 253-271, 2015.   DOI
41 Magic make-up mirror
42 G. Schall, A. Mulloni and G. Reitmayr, "North-centred orientation tracking on mobile phones," Mixed and Augmented Reality(ISMAR), in Proc. of the 9th IEEE International Symposium, 2010.
43 Petit A, Marchand E and Kanani K, "Augmenting markerless complex 3D objects by combining geometrical and color edge information," in Proc. of the 12th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, pp. 287-288, 2013.
44 Eric Marchand, Hideaki Uchiyama and Fabien Spindler, "Pose estimation for augmented reality: a hands-on survey," IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2016.
45 C.E. Hughes, C. B. Stapleton, D.E. Hughes and E. M. Smith, "Mixed reality in education, entertainment, and training," IEEE Computer Graphics and Applications, pp. 24-30, 2005.
46 Aiteanu, Dorin, Bernd Hillers, and A. Graser, "A step forward in manual welding: demonstration of augmented reality helmet," Mixed and Augmented Reality, in Proc. of The Second IEEE and ACM International Symposium on, IEEE, 2003.
47 Optical Tracking Explained
48 Pereira, Pedro, Nuno Matos, and Aderito Marcos, "ARK: augmented reality kiosk," Human-Computer Interaction-Theory and Practice(PART II), Edited by Constantine Stephanidis, Julie Jacko(Vol. 2 of the Proceedings of HCI International 2003, 22-27 June, Crete, Greece) pp.168-172, 2003. ISBN: 0-8058-4931-9
49 S. E. Reed, O. Kreylos, S. Hsi, L. H. Kellogg, G. Schladow, M. B. Yikilmaz, H. Segale, J. Silverman, S. Yalowitz and E. Sato, "Shaping watersheds exhibit: An interactive, augmented reality sandbox for advancing earth science education," in Proc. of AGU Fall Meeting Abstracts ,vol. 1, pp. 1, December, 2014.
50 Thomas P. Caudell and David W. Mizell, "Augmented reality: An application of heads-up display technology to manual manufacturing processes," System Sciences, in Proc. of the Twenty-Fifth Hawaii International Conference on, vol. 2, pp. 659-669, 1992.
51 Positional tracking
52 Yuko Uematsu and Hideo Saito, "Vision-based Augmented Reality Applications," Computer vision I-Tech, Vienna, Austria, 2008.
53 Elements 4D
54 Hannes Kaufmann and Dieter Schmalstieg, "Mathematics and geometry education with collaborative augmented reality," Computers & Graphics, vol. 27, no. 3, pp. 339-345, June, 2003.   DOI
55 AR Flashcards
56 Anatomy 4D
57 Arloon Geometry
58 SkyView
59 R. Cavallaro, "The FoxTrax Hockey Puck Tracking System," IEEE Computer Graphics and Applications, vol. 17, no. 2, pp. 6-12, April, 1997.   DOI
60 Vlasios Kasapakis , Damianos Gavalas, "Determining Field of View in Outdoors Augmented Reality Applications," Ambient Intelligence, Volume 9425 of the series Lecture Notes in Computer Science, pp 344-348, 2015.
61 Mauro Figueiredo, Maria-Angeles Cifredo-Chacon and Vitor Goncalves, "Learning Programming and Electronics with Augmented Reality," Universal Access in Human-Computer Interaction. Users and Context Diversity, Volume 9739 of the series Lecture Notes in Computer Science, pp 57-64, 2016.
62 James Swanson, "MFS Launches Fund," Fund Action, 2014. ISSN: 1054-5956.
63 J. Pair, J. Wilson, J. Chastine and M. Gandy, "The Duran Duran Project: The Augmented Reality Toolkit in Live Performance," The First IEEE International Augmented Reality Toolkit Workshop, vol.1, 2002.
64 A. State, G. Hirota, D. T. Chen, B. Garrett and M. Livingston, "Superior augmented reality registration by integrating landmark tracking and magnetic tracking," Computer Graphics (Proceedings of SIGGRAPH '96), pp. 429-438, 1996.
65 R. Azuma, Y. Balliot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre, "Recent Advances in Augmented Reality," Computers & Graphics, vol. 21, no. 6, pp. 34-47, November, 2001.
66 R. T. Whitaker, C. Crampton, D. E. Breen, M. Tuceryan, and E. Rose, "Object calibration for augmented reality," Computer Graphics Forum, Wiley Online Library, pp. 15-27, 1995.
67 Hyundai Virtual Guide
68 T.H. Hollerer and S.K. Feiner, "Mobile Augmented Reality," Telegeoinformatics: Location-based Computing and Services, CRC Press, Mar. 2004. ISBN 0-4153-6976-2.
69 Markus Aleksy and Elina Vartiainen, "Visualization Approaches in Augmented Reality Applications," Volume 9228 of the series Lecture Notes in Computer Science, pp. 84-90, August 2015.
70 Mobile augmented reality
71 Y.K. Chang, U.K. Woo, D.C. Kim and C.S. Shin, "Mobile Augmented Reality Technology Trend," OSIA Standards & Technology Review, vol.38, no.1, 2010.
72 Starbucks Cup Magic
73 Julie Carmigniani, Borko Furht, Marco Anisetti, Paolo Ceravolo, Ernesto Damiani and Misa Ivkovic, "Augmented reality technologies, systems and application," Multimedia Tools and Applications, vol. 51, no. 1, pp. 341-377, January, 2011.   DOI
74 X. Wang, S. K. Ong and A. Y. C. Nee, "A comprehensive survey of augmented reality assembly research," Advances in Manufacturing, vol. 4, no. 1, pp. 1-22, March, 2016.   DOI
75 Federico Manuri and Andrea Sanna, "A survey on applications of augmented reality," Advances in Computer Science: an International Journal, vol. 5, issue 1, no. 19, pp. 18-27, January, 2016.
76 Microsoft HoloLens
77 Z. Lv, L. Feng, H. Li, and S. Feng, "Hand-free motion interaction on google glass," SIGGRAPH Asia 2014 Mobile Graphics and Interactive Application, ACM, pp.21, 2014.
78 Pokemon GO
79 EZface
80 Field Trip
81 Gravity jack
82 Varia Vision
83 Metro AR Pro
84 Yelp Monocle
85 Google Translate
86 T. Hakky, R.M. Daniel, I. Larry, E.S. Philippe, E. C. Rafael, "Augmented Reality Assisted Urologic Surgery (ARAUS): A surgical training tool," The Journal of Urology, vol. 193, no. 4, pp.e271, May, 2015.
87 Peters and Terry, "Augmented-Reality Assisted Surgery on the Beating Heart," IEEE Toronto, 2015.
88 Giles Westerfield, Antonija Mitrovic and Mark Billinghurst, "Intelligent Augmented Reality Training for Motherboard Assembly," International Journal of Artificial Intelligence in Education, vol. 25, Issue 1, pp. 157-172, 2015.   DOI
89 M. Bajura and U. Neumann, "Dynamic registration correction in video-based augmented reality systems," IEEE Computer Graphics and Applications, vol. 15, no. 5, pp. 52-60, 1995.   DOI
90 R. Azuma and G. Bishop, "Improving static and dynamic registration in a see-through HMD," Computer Grphics (Proceedings of SIGGRAPH '94), pp. 197-204, 1994.
91 J. P. Mellor, "Enhanced reality visualization in a surgical environment," Master's thesis, Dept.of Electrical Enginerring, MIT, 1995.
92 J. P. Mellor, "Realtime camera calibration for enhanced reality visualization," in Proc. of Computer Vision, Virtual Reality, and Robotics in Medicine '95, pp. 471-475, 1995.
93 U. Neumann and Y. Cho, "A self-tracking augmented reality system," in Proc. of Virtual Reality Software and Technology '96, pp. 109-115, 1996.
94 S. M. Smith and J. M. Brady, "SUSAN - a new approach to low-level image processing," International Journal of Computer Vision, vol. 23, no. 1, pp. 45-78, 1997.   DOI
95 E. Rosten, "Machine Learning for High-speed Corner Detection," in Proc. of 9th European Conference on Computer Vision, pp. 430-443, May.2006.
96 ATHEER AiR$^{TM}$
97 Vuzix Augmented product
98 Meta 2 Development Kit
99 LAFORGE Shima
100 IEEE Spectrum Augmented Reality in a Contact Lens
101 D. Stredney and S. J. Weghorst, "The virtual retinal display: a new technology for virtual reality and augmented vision in medicine," Medicine Meets Virtual Reality: Art, Science, Technology: Healthcare (R) Evolution, vol. 50, pp.252, 1998. ISSN 0926-9630
102 Chryssi Birliraki, George Margetis , Nikolaos Patsiouras, Giannis Drossis and Constantine Stephanidis, "Enhancing the Customers' Experience Using an Augmented Reality Mirror," in Proc. of HCI International 2016 - Posters' Extended Abstracts, Volume 618 of the series Communications in Computer and Information Science , pp 479-484, 2016.
103 VR Interfaces Phantom
104 Abdulmotaleb El Saddik, Mauricio Orozco, Mohamad Eid and Jongeun Cha, "Multimedia Haptics," Haptics Technologies, Part of the series Springer Series on Touch and Haptic Systems pp 145-182, 2011.
105 Maestro AR$^{TM}$
106 Dhiraj Amin and Sharvari Govilkar, "Comparative study of augmented reality SDKs," International Journal on Computational Science & Applications (IJCSA), vol.5, no.1, 2015.
107 Augmented reality
108 D. H. Shin and P.S. Dunston, "Identification of application areas for augmented reality in industrial construction based on technology suitability," Automation in Construction, vol. 17, pp. 882-894, 2008.   DOI
109 Akash Bapat, Enrique Dunn and Jan-michael Frahm, "Kilo-Hertz 6-DoF visual tracking using an egocentric cluster of rolling shutter cameras," in Proc. of Mixed and Augmented Reality(ISMAR), 15th IEEE International Symposium on, 2016
110 G. Bleser, G. Hendeby and M. Miezal, "Using egocentric vision to achieve robust inertial body tracking under magnetic disturbances," in Proc. of Mixed and Augmented Reality(ISMAR), 10th IEEE International Symposium, 2011.
111 C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. of Fourth Alvey Vision Conference, pp. 147-151, 1988.
112 Sylvain Cardin, Howard Ogden, Daniel Perez-Marcos, John Williams and Tomo Ohno, "Neurogoggles for Multimodal Augmented Reality," in Proc. of the 7th Augmented Human International Conference 2016, no. 48, 2016.
113 U. Neumann and A. Majoros, "Cognitive, performance and systems issues for augmented reality applications in manufacturing and maintenance," IEEE Virtual Reality Annual International Symposium, pp. 4-11. 1998.
114 Jinwook, ShimYoonsik, Yang Nahyung, Kang Jonghoon, SeoTack-Don Han, "Gesture-based interactive augmented reality content authoring system using HMD," Virtual Reality, vol 20, Issue 1, pp 57-69, 2016.   DOI
115 Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua, "BRIEF: Binary Robust Independent Elementary Features," in Proc. of 11th European Conference on Computer Vision (ECCV), Heraklion, Crete. LNCS Springer, September ,2010.