Browse > Article
http://dx.doi.org/10.5909/JBE.2022.27.5.654

A Study on Immersive Content Production and Storytelling Methods using Photogrammetry and Artificial Intelligence Technology  

Kim, Jungho (Graduate School of Advanced Image Science, Multimedia and Film, Chunag-Ang University)
Park, JinWan (Department of Computer Art, College of Art and Technology, Chung-Ang University)
Yoo, Taekyung (Graduate School of Advanced Image Science, Multimedia and Film, Chunag-Ang University)
Publication Information
Journal of Broadcast Engineering / v.27, no.5, 2022 , pp. 654-664 More about this Journal
Abstract
Immersive content overcomes spatial limitations through convergence with extended reality, artificial intelligence, and photogrammetry technology along with interest due to the COVID-19 pandemic, presenting a new paradigm in the content market such as entertainment, media, performances, and exhibitions. However, it can be seen that in order for realistic content to have sustained public interest, it is necessary to study storytelling method that can increase immersion in content rather than technological freshness. Therefore, in this study, we propose a immersive content storytelling method using artificial intelligence and photogrammetry technology. The proposed storytelling method is to create a content story through interaction between interactive virtual beings and participants. In this way, participation can increase content immersion. This study is expected to help content creators in the accelerating immersive content market with a storytelling methodology through virtual existence that utilizes artificial intelligence technology proposed to content creators to help in efficient content creation. In addition, I think that it will contribute to the establishment of a immersive content production pipeline using artificial intelligence and photogrammetry technology in content production.
Keywords
Immersive Contents; Photogrammetry; Artificial Intelligene; Virtual Beings; eXtented Reality;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Huynh-The, Thien, et al., "Artificial Intelligence for the Metaverse: A Survey", arXiv preprint arXiv:2202. 10336, 2022. doi: https://doi.org/10.48550/arXiv.2202.10336   DOI
2 Comparison of Top 10 Speech Processing APIs, https://medium.com/activewizards-machine-learning-company/comparison-of-top-10-speech-processing-apis-2293de1d337f
3 C. Anthes, R. J. G. Hernandez, M. Wiedemann, D. Kranzlmuller, "State of the Art of Virtual Reality Technologies", 2016 IEEE Aerospace Conference, Montana, United States, 2016. doi: https://doi.org/10.1080/08856257.2011.593831   DOI
4 H. Shin, "The Freedom of Viewpoint in VR Contents: With a Focus on Lost, an Animation", The Korean Journal of animation, Vol.12, No.4, pp.87-102, 2016.
5 E. Leem, "Design and Development of XR Contents Authoring Framework for IT Convergence Education", Journal of Advanced Navigation Technology, Vol.24, No.6, pp.633-539, September 2020. doi: https://doi.org/10.12673/jant.2020.24.6.633   DOI
6 The Mandalorian leads the way: Real-time virtual production is saving hollywood during the lockdown, https://www.indiewire.com/2020/05/the-mandalorian-real-time-virtual-production-saving-hollywood-lockdown-vfx-120230120/
7 M. Choi, "Augmented Reality and Storytelling", The Society of Korean Language & Culture, Vol.0, No.73, pp.433-459, 2020.
8 Geigel, Joe, et al, "The digital docent: XR Storytelling for a Living History Museum", In 26th ACM Symposium on Virtual Reality Sofeware and Technology, pp. 1-3, 2020. doi: https://doi.org/10.1145/3385956.3422090   DOI
9 J. Cohn, "The Scientist of the Holy Ghost: Sunsrping and Reading Nonsense", Journal of Cinema and Media Studies, Vol.60, No.5, pp.1-21, 2021.   DOI
10 T. P. Caudell and D. W. Mizell, "Augmented reality: an application of heads-up display technology to manual manufacturing processes", in Proceedings of the Twenty-Fifth Hawaii Interanational Conference on System Science, Vol.2, pp.659-669, 1992.
11 P. Chen, X. Liu, and R. Huang, "A review of using Augmented Reality in Education from 2011 to 2016", Innovations in Smart Learning, pp.13-18, 2017.
12 F. Tao, H. Zhang, A. Liu, and A. Y. C. Nee, "Digital twin in industry:State-of-the-art", IEEE Transactions on Industrial Informatics, Vol.15, No.4, pp.2405-2415, April, 2019. doi: https://doi.org/10.1109/TII.2018.2873186   DOI
13 M. Daniluk, T. Rocktaschel, J. Welbl, and S. Riedel, "Frustraingly short attention spans in neural language modeling", arXiv preprint arxiv:1702.04521, 2017
14 D. Liu, J. Fu, Q. Qu, and J. Lv, "BFGAN: backward and forwad generative adversarial networks for lexically constrained sentence generation", IEEEE/ACM Transaction on Audio, Speech, and Language Processing, Vol.27, No.12, pp.2350-2362, December, 2019   DOI
15 M. Flasinski, Introduction to artificial intelligence, Springer International Publishing, Switzeland, pp.3-14, 2016.
16 Market spending on extended reality(XR) technologie worldwide from 2018 to 2023, by industry, https://www.statista.com/statistics/1096765/global-market-spend-on-xr-technologies-by-industry
17 T. Yoo, "A Study on Storytelling of VR Cartoons", Journal of braodcast engineering, Vol.23, No.1, pp.45-52, 2018. doi: https://doi.org/10.5909/JBE.2018.23.1.45   DOI
18 N. Skult and J. Smed, "Interactive Storytelling in Extended Reality: Concepts for the Design", In: Game User Experience and PlayerCentered Design, pp. 449-467, 2020. doi: https://doi.org/10.1007/978-3-030-37643-7_21   DOI
19 D. Chen, D. Wang, Y. Zhu, and Z. Han, "Digital twin for federated analytics using a bayesian approach", IEEE Internet of Things Journal, Vol.8, No.22, pp.16301-16312, November, 2021. doi: https://doi.org/10.1109/JIOT.2021.3098692   DOI
20 J. Decker, A. Doherty, J. Geigel, and G. D. Jacobs, "Blending Diciplines for a Blended Reality: Virtual Guides for a Living History Museum", The Journal of Interactive Technology & Pedagogy, Vol.17, May, 2020.
21 J. Kang, "A Case Study on Application of Realistic Content to Space Design", Journal of Digital Convergence, Vol.15, No.6, pp. 369-376, 2017 doi: https://doi.org/10.14400/JDC.2017.15.6.369   DOI
22 H. Rheingold, Virtual Reality, Summit Books, 1991