International Journal of Internet, Broadcasting and Communication

  • 제16권1호
  • /
  • Pages.106-123
  • /
  • 2024
  • /
  • 2288-4920(pISSN)
  • /
  • 2288-4939(eISSN)
한국인터넷방송통신학회 (The Institute of Internet, Broadcasting and Communication)
권호 표지
DOI QR코드

DOI QR Code

Application of Virtual Studio Technology and Digital Human Monocular Motion Capture Technology -Based on <Beast Town> as an Example-

  • YuanZi Sang (Department of Visual Contents, Dongseo University) ;
  • KiHong Kim (Department of Visual Contents, Dongseo University) ;
  • JuneSok Lee (Department of Software Contents, Dongseo University) ;
  • JiChu Tang (Department of Visual Contents, Dongseo University) ;
  • GaoHe Zhang (Department of Visual Contents, Dongseo University) ;
  • ZhengRan Liu (Department of Visual Contents, Dongseo University) ;
  • QianRu Liu (Department of Visual Contents, Dongseo University) ;
  • ShiJie Sun (Department of Visual Contents, Dongseo University) ;
  • YuTing Wang (Department of Visual Contents, Dongseo University) ;
  • KaiXing Wang (Department of Visual Contents, Dongseo University)
  • 투고 : 2023.12.21
  • 심사 : 2024.01.22
  • 발행 : 2024.02.29
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

This article takes the talk show "Beast Town" as an example to introduce the overall technical solution, technical difficulties and countermeasures for the combination of cartoon virtual characters and virtual studio technology, providing reference and experience for the multi-scenario application of digital humans. Compared with the live broadcast that combines reality and reality, we have further upgraded our virtual production technology and digital human-driven technology, adopted industry-leading real-time virtual production technology and monocular camera driving technology, and launched a virtual cartoon character talk show - "Beast Town" to achieve real Perfectly combined with virtuality, it further enhances program immersion and audio-visual experience, and expands infinite boundaries for virtual manufacturing. In the talk show, motion capture shooting technology is used for final picture synthesis. The virtual scene needs to present dynamic effects, and at the same time realize the driving of the digital human and the movement with the push, pull and pan of the overall picture. This puts forward very high requirements for multi-party data synchronization, real-time driving of digital people, and synthetic picture rendering. We focus on issues such as virtual and real data docking and monocular camera motion capture effects. We combine camera outward tracking, multi-scene picture perspective, multi-machine rendering and other solutions to effectively solve picture linkage and rendering quality problems in a deeply immersive space environment. , presenting users with visual effects of linkage between digital people and live guests.

키워드

참고문헌

  1. WEI Y. Deep-learning-based motion capture technology in film and television animation production [J]. Security and communication networks, 2022(11):1-9.B. Sklar, Digital Communications, Prentice Hall, pp. 187, 1998.
  2. WANG YS, LANG X, DU YD, et al. Construction of live animation platform based on motion capture technology[C]// 2021 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC). Dalian, China: IEEE, 2021.
  3. Mahmood, Naureen, et al. "AMASS: Archive of motion capture as surface shapes." Proceedings of the IEEE/CVF international conference on computer vision. 2019.
  4. Van der Kruk, Eline, and Marco M. Reijne. "Accuracy of human motion capture systems for sport applications; state-of-the-art review." European journal of sport science 18.6 (2018): 806-819. https://doi.org/10.1080/17461391.2018.1463397
  5. Zordan, Victor Brian, et al. "Dynamic response for motion capture animation." ACM Transactions on Graphics (TOG) 24.3 (2005): 697-701. https://doi.org/10.1145/1073204.1073249
  6. Moeslund, Thomas B., and Erik Granum. "A survey of computer vision-based human motion capture." Computer vision and image understanding 81.3 (2001): 231-268. https://doi.org/10.1006/cviu.2000.0897
  7. YuanZi Sang, KiHong Kim, Yang Pan, From Technology to Content: Research on the Development of VR Flow Experience, The International Journal of Advanced Smart Convergence, (2003), Vol.11, No.3, pp.93-101. DOI: http://dx.doi.org/10.7236/IJASC.2022.11.3.93