Browse > Article
http://dx.doi.org/10.15701/kcgs.2015.21.5.21

Interactive VFX System for TV Virtual Studio  

Byun, Hae Won (School of Information Technology, Sungshin Women's University)
Publication Information
Journal of the Korea Computer Graphics Society / v.21, no.5, 2015 , pp. 21-27 More about this Journal
Abstract
In this paper, we presents visual effect(water, fire, smoke) simulation and interaction system for TV virtual studio. TV virtual studio seamlessly synthesizes CG background and a live performer standing on a TV green studio. Previous virtual studios focus on the registration of CG background and a performer in real world. In contrast to the previous systems, we can afford to make new types of TV scenes more easily by simulating interactive visual effects according to a performer. This requires the extraction of the performer motion to be transformed 3D vector field and simulate fluids by applying the vector field to Navier Stokes equation. To add realism to water VFX simulation and interaction, we also simulate the dynamic behavior of splashing fluids on the water surface. To provide real-time recording of TV programs, real-time VFX simulation and interaction is presented through a GPU programming. Experimental results show this system can be used practically for realizing water, fire, smoke VFX simulation and the dynamic behavior simulation of fish flocks inside ocean.
Keywords
Virtual Studio; VFX Simulation; VFX Interaction; Interactive VFX; Realtime VFX; High Quality VFX; Performer Tracking; Kinect; Depth Camera; Fluid Simulation; Splash Simulation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 L. Blonde, M. Buck, R. Galli, W. Niem, Y. Paker, W. Schmidt, and G. Thomas, "A Virtual Studio for Live Broadcasting: The Mona Lisa Project", IEEE Multimedia, Vol.3, No.2, pp. 18-29, 1996.   DOI
2 Seongwoo Park, Yongduek Seo, and Kisang Hong, "Real-Time Camera Calibration for Virtual Studio", Real Time Imaging, Vol.6, Issue 6, pp. 433-448, 2000.   DOI
3 Woontack Woo, G.J. Kim, Chanmo Park, "3D Virtual Studio for Natural Interacting", IEEE Transactions on Systems, Man and Cybernetics, Vol.36, Issue 4, pp. 758-773, 2006.   DOI
4 Yunhao Li, Maojun Zhang, Bing Yang, and Lingda Wu, "Camera Tracking in Virtual Studio", Proc. SPIE 4553, Visualization and Optimization Techniques, 2001.
5 H. W. Byun, "Interactive Visual Effect Simulation for TV Virtual Studio", International Journal of Applied Engineering Research, Vol.10, No.21, pp. 41780-41785, 2015
6 VizRT, http://www.vizrt.com
7 Brainstorm, http://www.brainstorm.es/
8 M. Ihmsen, J. Orthmann, B. Solenthaler, A. Kolb, and M. Teschner, "SPH fluids in computer graphics," Eurographics, 2014.
9 T. Amada, M. Imura, Y. Yasumuro, Y. Manabe, and K. Chihara, "Particle-based fluid simulation on GPU," SIGGRAPH, 2004.
10 K. Hegeman, N. A. Carr, and G. Miller, "Particle-based fluid simulation on the GPU," Computational Science-ICCS, vol.3994 of Lecture Notes in Computer Science, pp. 228-235, 2006.
11 Y. Zhang, B. Solenthaler, and R. Pajarola, "Adaptive sampling and rendering of fluids on the GPU," Proceedings of IEEE/EG Symposium on Volume and Point-Based Graphics, pp. 137-146, 2008.
12 N. Bell, YU Y., and P.J. Mucha, "Particle-based simulation of granular materials". ACM SIGGRAPH/ Eurographics Symposium on Computer Animation, pp. 77-86, 2005.
13 "Particle-based realistic simulation of fluid-solid interaction". Computer Animation and Virtual Worlds, Vol.21, No.6, pp. 89-595. 2010.
14 M. Muller, S. Schirm, M. Teschner, B. Heidelberger, and M. Gross, "Interaction of fluids with deformable solids". Computer Animation and Virtual Worlds, Vol.15, No.3-4, pp. 159-171. 2004.   DOI
15 M. Becker, H. Tessendorf, and M. Teschner, Direct forcing for lagrangian rigid-fluid coupling. IEEE Transactions on Visualization and Computer Graphics, Vol.15, No.3, pp. 493-503, 2009.   DOI
16 R. Weller and G. Zachmann, "Inner sphere trees and their application to collision detection". Virtual Realities. pp. 181 -202, 2011.
17 R. Weller and G. Zachmann, "Inner Sphere Trees". Tech. Report, pp. 08-09, 2008.
18 R. Weller and G. Zachmann, "Inner sphere trees for proximity and penetration queries." Robotics: Science and Systems Conference, 2009.
19 R. Weller and G. Zachmann, "Stable 6-DOF haptic rendering with inner sphere trees." International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, 2009.
20 R. P. Fedkiw, "Coupling an eulerian fluid calculation to a lagrangian solid calculation with the ghost fluid method", Journal of Computational Physics, Vol.175, No.1, pp. 200-224. 2002.   DOI
21 Jos Stam, "Stable Fluids", SIGGRAPH 99 Conference Proceedings, pp. 121-128, 1999.
22 Andrew Selle, Nick Rasmussen, and Ronald Fedkiw, "A vortex particle method for smoke, water and explosions" ACM Transactions on Graphics (TOG), Vol.24, Issue 3, pp. 910-914, 2005.