Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Multi-screen Content Creation using Rig and Monitoring System

다면 콘텐츠 현장 촬영 시스템

  • Received : 2017.08.11
  • Accepted : 2017.12.07
  • Published : 2017.12.08
Download PDF
⟨ Previous Next ⟩

Abstract

Filming using multiple cameras is required for the production of the multi-screen content. It can fill the viewer's field of view (FOV) entirely to provide an increased sense of immersion. In such a filming scenario, it is very important to monitor how images captured by multiple cameras are displayed as a single content or how the content will be displayed in an actual theatre. Most recent studies on creating the content of special format have been focused on their own purposes, such as stereoscopic and panoramic images. There is no research on content creation optimized for theatres that use three screens that are spreading recently. In this paper, we propose a novel content production system with a rig that can control three cameras and monitoring software specialized for multi-screen content. The proposed rig can precisely control the angles between the cameras and capture wide angle of view with three cameras. It works with monitoring software via remote communication. The monitoring software automatically aligned the content in real time, and the alignment of the content is updated according to the angle of camera rig. Futher, the producion efficiency is greatly improved by making the alignment information available for post-production.

시청자의 시야를 콘텐츠로 가득 채워주어 강한 몰입감을 제공하는 다면 영상 제작을 위해서는 다수의 카메라를 이용한 촬영이 요구된다. 이러한 촬영 시나리오에서는 다수의 카메라에 의해 촬영되고 있는 화면들이 하나의 콘텐츠로써 어떻게 보여질지 혹은 실제 상영관에서 어떻게 보여질지 확인하는 모니터링 과정이 매우 중요하다. 기존의 특수 포맷 영상 촬영에 관한 연구들은 모두 스테레오스코픽 입체 영상이나 파노라마 영상 등 각자의 목적에 집중하여 이루어져 왔으며, 최근 확산되고 있는 세 개의 면을 이용한 다면 상영관에 최적화된 콘텐츠 제작에 관한 연구는 부재하다. 본 논문에서는 세 대의 카메라를 제어할 수 있는 리그와 다면 영상 포맷에 특화된 모니터링 소프트웨어를 이용한 다면 콘텐츠 현장 촬영 시스템을 제안한다. 제안된 리그는 카메라 간의 각도를 정밀하게 조절하여 세 대의 카메라로 넓은 화각을 촬영할 수 있으며, 원격 통신을 통해 모니터링 소프트웨어와 연동된다. 모니터링 소프트웨어는 실시간으로 들어오는 영상들을 자동으로 정렬해주며, 수신 받은 리그의 각도에 따라 영상의 정렬이 자동으로 업데이트된다. 또한 촬영 시에 얻어진 정렬 정보를 후반작업에 사용할 수 있게 함으로써, 제작 효율을 크게 향상시킨다.

Keywords

References

  1. J. Lee, S. Lee, Y. Kim, and J. Noh, "ScreenX: Public immersive theatres with uniform movie viewing experiences," IEEE Transactionson Visualization and Computer Graphics, vol. 23, no. 2, pp. 1124-1138, 2016.
  2. Barco, "Barco escape," 2014. [Online]. Available: http://www.ready2escape.com
  3. S. Yi and N. Ahuja, "An omnidirectional stereo vision system using a single camera," in Pattern Recognition, 2006. ICPR 2006.18th International Conferenceon, vol.4. IEEE, 2006, pp. 861-865.
  4. S. Heinzle, P. Greisen, D. Gallup, C. Chen, D. Saner, A. Smolic, A. Burg, W. Matusik, and M. Gross, "Computational stereo camera system with programmable control loop," in ACM Transactions on Graphics (TOG), vol. 30, no. 4. ACM, 2011, p. 94.
  5. A. Weffers-Albu, S. de Waele, W. Hoogenstraaten, and C. Kwisthout, "Immersive tv viewing with advanced ambilight," in Consumer Electronics (ICCE), 2011 IEEE International Conference on. IEEE, 2011, pp. 753-754.
  6. A. Ghosh, M. Trentacoste, H. Seetzen, and W. Heidrich, "Real illumination from virtual environments," in ACM SIGGRAPH 2005 Sketches. ACM, 2005, p. 41.
  7. C. Cruz-Neira, D. J. Sandin, and T. A. DeFanti, "Surround-screen projection-based virtual reality: the design and implementation of the cave," in Proceedings of the 20th annual conference on Computer graphics and interactive techniques. ACM, 1993, pp. 135-142.
  8. A. Simon and M. Gobel, "The i-cone/spl trade/-a panoramic display system for virtual environments," in Computer Graphics and Applications, 2002. Proceedings. 10th Pacific Conference on. IEEE, 2002, pp. 3-7.
  9. M. McGinity, J. Shaw, V. Kuchelmeister, A. Hardjono, and D. D. Favero, "Avie: a versatile multi-user stereo 360 interactive vr theatre," in Proceedings of the 2007 workshop on Emerging displays technologies: images and beyond: the future of displays and interacton. ACM, 2007, p. 2.
  10. P. Mills, A. Sheikh, G. Thomas, and P. Debenham, "BBC surround video," 2011. [Online]. Available: http://www.bbc.com/news/magazine-22315685
  11. B. R. Jones, H. Benko, E. Ofek, and A. D. Wilson, "IllumiRoom: peripheral projected illusions for interactive experiences," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2013, pp. 869-878.
  12. B. Jones, R. Sodhi, M. Murdock, R. Mehra, H. Benko, A. Wilson, E. Ofek, B. MacIntyre, N. Raghuvanshi, and L. Shapira, "Roomalive: Magical experiences enabled by scalable, adaptive projector-camera units," in Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 2014, pp. 637-644.
  13. W.-Y. Lin,S. Liu,Y. Matsushita, T.-T. Ng, and L.-F. Cheong, "Smoothly varying affine stitching," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 345-352.
  14. S. Li, L. Yuan, J. Sun, and L. Quan, "Dual-feature warping-based motion model estimation," in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 4283-4291.
  15. C.-H. Chang, Y. Sato, and Y.-Y. Chuang, "Shape-preserving half-projective warps for image stitching," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 3254-3261.
  16. C.-C. Lin, S. U. Pankanti, K. N. Ramamurthy, and A. Y. Aravkin, "Adaptive as-natural-as-possible image stitching," in Proceedings of the IEEE Conference on Computer Visionand Pattern Recognition, 2015, pp. 1155-1163.
  17. H.-Y. Shum and R. Szeliski, "Systems and experiment paper: Construction of panoramic image mosaics with global and local alignment," International Journal of Computer Vision, vol. 36, no. 2, pp. 101-130, 2000. https://doi.org/10.1023/A:1008195814169
  18. F. Perazzi, A. Sorkine-Hornung, H. Zimmer, P. Kaufmann, O. Wang, S. Watson, and M. Gross, "Panoramic video from unstructured camera arrays," Computer Graphics Forum, vol. 34, no. 2, pp. 57-68, 2015.
  19. J. Lee, B. Kim, K. Kim, Y. Kim, and J. Noh, "Rich360: optimized spherical representation from structured panoramic camera arrays," ACM Transactions on Graphics (TOG), vol. 35, no. 4, p. 63, 2016.

Cited by

  1. 멀티스크린의 발전과 초고화질 콘텐츠 응용에 대한 연구 vol.18, pp.6, 2017, https://doi.org/10.22678/jic.2020.18.6.033