Browse > Article
http://dx.doi.org/10.7840/kics.2013.38C.10.920

Stereoscopic Video Compositing with a DSLR and Depth Information by Kinect  

Kwon, Soon-Chul (광운대학교 정보콘텐츠대학원 디지털3D연구실)
Kang, Won-Young (광운대학교 정보콘텐츠대학원 디지털3D연구실)
Jeong, Yeong-Hu (광운대학교 정보콘텐츠대학원 디지털3D연구실)
Lee, Seung-Hyun (광운대학교 정보콘텐츠대학원 디지털3D연구실)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.38C, no.10, 2013 , pp. 920-927 More about this Journal
Abstract
Chroma key technique which composes images by separating an object from its background in specific color has restrictions on color and space. Especially, unlike general chroma key technique, image composition for stereo 3D display requires natural image composition method in 3D space. The thesis attempted to compose images in 3D space using depth keying method which uses high resolution depth information. High resolution depth map was obtained through camera calibration between the DSLR and Kinect sensor. 3D mesh model was created by the high resolution depth information and mapped with RGB color value. Object was converted into point cloud type in 3D space after separating it from its background according to depth information. The image in which 3D virtual background and object are composed obtained and played stereo 3D images using a virtual camera.
Keywords
3D Stereoscopic; Video compositing; Kinect; Depth keying; Depth map;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 B. Julesz, "Binocular depth perception of computer generated images," Bell Syst. Tech. J., vol. 39, no. 5, pp. 1125-1163, Sep. 1960.   DOI
2 A. Smolic, P. Kauff, S. Knorr, A. Hornung, M. Kunter, M. Mueller, and M. Lang, "Three-dimensional video postproduction and processing," Proc. IEEE, vol. 99, no. 4, pp. 607-625, Apr. 2011.   DOI   ScienceOn
3 K. Fukui, M. Hayashi, and Y. Yamanouchi, "A virtual studio system for TV program production," Soc. Motion Picture, Television Eng. (SMPTE) J., vol. 103, no. 6, pp. 386-390, June 1994.
4 G. J. Iddan and G. Yahav, "3D imaging in the studio," Proc. SPIE, vol. 4298, pp. 48-55, Apr. 2001.
5 S. C. Kwon, S. J. Lee, K. C. Son, Y. H. Jeong, and S. H. Lee, "High resolution 3D object generation with a DSLR and depth information by Kinect," J. Korean Soc. Computer Game, vol. 26, no. 1, pp. 221-227, Mar. 2013.
6 J. Park, H. Kim, Y.-W. Tai, M. S. Brown, and I. Kweon, "High quality depth map upsampling for 3D-TOF cameras," in Proc. IEEE Int. Conf. Computer Vision (ICCV), pp. 1623-1630, Barcelona, Spain, Nov. 2011.
7 K. Khoshelham and S. O. Elberink, "Accuracy and resolution of kinect depth data for indoor mapping applications," Sensor, vol. 12, no. 2, pp. 1437-1454, Feb. 2012.   DOI
8 R. A. Hamzah and S. I. Salim, "Software calibration for stereo camera on stereo vision mobile robot using Tsai's method," Int. J. Computer Theory Eng. (IJCTE), vol. 2, no. 3, pp. 390-394, June 2010.
9 H. Shin, S. Kim, and K. Sohn, "Hybrid stereoscopic camera system," J. Korean Soc. Broadcast Eng. (KOSBE), vol. 16, no. 4, pp. 602-613, July 2011.   과학기술학회마을   DOI   ScienceOn
10 C. Lee, H. Song, B. Choi, and Y.-S. Ho, "Multi-view generation using high resolution stereoscopic cameras and a low resolution Time-of-Flight camera," J. Korea Inst. Commun. Inform Sci. (KICS), vol. 37A, no. 4, pp. 239-249, Apr. 2012.   과학기술학회마을   DOI   ScienceOn
11 J. Zhang, L.-H. Wang, D.-X. Li, and M. Zhang, "High quality depth maps from stereo matching and ToF camera," in Proc. Int. Conf. Soft Comput. Pattern Recognition (SoCPaR), pp. 68-72, Dalian, China, Oct. 2011.
12 J. Kopf, M. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," ACM Trans. Graphics, vol. 26, no. 3, Article no. 96, July 2007.
13 G.-C. Lee and J. Yoo, "Real-time virtual-view image synthesis algorithm using Kinect camera," J. Korean Inst. Commun. Inform. Sci. (KICS), vol. 38c, no. 5, pp. 409-419, May 2013.   과학기술학회마을   DOI   ScienceOn
14 I. Schiller and R. Koch, "Improved video segmentation by adaptive combination of depth keying and Mixture-of-Gaussians," Lecture Notes in Computer Sci., Image Analysis, vol. 6688, pp. 59-68, May 2011.
15 B. Mediburu, 3D Movie Making, Focal Press, 2009.
16 A. R. Smith and J. F. Blinn, "Blue screen matting," in Proc. SIGGRAPH '96, pp. 259-268, New Orleans, U.S.A., Aug. 1996.
17 M. Ben-Ezra, "Segmentation with invisible keying signal," in Proc. IEEE Conf. Computer Vision Pattern Recognition, vol. 1, pp. 32-37, Hilton Head Island, U.S.A., June 2000.
18 S.-C. Kwon, J.-H. Kim, K.-C. Son, and A. Hamacher, "Acquisition of stereo composite images by depth keying in three dimensional space," J. Korean Soc. Computer Game, vol. 26, no. 2, pp. 139-145, June 2013.