Browse > Article

A Stereo Video Avatar for Supporting Visual Communication in a $CAVE^{TM}$-like System  

Rhee Seon-Min (이화여자대학교 컴퓨터학과)
Park Ji-Young (이화여자대학교 컴퓨터학과)
Kim Myoung-Hee (이화여자대학교 컴퓨터학과)
Publication Information
Journal of KIISE:Computer Systems and Theory / v.33, no.6, 2006 , pp. 354-362 More about this Journal
Abstract
This paper suggests a method for generating high qualify stereo video avatar to support visual communication in a CAVE$^{TM}$-like system. In such a system because of frequent change of light projected onto screens around user, it is not easy to extract user silhouette robustly, which is an essential step to generate a video avatar. In this study, we use an infrared reflective image acquired by a grayscale camera with a longpass filter so that the change of visible light on a screen is blocked to extract robust user silhouette. In addition, using two color cameras positioned at a distance of a binocular disparity of human eyes, we acquire two stereo images of the user for fast generation and stereoscopic display of a high quality video avatar without 3D reconstruction. We also suggest a fitting algorithm of a silhouette mask on an infrared reflective image into an acquired color image to remove background. Generated stereo images of a video avatar are texture mapped into a plane in virtual world and can be displayed in stereoscopic using frame sequential stereo method. Suggested method have advantages that it generates high quality video avatar taster than 3D approach and it gives stereoscopic feeling to a user 2D based approach can not provide.
Keywords
Video Avatar; Stereo Image Generation; CAVE$^{TM}$-like system;
Citations & Related Records
연도 인용수 순위
  • Reference
1 K.M. Cheung, S. Baker, and T. Kanade, 'Shape-From-Silhouette of Articulated Objects and its Use for Human Body Kinematics Estimation and Motion Capture,' Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June, 2003   DOI
2 V. Rajan, S. Subramanian, D.Keenan, A. Johswon, D. Sandin, T. Defanti, 'A Realistic Video Avatar System for Networked Virtual Environments,' IPT 2002, 2002
3 Youngjung Suh, Dongpyo Hong, Woontack Woo, '2.5D Video Avatar Augmentation for VR Photo,' ICAT 2003, 2003
4 T. Ogi, T. Yamada, K. Tamagawa, M. Kano, M. Hirose, 'Immersive Telecommunication Using Stereo Video Avatar,' IEEE VR200l, 2001
5 M. Naef, O. Staadt, and M. Gross. blue-c api: A multimedia and 3d video enhanced toolkit for collaborative vr and telepresence. In Proc. ACM SIGGRAPH Int'l Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI'04), 2004   DOI
6 T. Ogi, T. Yamada, Y. Kurita, Y. Hattori, M. Hirose, 'Usage of Video Avatar Technology for Immersive Communication,' First International Workshop on Language Understanding and Agents for RealWorld Interaction, 2003
7 김익재, 이상엽, 안상철, 권용무, 김형곤, '가상환경에서 다수의 실시간 비디오 아바타 생성기법'. HCI 2003, 2003
8 이원우, 우운택, 'Network 가상환경을 위한 단순화 된 2.5D 비디오 아바타 생성', HCI2004, 2004
9 S. Savarese, Camera Model and Triangulation, 'Notes for EE-148 : 3D Photography,' 2001
10 Rudolph E. Kalman, 'An Introduction to Kalman Filter,' University of North Carolina at Chapel Hill, Department of Computer Science, TR 95-041, 1995
11 A Fusiello et al., 'A Compact algorithm for rectification of stereo pairs,' Machine Vision and Application vol.12 pp.16-22, 2000   DOI
12 P. Debevec, C. Tchou, A. Wenger, T. Hawkins, A. Gardner, B. Emerson and A. Panday, 'A Lighting Reproduction Approach to Live-Action Compositing,' In Proceedings of the ACM SIGGRAPH 2002, 2002   DOI
13 R. Y. Tsai, 'An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision,' In proceedings of IEEE Computer Vision and Pattern Recognition, 1986
14 박지영, 이선민, 김명희, '혼합현실환경을 위한 능동적외선 기반 동적배경 제거', 2004 한국정보과학회 추계학술발표대회 논문집, 2004   과학기술학회마을
15 Matusik, Wojciech, 'Image-Based Visual Hulls,' Master of Science Thesis, Massachusetts Institute of Technology, 2001
16 Sang-Yup Lee, Ig-Jae Kim, Sang C Ahn, Heedong Ko, Myo-Taeg Lim, Hyoung-Gon Kim, 'Real Time 3D Avatar for Interactive Mixed Reality,' In Proceedings of the ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI '04), Singapore, 16-18 June 2004   DOI
17 Yasuda, K,Naemura, T,Harashima, H, 'Thermo-Key: Human Region Segmentation from Video, IEEE Computer Graphics and Applications,' Vol 24, No, 1, pp, 26-30, 2004   DOI   ScienceOn
18 M. Gross, S. Wuemlin, M. Naef, E. Lamboray, C. Spagno, A Kunz, E.Koller-Meier, T. Svoboda, L. V. Gool, S. Lang, K. Strehlke, M. A. Vande, O. Staadt, 'blue-c: A Spatially Immersive Display and 3D Video Portal for Telepresence,' in Proceedings of ACM SIGGRAPH 2003, pp, 819-827, 2003