Journal of KIISE:Computer Systems and Theory (한국정보과학회논문지:시스템및이론)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Registration of Video Avatar by Comparing Real and Synthetic Images

실제와 합성영상의 비교에 의한 비디오 아바타의 정합

  • 박문호 (삼성전자연구원) ;
  • 고희동 (한국과학기술연구원 영상미디어연구센터) ;
  • 변혜란 (연세대학교 컴퓨터과학과)
  • Published : 2006.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, video avatar, made from live video streams captured from a real participant, was used to represent a virtual participant. By using video avatar to represent participants, the sense of reality for participants can be increased, but the correct registration is also an important issue. We configured the real and virtual cameras to have the same characteristics in order to register the video avatar. Comparing real and synthetic images, which is possible because of the similarities between real and virtual cameras, resolved registration between video avatar captured from real environment and virtual environment. The degree of incorrect registration was represented as energy, and the energy was then minimized to produce seamless registration. Experimental results show the proposed method can be used effectively for registration of video avatar.

본 논문에서는 가상 환경의 참여자를 표현하기 위해 실제 참여자의 영상을 가상 환경에 실시간으로 제공하는 비디오 아바타를 사용하였다. 비디오 아바타의 사용은 참여자를 표현하는 정밀도를 높일 수 있지만 정확한 정합이 중요한 이슈가 된다. 비디오 아바타의 정합을 위해 실제 환경에서 사용되는 카메라와 가상 환경을 생성하기 위해 사용되는 가상 카메라의 특성을 동일하게 조정하였다. 조정된 실제와 가상 카메라의 유사성에 근거하여 실제와 합성 영상의 비교를 통하여 실제 환경에서 획득된 비디오 아바타가 가상 환경과 정합되도록 하였다. 비디오 아바타의 정합 과정에서는 정합의 부정확한 정도를 에너지로 표현하여 이를 최소화시키는 방법을 이용하였으며 실험을 통하여 제안된 방법이 가상 환경에서 비디오 아바타의 정합에 효과적으로 적용 가능함을 확인하였다.

Keywords

References

  1. Chris Greenhalgh and Steve Benford, 'Supporting rich and dynamic communication in large scale collaborative virtual environments,' Presence: Teleoperators and Virtual Environments, vol. 8, no. 1, pp. 14-35, 1999 https://doi.org/10.1162/105474699566026
  2. Jongwook jin, Moonho Park, Heedong Ko and Hyeran Byun, 'Immersive Telemeeting with Virtual Studio and CAVE,' Proceedings of International Workshop on Advanced Image Technology, pp. 15-20, Daejeon, Korea, February 2001
  3. Ronald Azuma, 'A Survey of Augmented Reality,' Presence: Teleoperators and Virtual Environments vol. 6, no. 4, pp. 355-385, 1997
  4. Paul Milgram and Fumio Kishino, 'A taxonomy of mixed reality visual displays,' IEICE Transactions on Information and Systems, Special issue on Networked Reality, vol. E77-D, no. 12, pp. 1321-1329, 1994
  5. Simon Gibbs, Costas Arapis, Christian Breiteneder, Vali Lalioti, Sina Mostafawy and Josef Speier, 'Virtual Studios: An Overview,' IEEE Multimedia, vol. 5, no. 1, pp. 18-35, 1998 https://doi.org/10.1109/93.664740
  6. Neal Stephenson, 'Snow Crash:' Bantam Books, 1992
  7. Tetsuro Ogi, Toshio Yamada, Yuji Kurita, Yoichi Hattori and Michitaka Hirose, 'Usage of Video Avatar Technology for Immersive Communication,' Proceedings of First International Workshop on Language Understanding and Agents for Real World Interaction, pp.24-31, Sapporo Japan, July 2003
  8. Youngjung Suh, Dongpyo Hong and Woontack Woo, '2.5D Video Avatar Augmentation for VRPhoto:' Proceedings of International Conference on Artificial Reality and Telexistence, vol.l2, pp.182-18, Tokyo Japan, Dec 2002
  9. Raphael Grasset, Julian Loose and Mark Billinghurst, 'OSGARToolkit: Tangible+Transitional 3D Collaborative Mixed Reality Framework,' Proceedings of International Conference on Artificial Reality and Telexistence, vol. 15, Christchurch New Zealand, Dec 2005 https://doi.org/10.1145/1152399.1152453
  10. Namgyu Kim, Woontack Woo and Makoto Tadenuma, 'Photo-realistic Interactive 3D Virtual Environment Generation Using Multiview Video:' Proceedings of SPIE PW-EI-VCIP'0I, vol. 4310, pp. 245-254, Jan 2001 https://doi.org/10.1117/12.411802
  11. Max Ratthaler, 'Virtual Studio Technology: An overview of the possible applications in television programme production:' European Broadcasting Union Technical Review, no 268, Summer 1996
  12. William H. Press, Saul A. Teukolsky, William T. Vetterling and Brian P. Flannery, 'Numerical recipes in C: The art of scientific computing,' Cambridge University Press, 1992
  13. Roger Y. Tsai, 'A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses,' IEEE Journal of Robotics and Automation, vol. RA-3, no.4, pp. 323-344, 1987 https://doi.org/10.1109/JRA.1987.1087109
  14. James D. Foley, Andries van Dam, Steven K. Feiner and John F. Hughes, 'Computer Graphics: Principle and Practice,' Addison-Wesley Publishing Company, 1990
  15. Mason Woo, Jackie Neider and Tom Davis, 'OpenGL Programming Guide, Second Edition: The Official Guide to Learning OpenGL,' Version 1.1, Addison-Wesley, 1997
  16. George Eckel, Ken Jones and Tammy Domeier, 'OpenGL Perfomer Getting Started Guide,' Silicon Graphics Incorporated Technical Publications Series, November 2000