DOI QR코드

DOI QR Code

Adaptive Multi-view Video Service Framework for Mobile Environments

이동 환경을 위한 적응형 다시점 비디오 서비스 프레임워크

  • Kwon, Jun-Sup (Kangwon National University, Dept. of Computer Engineering) ;
  • Kim, Man-Bae (Kangwon National University, Dept. of Computer Engineering) ;
  • Choi, Chang-Yeol (Kangwon National University, Dept. of Computer Engineering)
  • 권준섭 (강원대학교 컴퓨터정보통신공학과) ;
  • 김만배 (강원대학교 컴퓨터정보통신공학과) ;
  • 최창열 (강원대학교 컴퓨터정보통신공학과)
  • Published : 2008.09.30

Abstract

In this paper, we propose an adaptive multi-view video service framework suitable for mobile environments. The proposed framework generates intermediate views in near-realtime and overcomes the limitations of mobile services by adapting the multi-view video according to the processing capability of a mobile device as well as the user characteristics of a client. By implementing the most of adaptation processes at the server side, the load on a client can be reduced. H.264/AVC is adopted as a compression scheme. The framework could provide an interactive service with efficient video service to a mobile client. For this, we present a multi-view video DIA (Digital Item Adaptation) that adapts the multi-view video according to the MPEG-21 DIA multimedia framework. Experimental results show that our proposed system can support a frame rate of 13 fps for 320{\times}240 video and reduce the time of generating an intermediate view by 20 % compared with a conventional 3D projection method.

본 논문에서는 이동 환경에서 다시점 비디오를 제공하는 적응형 다시점 비디오 서비스 프레임워크를 제안한다. 중간시점 영상의 실시간 생성과 다시점 비디오의 클라이언트 적응을 통해 이동 환경이 갖는 성능 제약을 해결한다. 그리고 적응 변환 작업을 서버에서 수행함으로써 클라이언트의 부하를 줄이고, H.264/AVC를 채택하여 비디오의 압축 효율을 개선한다. 이를 위해, 멀티미디어 프레임워크 표준인 MPEG-21 DIA (Digital Item Adaptation)를 참조하여, 사용자 요구와 클라이언트 기기의 특성에 맞도록 비디오를 적응시키는 이동 환경을 위한 새로운 다시점 비디오 DIA를 구현한다. 제안 프레임워크의 효율성과 성능을 측정한 결과, 다시점 비디오의 이동 서비스는 양방향으로 해상도가 $320{\times}240$이면, 최대 초당 13 프레임까지 가능하고, 기존 3D 점의 투영 방법과 비교하여 5배 빠른 중간시점 영상을 생성한다.

Keywords

References

  1. A. Smolic and P. Kauff, "Interactive 3D video representation and coding technologies," Proc. of the IEEE, Spatial Issue on Advan- ces in Video Coding and Delivery, Vol. 93, pp. 99-110, 2005
  2. A. Redert, M. Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. Gool, E. Ofek, I. Sexton, and P. Surman, "Advanced three-dimensional television system technologies," Proc. 3D Data Processing Visualization and Transmission, 2002
  3. A. Vetro, W. Matusik, H. Pfister, and J. Xin, "Coding approaches for end-to-end 3D TV systems," Picture Coding Symposium, 2005
  4. J. G. Lou , H. Cai and K. Li, "A real-time interactive multi-view video system," Multimedia 2005: Proc. of the 13th annual ACM international conference on multimedia, pp. 161-170, 2005 ACM Press
  5. Z. Yang. B. Yu, K. Nahrstdet, and R. Bajscy, "A multi-stream adaptation framework for bandwidth management in 3D tele-immersion," Network and Operating System Support for Digital Audio and Video (NOSSDAV) 2006, May 2006
  6. "MPEG-21 DIA AM(v3.0)," ISO/IEC JTC 1/SC 29/WG 11/ N5179, October 2002
  7. L. McMillan, "An image-based approach to three-dimensional computer graphics," Ph.D thesis, University of North Carolina, 1997
  8. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2nd edition, 2003
  9. http://iphome.hhi.de/suehring/tml
  10. http://research.microsoft.com/vision/Interactive- VisualMediaGroup/3DVideo Download/, MSR