The Journal of Korean Institute of Communications and Information Sciences (한국통신학회논문지)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지
DOI QR코드

DOI QR Code

Transmitting Devices Selection Based on Viewpoint Popularity for Wireless Free-Viewpoint Video Streaming

무선 자유시점 비디오 스트리밍에서 인기도 기반 전송 기기 선택 기법

  • Koo, Jae-Woo (Ajou University Department of Computer Engineering) ;
  • Cho, Young-Jong (Ajou University Department of Software and Computer Engineering) ;
  • Kang, Kyungran (Ajou University Department of Software and Computer Engineering)
  • Received : 2016.02.16
  • Accepted : 2016.05.09
  • Published : 2016.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Free-viewpoint video (FVV) is a synthesization technology that generates a virtual viewpoint video using multiple videos recorded via wireless devices at heterogeneous locations. In order to introduce a new service that grafts the FVV onto the real-time streaming service using wireless devices, we need to overcome several constraints. Two main factors of those constraints are the limited wireless capacity that are shared fairly by multiple devices, and the transmission time constraint with which live streaming services have to comply. Therefore, for optimal quality of entire videos, a set of transmitting devices should be effectively selected depending on the condition of wireless channel and the required video popularity of specific viewpoint requested from users. For optimal selection, this study proposes a heuristic algorithm that takes into account the aforementioned factors from possible wireless transmission error behaviors and the requested viewpoint popularity. Through analysis and simulation, we show that with this algorithm, quality of most popular viewpoint videos is guaranteed. Furthermore, performance comparison against the existing scheme which is based only on the location of recording devices is made.

다수의 무선 기기를 통해 하나의 대상을 촬영하여, 이 영상을 통해 실제로 촬영하지 않은 위치에서 바라볼 때의 영상으로 합성하는 기술을 자유시점 비디오라고 한다. 이 기술을 무선기기를 이용한 실시간 스트리밍 서비스에 접목하면 사용자에게 새로운 서비스를 제공할 수 있으나, 모든 시점에서 촬영한 영상을 전부 전송하기에는 다수의 전송 기기가 공유하는 무선 자원의 제한과, 스트리밍 서비스가 가지는 시간적 제약으로 인한 어려움이 해결되어야 한다. 따라서, 최적의 품질을 위해서는 무선 채널의 상태와 사용자의 요청 비율을 고려하여, 서버로 전송하는 기기들을 효과적으로 선별해야 할 필요가 있다. 본 연구는 실시간 자유시점 비디오 스트리밍 서비스 환경을 가정하고, 전송 과정에서 발생할 수 있는 무선 채널 오류와 다양한 시점에 대한 사용자들의 인기도를 반영하여, 최적 품질을 보장하는 전송기기 집합을 선별하는 추단적 알고리즘을 제안한다. 성능분석을 통해 제안된 방식은 가장 인기도가 높은 시점의 품질이 우선적으로 보장되는 효과를 가짐을 보였다. 또한, 이 알고리즘의 성능을 촬영 기기의 위치만을 고려한 기존 연구의 방식과 비교한다.

Keywords

References

  1. J. Yang, M. Kim, J. Jeon, and G. Park, "Implement free-viewpoint image through spherical mapping of 360 degree panorama image," in Proc. KICS Winter Conf. 2015, pp. 1163-1164, Jung-sun, Korea, Jan. 2015.
  2. S. Kodera, et al., "Multi-view video streaming with mobile cameras," in Proc. GLOBECOM 2014, pp. 1412-1417, Austin, USA, Dec. 2014.
  3. L. Toni, et al., "Interactive free viewpoint video streaming using prioritized network coding," in Proc. 2013 IEEE 15th Int. Workshop on Multimedia Signal Process. (MMSP), pp. 446-451, Pula, Italy, Oct. 2013.
  4. M. Tanimoto, "Overview of FTV," in Proc. 2009 IEEE Int. Conf. Multimedia and Expo, pp. 1552-1553, New York, USA, Jul. 2009.
  5. K. Muller, et al., "View synthesis for advanced 3D video systems," EURASIP J. Image and Video Process, vol. 2008, no. 4, Sept. 2008.
  6. T. Fujihashi, et al., "UMSM: A traffic reduction method on multi-view video streaming for multiple users," IEEE Trans. Multimedia, vol. 16, no. 1, pp. 228-241, Sept. 2013. https://doi.org/10.1109/TMM.2013.2281588
  7. J. Kim, M. Choi, Y. Baek, D. Kim, H. Kim, and J. Yoo, "Multi-view video coding with view scalability," J. KICS, vol. 32, no. 8, pp. 703-711, Aug. 2007.
  8. S. Knorr, et al., "From 2D-to stereo-to multi-view video," in Proc. 2007 3DTV Conf., pp. 1-4, Kos Island, Greece, May 2007.
  9. J. Koo, Y. Seo, H. Choi, J. Yoo, and D. Kim, "Intermediate depth image generation using disparity increment of stereo depth images," J. Broadcast. Eng., vol. 17, no. 2, pp. 363-373, Mar. 2012. https://doi.org/10.5909/JEB.2012.17.2.363
  10. J. Koo, H. Choi, Y. Seo, and D. Kim, "Fast virtual image generation using stereo matching of depth images," in Proc. Korean Soc. Broadcast Engineers Conf., pp. 126-129, Jeju Island, Korea, Jul. 2012.
  11. A. Park, D. Lee, Y. Kim, K. Lee, W. Jang, Y. Park, and J. Kim, "3D video reconstruction and rendering from multiple RGB-D cameras," in Proc. KICS Int. Conf. Commun., pp. 1075-1076, Jeju Island, Korea, Jun. 2014.
  12. K. Karsch, C. Liu, and S. Kang, "Depth extraction from video using non-parametric sampling," in Proc. ECCV'12, vol. Part V, pp. 775-788, Florence, Italy, Oct. 2012.
  13. Y. Yuan, B. Hu, G. Cheung, and V. Zhao, "Optimizing peer grouping for live free viewpoint video streaming," in Proc. 2013 IEEE Int. Conf. Image Process. (ICIP), pp. 1593-1597, Melbourne, Australia, Sept. 2013.
  14. D. Ren, S. G. Chan, G. Cheung, V. Zhao, and P. Frossard, "Collaborative P2P streaming of interactive live free viewpoint video," arXiv: 1211.4767, Nov. 2012.
  15. R. Zhang, S. L. Regunathan, and K. Rose, "Optimized video streaming over lossy networks with real-time estimation of end-to-end distortion," in Proc. IEEE ICME '02, vol. 1, pp. 861-864, Lausanne, Switzerland, Aug. 2002.
  16. Z. Chen and D. Wu, "Prediction of transmission distortion for wireless video communication: Analysis," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1123-1137, Mar. 2012. https://doi.org/10.1109/TIP.2011.2168411
  17. Y. Ho, "A survey on international standards for super multi-view video," KICS Inf. & Commun. Mag., vol. 32, no. 3, pp. 3-10, Feb. 2015.

Cited by

  1. 영역 분할을 이용한 변형된 스위칭 필터에 관한 연구 vol.41, pp.10, 2016, https://doi.org/10.7840/kics.2016.41.10.1284