Browse > Article
http://dx.doi.org/10.7472/jksii.2019.20.1.47

Implementation Method for DASH-based Free-viewpoint Video Streaming System  

Seo, Minjae (Dept. of Computer, Seoul Women's University)
Paik, Jong-ho (Dept. of Software Convergence, Seoul Women's University)
Publication Information
Journal of Internet Computing and Services / v.20, no.1, 2019 , pp. 47-55 More about this Journal
Abstract
Free-viewpoint video (FVV) service provides multi viewpoints of contents and synthesizes intermediate video files which are not captured on some view angles so that enables users to watch as they choose wherever they want. Synthesizing video is necessary technique to provide FVV video service, because every video of the FVV contents for different view angles cannot be stored to the content server physically. For the reason, fast view synthesis can improve the quality of video service and increase user's satisfaction. One of the studies for FVV service, a method was proposed to transmit FVV service based on DASH (Dynamic Adaptive Streaming over HTTP). There is big advantage on using DASH that it is commonly used to transport video service. However, the method was only a conceptual proposal, so it is difficult to implement the system using the proposal. In this paper, we propose an implementation method to provide real-time FVV service smoothly. We suggest a system structure and operation method on the server and client side in detail, which is to be applicable to synthesize video quickly. Also, we suggest generating FVV service map additionally which controls a FVV service overall. We manage real-time information of the whole service through the service map. The service can be controlled by reducing the possible delay from network situation.
Keywords
Free-viewpoint Video; DASH; Multi-viewpoint; FVV; Streaming Service; Immersive Video;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 M. Tanimoto, M. P. Tehrani, T. Fujii and T. Yendo, "Free-Viewpoint TV," IEEE Signal Processing Magazine, pp.67-76, 2011. https://doi.org/10.1109/MSP.2010.939077   DOI
2 A. Hamza and M. Hefeeda, "A DASH-based Free Viewpoint Video Streaming System," In Proc. of the ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, pp. 55-60, 2014. https://doi.org/10.1145/2597176.2578276   DOI
3 A. Huszak, "Advanced Free Viewpoint Video Streaming Techniques," Multimedia Tools and Applications, January, pp.373-396, 2017. https://doi.org/10.1007/s11042-015-3048-9   DOI
4 https://www.youtube.com/watch?v=lrMcdaEzonA, "Correspondence and Depth-Image Based Rendering".
5 ISO/IEC 23009-1, "Information technology - Dynamic adaptive streaming over HTTP (DASH) - Part 1: Media presentation description and segment formats," 2012.
6 ISO/IEC 23008-1, "Information technology - High efficiency coding and media delivery in heterogeneous environments - Part1: MPEG media transport (MMT)", 2014.
7 Y. Chen, Y. K. Wang, K. Ugur, M. M. Hannuksela, J. Lainema and M. Gabbouj, "The emerging MVC standard for 3D video services," EURASIP Journal on Advances in Signal Processing, December, pp. 1-13, 2008. https://doi.org/10.1155/2009/786015   DOI
8 A. Huszak, "Optimization of distributed free-viewpoint video synthesis," 3DTV-Conference: The True Vision - Capture Transmission and Display of 3D Video, pp.1-4, 2014. https://doi.org/10.1109/3DTV.2014.6874738   DOI
9 T. Su, A. Sobhani, A. Yassine, S. Shirmohommadi and A. Javadtalab, "A DASH Based HEVC Multi-View Video Streaming System," Journal of Real-Time Image Processing, May, pp.1-25, 2015. https://doi.org/10.1007/s11554-015-0504-8   DOI
10 M. Domanski, M. Gotfryd, and K. Wegner, "View synthesis for multiview video transmission," The 2009 International conference on image processing, computer vision, and pattern recognition, pp.1-4, 2009.
11 Z. Han and Q. Dai, "A new scalable free viewpoint video streaming system over IP network," IEEE international conference on acoustics speech and signal processing, pp.773-776, 2007. https://doi.org/10.1109/ICASSP.2007.366350   DOI
12 S. Jo, D. Lee, Y. Kim and C. Yoo, "Development of a simple free viewpoint video system," Multimedia and Expo, 2008 IEEE International Conference on, June, 2008. https://doi.org/10.1109/ICME.2008.4607750   DOI
13 R. Ma, T. Maugey and P. Frossard, "Optimized Data Representation for Interactive Multiview Navigation," IEEE Transactions on Multimedia, December, 2017. https://doi.org/10.1109/TMM.2017.2779039   DOI
14 A. Smolic, "3D video and free viewpoint video-From capture to display," Pattern Recognition vol. 44, September, 2010. https://doi.org/10.1016/j.patcog.2010.09.005   DOI
15 L. Zhao, A. Wang, B. Zeng and J. Jin, "Scalable Coding of Depth Images with Synthesis-Guided Edge Detection," KSII Transactions on Internet and Information Systems, vol. 9, no. 10, pp. 4108-4125, 2015. http://dx.doi.org/10.3837/tiis.2015.10.019   DOI
16 N. Hu, Y. Zhao and H. Bai, "3D View Synthesis with Feature-Based Warping," KSII Transactions on Internet and Information Systems, vol. 11, no. 11, pp. 5506-5521, 2017. https://doi.org/10.3837/tiis.2017.11.018   DOI