Browse > Article
http://dx.doi.org/10.3837/tiis.2022.03.010

A Proposal for Zoom-in/out View Streaming based on Object Information of Free Viewpoint Video  

Seo, Minjae (Department of Software Convergence, Seoul Women's University)
Paik, Jong-Ho (Department of Software Convergence, Seoul Women's University)
Park, Gooman (Department of Electronic and IT Media Engineering, Seoul National University of Science Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.16, no.3, 2022 , pp. 929-946 More about this Journal
Abstract
Free viewpoint video (FVV) service is an immersive media service that allows a user to watch it from a desired location or viewpoint. It is composed of various forms according to the direction of the viewpoint of the provided video, and includes zoom in/out in the service. As consumers' demand for active watching is increasing, the importance of FVV services is expected to grow gradually. However, additional considerations are needed to seamlessly stream FVV service. FVV includes a plurality of videos, video changes may occur frequently due to movement of the viewpoint. Frequent occurrence of video switching or re-request another video can cause service delay and it also can lower user's quality of service (QoS). In this case, we assumed that if a video showing an object that the user wants to watch is selected and provided, it is highly likely to meet the needs of the viewer. In particular, it is important to provide an object-oriented FVV service when zooming in. When video zooming in in the usual way, it cannot be guaranteed to zoom in around the object. Zoom function does not consider about video viewing. It only considers the viewing screen size and it crop the video view as fixed screen location. To solve this problem, we propose a zoom in/out method of object-centered dynamic adaptive streaming of FVV in this paper. Through the method proposed in this paper, users can enjoy the optimal video service because they are provided with the desired object-based video.
Keywords
Free viewpoint video; FVV service; video streaming service; video zoom in/out;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Minjae Seo and Jong-Ho Paik, "Bandwidth-Efficient Transmission Method for User View-Oriented Video Services," Computers, Materials & Continua, Vol. 65, No. 3, pp. 2571-2589, Sep. 2020.   DOI
2 "How Canon's Free Viewpoint Video System brings a new perspective to Rugby World Cup 2019™ action". [Online]. Available: https://www.canon.co.uk/pro/stories/free-viewpoint-video-rugby-world-cup/
3 M. Tanimoto, M. Panahpour Tehrani, T. Fujii and T. Yendo, "FTV for 3-D Spatial Communication," Proceedings of the IEEE, vol. 100, no. 4, pp. 905-917, April 2012.   DOI
4 M. Tanimoto, "FTV (Free-viewpoint TV)," in Proc. of 2010 IEEE International Conference on Image Processing, pp. 2393-2396, 2010,
5 Gooman Park, "Free viewpoint content composition technology development case," broadcasting and media, Vol. 24, No. 3, pp. 24-34, Aug. 2019.
6 Gooman Park, "Free viewpoint video technology trends and development examples of extended free-view point of view," Information and Communication, Vol. 36, No. 12, pp. 3-9, Nov. 2019.
7 "Free viewpoint video system using canon's unrivaled imaging technologies". [Online]. Available: https://global.canon/en/technology/frontier18.html.
8 G.S. Lee, J.Y. Jeong et al., "Standardization Trend of 3DoF+ Video for Immersive Media," Electronics and Telecommunications Trends, Vol. 34, No. 6, pp.156-163, Dec. 2019.
9 Sid Yingze Bao, Yu Xiang and Silvio Savarese, "Object Co-detection," in Proc. of European Conference on Computer Vision, pp.86-101, Oct. 2012.
10 N. Kim and B. Lee, "Analysis and Improvement of MPEG-DASH-based Internet Live Broadcasting Services in Real-world Environments," KSII Transactions on Internet and Information Systems, vol. 13, no. 5, pp. 2544-2557, 2019.   DOI
11 ISO/IEC 23009-1:2014 Information Technology-Dynamic adaptive streaming over HTTP (DASH)-Part 1: Media presentation description and segment formats. [Online]. Available: https://www.iso.org/standard/65274.html
12 J. Lee, J. Lee, J. Lim and M. Kim, "Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay," KSII Transactions on Internet and Information Systems, vol. 13, no. 1, pp. 291-304, 2019.   DOI
13 J. Gwak, G. Park and M. Jeon, "Viewpoint Invariant Person Re-Identification for Global Multi-Object Tracking with Non-Overlapping Cameras," KSII Transactions on Internet and Information Systems, vol. 11, no. 4, pp. 2075-2092, 2017.   DOI
14 "face_recognition package". [Online]. Available: https://face-recognition.readthedocs.io/en/latest/face_recognition.html
15 Robert Seeliger, Daniel Silhavy, Stefan Pham and Stefan Arbanowski, "Cross-platform ad-insertion using HbbTV and MPEG-DASH," in Proc. of Asia Pacific Conference on Multimedia and Broadcasting, pp.7-13, Nov. 2016.
16 EasyTV: Easing the access of Europeans with disabilities to converging media and content, "Content adaptation using DASH streaming services," Oct. 2018. [Online]. Available: https://easytvproject.eu/files/D4.4.pdf
17 Ingo Kofler, Robert Kuschnig and Hermann Hellwagner, "Implications of the ISO base media file format on adaptive HTTP streaming of H.264/SVC," in Proc. of 2012 IEEE Consumer Communications and Networking Conference (CCNC), pp.549-553, Jan. 2012.
18 Ahmed Hamza and Mohamed Hefeeda, "A DASH-based Free Viewpoint Video Streaming System," in Proc. of Network and Operating System Support on Digital Audio and Video Workshop, pp. 55-60, Mar. 2014.
19 Minjae Seo and Jong-Ho Paik, "Implementation Method for DASH-based Free-viewpoint Video Streaming System," Journal of Internet Computing and Services, Vol. 20, No. 1, pp. 47-55, 2019.   DOI