Browse > Article
http://dx.doi.org/10.5909/JBE.2020.25.2.265

Implementation of Integrated Player System based on Free-Viewpoint Video Service according to User Selection  

Yang, Ji-hee (Dept. of Information Technology and Media Engineering, The graduate School of Nano IT Design Fusion, Seoul National University of Science and Technology)
Song, Min-ki (Dept. of Media IT Engineering, The Graduate School, Seoul National University of Science and Technology)
Park, Gooman (Dept. of Electronic IT Media Engineering, Seoul National University of Science and Technology)
Publication Information
Journal of Broadcast Engineering / v.25, no.2, 2020 , pp. 265-274 More about this Journal
Abstract
Free-viewpoint video service is a technology that allows users to watch at any angle, location and distance through interaction. In this paper, the free-viewpoint video services are defined in four viewing modes: Inward view, outward view, 3D object view and first person view. And we developed and implemented a new integrated program that plays all the suggested views. In the contents of girl band performances and basketball games, multi-view cameras suitable for each viewing mode are installed to acquire media, and data stored on the server is streamed over the network, making it available for viewing. Users can freely choose four viewing modes, space location, angle and so on, and the media data such as images and sounds are provided to them by rendering appropriately for the selected the viewpoint. Our system is expected to be a scalable free-viewpoint video service player as well as provide users with immersion and presence by combining various viewing modes.
Keywords
Free-viewpoint; Immersive media player system; Inward view; Outward view; 3D object view;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 M. Domanski, O. Stankiewicz, K, Wegner and T, Grajek, "Immersive Visual Media-MPEG-I:360 Video, Virtual Navigation and Beyond", Proceeding of International Conference on Systems, Signals and Image Processing(IWSSIP), Poznan, Poland, pp.1-9, May, 2017, doi: 10.1109/IWSSIP.2017.7965623
2 X. Zhang, L. Toni, P. Frossard, Y. Zhao and C. Lin, "Adaptive Streaming in Interactive Multiview Video Systems", Transactions on Circuits and Systems for Video Technology, Vol.29, No.4, pp.1130-1144, April, 2019, doi: 10.1109/TCSVT.2018.2819804   DOI
3 G. Park, "Free-Viewpoint Content Composition Technology Development Case", Broadcasting and Media Magazine, Vol.24, No.3, pp.24-34. July, 2019.
4 G. Lafruit, M. Domanski, K. Wegner and T. Grajek, et al, "New Visual Coding Exploration in MPEG: Super-MultiView and Free Navigation in Free Viewpoint TV", Electronics Imaging, Stereoscopic Displays and Applications XXVII, pp.1-9, Feb, 2016, doi: 10.2352/ISSN. 2470-1173.2016.5.SDA-426
5 S. Song, Y. Park and J. Wee, "Streaming Technology for Free-Viewpoint Service", The Journal of The Korean Institute of Communication Sciences, Vol.36, No.12, pp.32-37, Nov, 2019.
6 S. Yairi, Y. Iwaya, M. Kobayashi, M. Otani, Y. Suzuki and T. Chiba, "The Effects of Ambient Sounds on The Quality of 3D Virtual Sound Space", Proceeding of International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Kyoto, Japan, pp.1122-1125, Sept, 2009, doi: 10.1109/IIH-MSP.2009.267
7 Fmod API Documentation, https://www.fmod.com/resources/documentation-api.
8 S. Jeon, C. Kim and G. Park, "Implementation of Omni-directional Image Viewer Program for Effective Monitoring", Journal of Broadcasting Engineering, Vol.23, No.6, pp. 939-946, Nov, 2018, doi: 10.5909/JBE.2018.23.6.939
9 J. Jeong, M. Yoon, S. Kim and G. Park, "Design and Production of Realtime 3D Animation Viewer based on Motion Capture", Proceeding of The Institute of Electronics and Information Engineers Conference, Jeju, Korea, pp.531-535, July, 2019.
10 Z. Cao, G. Hidalgo, T. Simon, S. E. Wei and Y. Sheikh, "OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields", Transactions on Pattern Analysis and Machine Intelligence, pp.1-14, June, 2018, doi: 10.1109/TPAMI.2019.2929257
11 G. Park, "Free-Viewpoint Video Technology Trends and Free Selection View Development Case", The Journal of The Korean Institute of Communication Sciences, Vol.36, No.12, pp.3-9, Nov, 2019.
12 J. Jeon, H. Lim and C. Kim, "A Study of Dynamic 3D Modeling based on Photogrammetry Technology for Object Observation View", The Journal of The Korean Institute of Communication Sciences, Vol.36, No.12, pp.38-44, Nov, 2019.