Browse > Article
http://dx.doi.org/10.7471/ikeee.2020.24.4.1050

A Reference Frame Selection Method Using RGB Vector and Object Feature Information of Immersive 360° Media  

Park, Byeongchan (Dept. of Computer Science and Engineering, Soongsil University)
Yoo, Injae (Research Institute, Beyondtech Inc.)
Lee, Jaechung (Research Institute, Beyondtech Inc.)
Jang, Seyoung (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Seok-Yoon (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Youngmo (Dept. of Computer Science and Engineering, Soongsil University)
Publication Information
Journal of IKEEE / v.24, no.4, 2020 , pp. 1050-1057 More about this Journal
Abstract
Immersive 360-degree media has a problem of slowing down the video recognition speed when the video is processed by the conventional method using a variety of rendering methods, and the video size becomes larger with higher quality and extra-large volume than the existing video. In addition, in most cases, only one scene is captured by fixing the camera in a specific place due to the characteristics of the immersive 360-degree media, it is not necessary to extract feature information from all scenes. In this paper, we propose a reference frame selection method for immersive 360-degree media and describe its application process to copyright protection technology. In the proposed method, three pre-processing processes such as frame extraction of immersive 360 media, frame downsizing, and spherical form rendering are performed. In the rendering process, the video is divided into 16 frames and captured. In the central part where there is much object information, an object is extracted using an RGB vector per pixel and deep learning, and a reference frame is selected using object feature information.
Keywords
Immersive $360^{\circ}$ Media; Reference Frame; RGB Vector; Object Feature Information; Filtering;
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 J. S. Lee, "Changes in realistic media content distribution environment and production technology in the 5G era," NIPA Issue Report, Vol.22, 2019.
2 S. W. Son, "5G era, single media copyright issues and trends," VideoPlus, 2019.
3 M. G. Kim, "Korean 5G-based VR.AR development urgentThere is no "law/policy," EYENEWS 24, 2019.
4 Y. Kim and D. Sin, "Feature-based filtering technology performance evaluation trend," Korean Institute of Information Technology, Vol.11, No.2, pp.1-7, 2013.
5 Y. S. Ho, "VR/AR content creation using 360-degree video," The Magazine of the IEEE, Vol.45, No.8, pp. 33-40, 2018.
6 S. Mun, M. Whang, S. Park, D. W. Lee and H. I. Kim, "Overview of VR Media Technology and Methods to Reduce Cybersickness," Journal of Broadcast Engineering, Vol.23. No.6, pp.800-812, 2018.   DOI
7 G. S. Lee, J. Y. Jeong, H. C. Shin and J. I. Seo, "Standardization Trend of 3DoF+ Video for Immersive Media," Electronics and Telecommunications Trends, Vol.34, No.6, pp.156-163, 2019. DOI: 10.22648/ETRI.2019.J.340614   DOI
8 Y. Kim, B. Park, S. Jang, I. Yoo, J. Lee and S. Y. Kim, "A Study on Fingerprinting Robustness Indicators for Immersive 360-degree Video," Journal of IKEEE, Vol.24, No.3, pp.743-753, 2020. DOI: 10.7471/ikeee.2020.24.3.743   DOI
9 S. Ren, K. He, R. Girshick and J. Sun "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.39, No.6, pp.1137-1149, 2017.   DOI
10 D. Belur V, "Nearest neighbor (NN) norms: NN pattern classification technique," EEE Computer Society Press, 1991.
11 J. Lee, "An Efficient kNN Algorithm," KIPS Transactions on Software and Data Engineering (KTSDE), Vol.11, No.7, pp.849-854, 2004.