Browse > Article
http://dx.doi.org/10.9708/jksci.2019.24.01.093

An Efficient Feature Point Extraction and Comparison Method through Distorted Region Correction in 360-degree Realistic Contents  

Park, Byeong-Chan (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Jin-Sung (Dept. of Computer Science and Engineering, Soongsil University)
Won, Yu-Hyeon (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Young-Mo (Dept. of Computer Science and Engineering, Soongsil University)
Kim, Seok-Yoon (Dept. of Computer Science and Engineering, Soongsil University)
Abstract
One of critical issues in dealing with 360-degree realistic contents is the performance degradation in searching and recognition process since they support up to 4K UHD quality and have all image angles including the front, back, left, right, top, and bottom parts of a screen. To solve this problem, in this paper, we propose an efficient search and comparison method for 360-degree realistic contents. The proposed method first corrects the distortion at the less distorted regions such as front, left and right parts of the image excluding severely distorted regions such as upper and lower parts, and then it extracts feature points at the corrected region and selects the representative images through sequence classification. When the query image is inputted, the search results are provided through feature points comparison. The experimental results of the proposed method shows that it can solve the problem of performance deterioration when 360-degree realistic contents are recognized comparing with traditional 2D contents.
Keywords
MPEG-Immersive; Virtual Reality; Feature Point Extraction and Matching; Sequence Classification;
Citations & Related Records
연도 인용수 순위
  • Reference
1 H. W. Chun, M. K. Han, and J. H. Jang, "Application trends in virtual reality," 2017 Electronics and Telecommunica tions Trends, 2017.
2 S. E. Chen, "Quicktime VR: An image-based approach to virtual environment navigation," Proc. of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, ACM, 1995.
3 J. Y. Kim, "Design of 360 degree video and VR contents," Communication Books, 2017.
4 R. Kijima and K. Yamaguchi, "VR device time Hi-precision time management by synchronizing times between devices and host PC through USB," IEEE Virtual Reality(VR), Mar. 2016.
5 W. J. Ha and K. A. Sohn, "Image classification approach for Improving CBIR system performance," in Proc. 2016 KICS Conf. Winter, pp. 308-309, Jeongseon, Korea, 2016.
6 W16824, Text of ISO/IEC DIS 23090-2 Omnidirectional MediA Format (OMAF).
7 Y Ke and R Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," IEEE CVPR, May 2004.
8 H Bay, T Tuytelaars, and L Van Gool, "SURF: Speeded Up Robust Features," ECCV, May 2006.
9 J. S. Song, S. J. Hur, Y. W. Park, and J. H. Choi, "User positioning method based on image similarity comparison using single camera," J. KICS, vol. 40, no. 8, pp. 1655-1666, 2015.   DOI
10 M. Yasmin, S. Mohsin, I. Irum, and M. Sharif, "Content based image retrieval by shape, color and relevance feedback." Life Science Journal, 10(4s), pp. 593-598, 2013.
11 M. Everingham, et al., "The pascal visual object classes (voc) challenge," Int. J. Computer Vision, vol. 88, no. 2, pp. 303-338, 2010.   DOI
12 Y. Ke, and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. IEEE Computer Soc. Conf. CVPR 2004, vol. 2, 2004.
13 Y. S. Ho, "MPEG-I standard and 360 degree video content generation," Journal of Electrical Engineering, Aug. 2017.
14 H. J. Jung and J. S. Yoo, "Feature matching algorithm robust to viewpoint change," J. KICS, vol. 40, no. 12, pp. 2363-2371, 2015.12.   DOI