Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Proposal and Implementation of Intelligent Omni-directional Video Analysis System

지능형 전방위 영상 분석 시스템 제안 및 구현

  • Jeon, So-Yeon (Dept. of Media IT Engineering, The Graduate School, Seoul National University of Science and Technology) ;
  • Heo, Jun-Hak (Dept. of Electronic IT Media Engineering, Seoul National University of Science and Technology) ;
  • Park, Goo-Man (Dept. of Media IT Engineering, The Graduate School, Seoul National University of Science and Technology)
  • 전소연 (서울과학기술대학교 일반대학원 미디어IT공학과) ;
  • 허준학 (서울과학기술대학교 전자IT미디어공학과) ;
  • 박구만 (서울과학기술대학교 일반대학원 미디어IT공학과)
  • Received : 2017.11.10
  • Accepted : 2017.11.21
  • Published : 2017.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an image analysis system based on omnidirectional image and object tracking image display using super wide angle camera. In order to generate spherical images, the projection process of converting from two wide-angle images to the equirectangular panoramic image was performed and the spherical image was expressed by converting rectangular to spherical coordinate system. Object tracking was performed by selecting the desired object initially, and KCF(Kernelized Correlation Filter) algorithm was used so that robust object tracking can be performed even when the object's shape is changed. In the initial dialog, the file and mode are selected, and then the result is displayed in the new dialog. If the object tracking mode is selected, the ROI is set by dragging the desired area in the new window.

본 논문에서는 초광각 카메라를 활용한 전방위 영상 및 객체 추적 결과 영상 표출을 통한 영상 분석 시스템을 제안한다. 구형 전방위 영상 생성을 위해 광각 영상 두 개에서 equirectangular 파노라마 영상으로의 projection 과정을 거쳤고, 구면 좌표계 변환식을 사용하여 구형 영상으로 표출하였다. 객체 추적은 원하는 객체를 초기에 선택하는 방식으로 수행되었으며, equirectangular 영상 내 왜곡으로 인한 객체 형태 변화에도 강인한 객체 추적이 이루어질 수 있도록 KCF(Kernelized Correlation Filter) 알고리즘을 사용하였다. 초기 다이얼로그에서는 파일 및 모드를 선택하고, 이후 새 다이얼로그에서 구형 영상 매핑 수행 결과 영상이 표출되도록 하였으며, 객체 추적 모드를 선택한 경우 새로운 창에서 원하는 영역을 드래그하여 ROI를 설정한 뒤, 이를 매 프레임마다 추적할 수 있도록 하였다.

Keywords

References

  1. Bosung Kim, JonSeung Park, "Exemplar-Based Image Inpainting for Spherical Panoramic Image", Journal of Korean Institute of Information Scientists and Engineers, Vol. 43, No.4, pp. 437-449, 2016.
  2. Gyeong-il Kweon, Young-ho Choi, "Image-processing Based Panoramic Camera Employing Single Fisheye Lens", Journal of the Optical Society of Korea, Vol. 14, No. 3, pp.245-259, 2010 https://doi.org/10.3807/JOSK.2010.14.3.245
  3. Gooman Park, Jihye Jeon, Jihee Yang, Jiwoong Jang, The Method of 360 Degrees Spherical Rendering Display and Auto Video Analytic Using Real-time Image Acquisition Cameras, 10-1639275, Korea, 2016.
  4. Shigang Li, Member, IEEE, "Monitoring Around a Vehicle by a spherical Image Sensor", IEEE Transactions on Intelligent Transportation Systems, Vol. 7, No. 4, pp.541-550, 2006. https://doi.org/10.1109/TITS.2006.883116
  5. Jun-Hwan Lee and Jisang Yoo, "Real-time Face Tracking Method using Improved Camshift", JBE Vol. 21, No. 6, pp.861-877, 2016.
  6. Ming TANG and Jiayi FENG, "Multi-kernel Correlation Filter for Visual Tracking", IEEE International Conference on Computer Vision, 2015.
  7. Joao F. Henriques, Rui Caseiro, Pedro Martins, and Jorge Batista, "High-Speed Tracking with Kernelized Correlation Filters", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol,37, No 3, pp.583-596, 2015. https://doi.org/10.1109/TPAMI.2014.2345390
  8. Seoung Heon Kang, Seoung-Jae Lee, Man Hee Lee and In Kyu Park, "Parallelization of Feature Detection and Panorama Image Generation using OpenCL and Embedded GPU", JBE Vol.19, No. 3, pp.316-328, 2014.
  9. Dongmin Park, Dongkyu Lee and SeoungJun Oh, "Object Tracking in HEVC Bitstrams", JBE Vol. 20, No. 3, pp.449-463, 2015.