DOI QR코드

DOI QR Code

스테레오 카메라 기반 트윈 카메라 모듈 시스템 설계 및 구현

Design and Implementation Stereo Camera based Twin Camera Module System

  • Kim, Tae-Yeun (SW Convergence Education Institute, Chosun University)
  • 투고 : 2019.11.17
  • 심사 : 2019.11.21
  • 발행 : 2019.12.31

초록

본 논문에서는 휴대하기 편하고 3D 콘텐츠 제작이 용이한 트윈 카메라 모듈 시스템을 구현하고자 하였다. 제안한 트윈 카메라 모듈 시스템은 2D 스테레오 카메라로 부터 입력되는 영상을 변환하여 3차원 영상으로 출력할 수 있는 시스템이다. 본 눈문에서 제안한 시스템의 성능평가를 위해 Test Platform을 이용하여 좌, 우 두 개의 렌즈로 촬영된 스테레오 입체 영상의 좌, 우 영상 간의 시차에 따른 회전(Rotation), 기울기(Tilt)에 대한 보정을 평가하였다. 또한 SIFT(Scale Invariant Feature Transform) 알고리즘을 이용하여 3D 입체 영상의 거리오차(Depth Error)를 검증하여 트윈 카메라 모듈 시스템의 효율성을 검증하고자 하였다. 본 논문에서 제안한 트윈 카메라 모듈 시스템은 촬영된 영상을 3D 입체 영상과 준비 영상으로 변화하여 외부에 출력하면 각기 다른 3D 입체 영상 제작 방식에 따른 출력장치에 맞춰 디스플레이가 가능하다. 또한 생성된 영상을 준비 영상과 입체 영상을 각기 다른 채널을 통해 출력하여 많은 제품에 적용하기 쉽고 간편하게 3D 입체 영상 콘텐츠를 제작하는데 이용할 수 있을 거라 기대한다.

The paper actualizes the twin camera module system that is portable and very useful for the production of 3D contents. The suggested twin camera module system is a system to be able to display the 3D image after converting the inputted image from 2D stereo camera. To evaluate the performance of the twin camera module suggested in this paper, I assessed the correction of Rotation and Tilt created depending on the visual difference between the left and right stereoscopic image shot by the left and right lenses by using the Test Platform. In addition, I verified the efficiency of the twin camera module system through verifying Depth Error of 3D stereoscopic image by means of Scale Invariant Feature Transform(SIFT) algorithm. I think that if the user utilizes the suggested twin camera module system in displaying the image to the external after converting the shot image into the 3D stereoscopic image and the preparation image, it is possible to display the image in a matched way with an output device fit respectively for different 3D image production methods and if the user utilizes the system in displaying the created image in the form of the 3D stereoscopic image and the preparation image via different channels, it is possible to produce 3D image contents easily and conveniently with applying to lots of products.

키워드

참고문헌

  1. Jae Hoon Jung, "Object Tracking Method Based on Optimized 3D Trajectory and Normalized Size Information Using Camera Calibration," Doctorate Thesis, Chaun-Ang University, 2017.
  2. Byung Wan Han and Sung Jun Lim, “Development of HD Resolution Stereoscopic Camera and Apparatus for Recognizing Depth of Object,” Journal of the Korea Academia-Industrial cooperation Society, Vol. 14, No. 1, pp. 351-357, 2013. https://doi.org/10.5762/KAIS.2013.14.1.351
  3. Jong sub Park, June Seok Hong, and Woo Ju Kim, “A Study on Intuitive IoT Interface System using 3D Depth Camera,” The Journal of Society for e-Business Studies, Vol. 22, No. 2, pp. 137-152, 2017. https://doi.org/10.7838/jsebs.2017.22.2.137
  4. Cheon Lee, Hy ok Song, Byeong ho Choi,, and Yo Sung Ho, “Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera,” The Journal of The Korean Institute of Communication Sciences, Vol. 37, No. 4, pp. 239-249, 2012. https://doi.org/10.7840/KICS.2012.37A.4.239
  5. Young soo Prak, Nam bo Hur, Kyung soo Pyo, and Chung kun Song, "A Method of Stereoscopic 3D Image Quality Assessment," Journal of broadcast engineering, Vol. 16, No. 2, pp. 321-330, 2011.
  6. Hyoung chul Shin, Sang hoon Kim, and Kwang hoon Sohn, "Hybrid Stereoscopic Camera System," Journal of broadcast engineering, Vol.16, No. 4, pp. 602-613, 2011. https://doi.org/10.5909/JEB.2011.16.4.602
  7. Jung Hyun Kim, “3D graphic-based stereoscopic camera considering visual fatigue,” Journal of The Korean Society for Computer Game, Vol. 24, No. 4, pp. 89-98, 2011.
  8. Seon Min Rhee, Jog Moo Choi, and Soo Mi Choi, “A Method for Reproducing Stereo Images to Adjust Screen Parallax on a 3D Display,” Journal of the Korea computer graphics society, Vol. 16, No. 4, pp. 1-10, 2010.
  9. Chang Yoon Kim and Woo Sik Lee, “Developing Stereo-vision based Drone for 3D Model Reconstruction Structures in Disaster Sites,” Journal of the Korea Academia-Industrial cooperation Society, Vol. 17, No. 6, pp. 33-38, 2016. https://doi.org/10.5762/KAIS.2016.17.6.33
  10. S. Michalik, S. Michalik, J. Naghmouchi, and M. Berekovic, " Real-time smart stereo camera based on FPGA-SoC," 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), pp. 311-317, 2017.
  11. Oh-Young Kwon, and Kyoung-Taek Seo, “3D Reconstruction Using a Single Camera,” Journal of the korea Institute of Information and Communication Engineering, Vol. 19, No. 12, pp. 2943-2948, 2015. https://doi.org/10.6109/jkiice.2015.19.12.2943
  12. A. Y. Rahman, S. S. Sumpeno, and M. H. Pumomo, "Arca Detection and Matching Using Scale Invariant Feature Transform (SIFT) Method of Stereo Camera," 2017 International Conference on Soft Computing, Intelligent System and Information Technology (ICSIIT), pp. 66-71, 2017.
  13. T. Sattler, B. Leibe, and L. Kobbelt, “Efficient & Effective Prioritized Matching for Large-Scale Image-Based Loclization,” IEEE Transactions on Pattern Analysis & Machine Intelligence, Vol. 39, No. 9, pp. 1744-1756, 2017. https://doi.org/10.1109/TPAMI.2016.2611662
  14. S. Avidan and A. Shashua, “ Trajectory Triangulation: 3D Reconstruction of Moving Points from a Monocular Image Sequence,” IEEE Transactions on Pattern Analysis & Machine Intelligence, Vol. 22, No. 4, pp. 348-357, 2000. https://doi.org/10.1109/34.845377
  15. Ji Jung Jung, Gwang Lee, and Bong Keun Kim, “A Study on Stable Service of Marker based Augmented Reality Using 3D Location Measurement of Beacons,” The Journal of the korea Institute of Electronic Communication Sciences, Vol. 12, No. 5, pp. 883-890, 2017. https://doi.org/10.13067/JKIECS.2017.12.5.883