Journal of Korea Society of Industrial Information Systems (한국산업정보학회논문지)

Korea Society of Industrial Information Systems (한국산업정보학회)
권호 표지
DOI QR코드

DOI QR Code

Stitching Method of Videos Recorded by Multiple Handheld Cameras

다중 사용자 촬영 영상의 영상 스티칭

  • Received : 2017.05.29
  • Accepted : 2017.06.27
  • Published : 2017.07.03
Download PDF
⟨ Previous Next ⟩

Abstract

This Paper Presents a Method for Stitching a Large Number of Images Recorded by a Large Number of Individual Users Through a Cellular Phone Camera at a Venue. In Contrast to 360 Camera Solutions that Use Existing Fixed Rigs, these Conditions must Address New Challenges Such as Time Synchronization, Repeated Transformation Matrix Calculations, and Camera Sensor Mismatch Correction. In this Paper, we Solve this Problem by Updating the Transformation Matrix Using Time Synchronization Method Using Audio, Sensor Mismatch Removal by Color Transfer Method, and Global Operation Stabilization Algorithm. Experimental Results Show that the Proposed Algorithm Shows better Performance in Terms of Computation Speed and Subjective Image Quality than that of Screen Stitching.

본 연구는 다수의 개인 사용자들이 휴대폰 카메라를 통하여 공연장 등에서 녹화한 다수의 영상을 스티칭하는 방법을 제시한다. 기존 고정형 리그(Rig)를 사용하는 360 카메라 솔루션과 대비하여, 시간 동기화, 반복적 변환행렬계산 및 카메라 센서 불일치 보정과 같은 새로운 문제들을 해결해야한다. 이 논문에서는 오디오를 사용한 시각동기화 방법, 색상 전달 방식에 따른 센서 불일치 제거, 전역 동작 안정화 알고리즘을 사용하여 변환 행렬의 업데이트를 함으로써 이러한 문제를 해결하였다. 또한, 카메라의 움직임이 크지 않은 경우에서, 제안 된 알고리즘은 화면 별 스티칭을 하는 경우 보다, 계산 속도와 화질 면에서도 우수한 성능을 보임을 실험을 통하여 확인하였다.

Keywords

References

  1. Ko H.-S., “Cyberspace and Protection of Personal Data,” The Journal of Internet Electronic Commerce Research, Vol. 3, No. 2, pp. 37-63, 2003.
  2. Joo J.-H., “The Development of a Cyber World Culture Expo and Electronic Tourism Market System,” The Journal of Information Systems, Vol. 9, No. 1, pp. 87-108, 2000.
  3. Brown, M. and Lowe, D.G., “Automatic Panoramic Image Stitching Using Invariant Features,” International Journal of Computer Vision, Vol. 74, No. 1, pp. 59-73, 2007. https://doi.org/10.1007/s11263-006-0002-3
  4. Collection of $360^{\circ}$ Video Rigs, https://thefulldomeblog.com/2015/11/17/collection-of-360-video-rigs/ (last access, 2017. May, 26)
  5. PTGui, https://www.ptgui.com/(last access, 2017. May, 26)
  6. Kolor, http://www.kolor.com/panotour/ (last access, 2017. May, 26)
  7. Vahana Video-Stitch, http://www.video-stitch.com/(last access, 2017. May, 26)
  8. ICoSOLE EU project, http://icosole.eu (last access, 2017. May, 26)
  9. El-Saban, M.A., Refaat, M., Kaheel, A. and Abdul-Hamid, A., "Stitching Videos Streamed by Mobile Phones in Real-Time," The 17th ACM International Conference on Multimedia, pp. 1009-1010. 2007
  10. Reinhard E., Ashikhmin M., Gooch B., and Shirley P., "Color Transfer between Images. In Applied Perception," IEEE Computer Graphics and Applications, September/October 2001.
  11. Learning OpenCV: Color Transfer Between Images algorithm. available online http://www.programering.com/a/MzM4gDMwATU.html
  12. Ruderman D.L., Cronin T.W., and Chiao C.C., "Statistics of Cone Responses to Natural Images: Implications for Visual Coding," J. Optical Soc. of America, Vol. 15, No. 8, pp. 2036-2045, 1988 https://doi.org/10.1364/JOSAA.15.002036
  13. Nghia Ho, Simple Video Stabilization Using OpenCV. At http://nghiaho.com/?p=2093
  14. Shi J. and Tomasi. C. "Good Features to Track," IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, 1994.
  15. Jean-Yves Bouguet. "Pyramidal Implementation of the Lucas Kanade Feature Tracker," Intel Corporation, Vol. 5, No. 4, 2001
  16. Lucas, B., and Kanade, T. "An Iterative Image Registration Technique with an Application to Stereo Vision," the 7th International Joint Conference on Artificial Intelligence, pp. 674-679, 1981.
  17. Bano, S., and Cavallaro, A., "ViComp: Composition of User-Generated Videos." Multimedia Tools and Applications Vol, 75, No. 12, pp. 7187-7210, 2016. https://doi.org/10.1007/s11042-015-2641-2
  18. Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P., "Image Quality Assessment: from Error Visibility to Structural Similarity," IEEE Transactions on Image Processing, Vol. 13. No. 4, pp. 600-612, 2004. https://doi.org/10.1109/TIP.2003.819861