Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Camera Motion Detection Using Estimation of Motion Vector's Angle

모션 벡터의 각도 성분 추정을 통한 카메라 움직임 검출

  • Kim, Jae Ho (Dept. of Electronic Eng., Graduate School, Pusan National University) ;
  • Lee, Jang Hoon (Dept. of Electronic Eng., Graduate School, Pusan National University) ;
  • Jang, Soeun (Research Center of QTT, Inc.)
  • Received : 2018.06.14
  • Accepted : 2018.07.18
  • Published : 2018.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new algorithm that is robust against the effects of objects that are relatively unaffected by camera motion and can accurately detect camera motion even in high resolution images. First, for more accurate camera motion detection, a global motion filter based on entropy of a motion vector is used to distinguish the background and the object. A block matching algorithm is used to find exact motion vectors. In addition, a matched filter with the angle of the ideal motion vector of each block is used. Motion vectors including 4 kinds of diagonal direction, zoom in, and zoom out are added additionally. The experiment shows that the precision, recall, and accuracy of camera motion detection compared to the recent results is improved by 12.5%, 8.6% and 9.5%, respectively.

Keywords

References

  1. A. Hampapur, R. Jain, and T.E. Weymouth, "Production Model Based Digital Video Segmentation," Multimedia Tools and Applications, Vol. 1, No. 1, pp. 9-46, 1995. https://doi.org/10.1007/BF01261224
  2. Y.F. Ma, L. Lu, H.J. Zhang, and M. Li, "A User Attention Model for Video Summarization," Proceedings of 10th ACM International Conference on Multimedia, pp. 533-542, 2002.
  3. Y. Li, S.H. Lee, C.H. Yeh, and C.J. Kuo, "Techniques for Movie Content Analysis and Skimming: Tutorial and Overview on Video Abstraction Techniques," IEEE Signal Processing Magazine, Vol. 23, No. 2, pp. 79-89, 2006. https://doi.org/10.1109/MSP.2006.1621451
  4. Y.J. Lee and H.T. Kim, "Analysis of Movie Production by Camera Movement," Korea Digital Design Counicl, Vol. 12, No. 1, pp. 491-501, 2012. https://doi.org/10.17280/jdd.2012.12.1.047
  5. S. Jang, Y.S. Kim, and J.H. Kim, "Fusion Analysis of Visual Story Telling and Original Sound Track of 'Beauty and the Beast' Animation," Korea Science and Art Forum, Vol. 23, pp. 295-307, 2016.
  6. S. Jang, L. Lou, and J.H. Kim, "Integrated Analysis of Visual Story Telling and Original Sound Track of 'Alladin' Animation," Korea Science and Art Forum, Vol. 24, pp. 375-388, 2016.
  7. B.S. Sung and J.H. Kim, "Analysis of Kinetic Composition for the Visual Story Telling of Animation," Korean Society of Design Science, Vol. 22, No. 3, pp. 273-284, 2009.
  8. S. Pumrin and D.J. Dailey, "Roadside Camera Motion Detection for Automated Speed Measurement," Proceedings of IEEE 5th International Conference on Intelligent Transportation Systems, pp. 147-151, 2002.
  9. P. Bouthemy, M. Gelgon, and F. Ganansia, "A Unified Approach to Shot Change Detection and Camera Motion Characterization," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 9, No. 7, pp. 1030-1044, 1999. https://doi.org/10.1109/76.795057
  10. M. Naito, K. Matsumoto, K. Hoashi, and F. Sugaya, "Camera Motion Detection Using Video Mosaicing," Proceeding of 2006 IEEE International Conference on Multimedia and Expo, pp. 1741-1744, 2006.
  11. A. Jain, "Bit Reduction Based Matching Criterion for Motion Compensation in Video Coding," IEEE International Multimedia, Signal Processing and Communication Technologies, pp. 36-39, 2009.
  12. S. Ma and W. Wang, "Effective Camera Motion Analysis Approach," Proceeding of IEEE International Conference on Networking, Sensing and Control, pp. 111-116, 2010.
  13. T. Thorsten, N. Hasler, Michael Wand, H.P. Seidel, "Merging of Feature Tracks for Camera Motion Estimation from Video," Proceeding of IET 5th European Conference on Visual Media Production, 2008.
  14. D. Murray and A Basu, "Motion Tracking with an Active Camera," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 5, pp. 449-459, 1994. https://doi.org/10.1109/34.291452
  15. A. Barjatya, "Block Matching Algorithms for Motion Estimation," IEEE Transactions on Evolution Computation, Vol. 8, No. 3, pp. 225-239, 2004. https://doi.org/10.1109/TEVC.2004.826069
  16. Y.F. Ma and H.J. Zhang, "A New Perceived Motion Based Shot Content Representation," Proceedings of IEEE International Conference on In Image Processing, pp. 426-429, 2001.
  17. J.H. Lee, Camera Motion Detection Using Matched Filter with Motion Vector's Angle, Master's Thesis of Pusan National University of Technology, 2016.
  18. J. G. Kim, H.S. Chang, J. Kim, H.M. Kim,, "Efficient Camera Motion Characterization for MPEG Video Indexing," Proceeding of IEEE International Conference on Multimedia and Expo, 2000.
  19. Z.L. He, C.Y. Tsui, K.K. Chan, and M.L. Liou, "Low-power VLSI Design for Motion Estimation Using Adaptive Pixel Truncation," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, No. 5, pp. 669-678, 2000. https://doi.org/10.1109/76.856445
  20. B. Sklar, Digital Communications: Fundamentals and Applications, Prentice Hall, New Jersey, 2001.
  21. G.L. Turin, "An Introduction to Matched Filters," Proceedings of the IEEE, Vol. 64, No. 7, pp. 1092-1112, 1976. https://doi.org/10.1109/PROC.1976.10274
  22. G.S. Kim, The Recognition of Car Plate based on Normalized Matched Filter, Master's Thesis of Pusan National University, 2005.
  23. D.L. Olson and D. Delen, Advanced Data Mining Techniques, Springer Science and Business Media, Berlin, 2008.
  24. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, Vol. 60, No. 2, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  25. J.H. Kim, J.H. Lee, and S. Jang, "Animation OST Musical Element Analysis Based on A Narrative Process Classification Model," Journal of Korea Multimedia Society, Vol. 17, No. 10, pp. 1239-1252, 2014. https://doi.org/10.9717/kmms.2014.17.10.1239