Browse > Article

A Real Time Processing Technique for Content-Aware Video Scaling  

Lee, Kang-Hee (Dept. of Computer and Communications Engineering, Kangwon National University)
Yoo, Jae-Wook (Dept. of Computer and Communications Engineering, Kangwon National University)
Park, Dae-Hyun (Dept. of Computer and Communications Engineering, Kangwon National University)
Kim, Yoon (Dept. of Computer and Communications Engineering, Kangwon National University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.48, no.1, 2011 , pp. 80-89 More about this Journal
Abstract
In this paper, a new real time video scaling technique which preserved the contents of a movie was proposed. Because in a movie a correlation exists between consecutive frames, in this paper by determining the seam of the current frame considering the seam of the previous frame, it was proposed the real time video scaling technique without the shaking phenomenon of the contents even though the entire video is not analyzed. For this purpose, frames which have similar features in a movie are classified into a scene, and the first frame of a scene is resized by the seam carving at the static images so that it can preserve the contents of the image to the utmost. At this time, the information about the seam extracted to convert the image size is saved, and the sizes of the next frames are controlled with reference to the seam information stored in the previous frame by each frame. The proposed algorithm has the fast processing speed of the extent of being similar to a bilinear method and preserves the main content of an image to the utmost at the same time. Also because the memory usage is remarkably small compared with the existing seam carving method, the proposed algorithm is usable in the mobile terminal in which there are many memory restrictions. Computer simulation results indicate that the proposed technique provides better objective performance and subjective image quality about the real time processing and shaking phenomenon removal and contents conservation than conventional algorithms.
Keywords
Content-Aware Image Resizing; Seam carving;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Santella and M. Agrawala and D. Decarlo and D. Salesin and M. Cohen, "Gaze-based interaction for semi-automatic photo cropping," ACM Human Factors in Computing Systems, pp. 771-780, 2006.
2 F. Liu and M. Gleicher, "Automatic Image retargeting with fisheye-view warping," ACM Multimedia, pp. 153-164, Oct. 2005.
3 S. Avidan and A. Shamir, "Seam Carving for Content-Aware Image Resizing," ACM Trans. on Graphics, Vol. 26, Issue 3, Jul. 2007.
4 V. Kwatra, A. Sch'odl, I. Essa, G. Turk and A. Bobick, "Graphcut textures: image and video synthesis using graph cuts," ACM Trans. Graph. 22, 3, pp. 277-286, 2003.   DOI   ScienceOn
5 H. Liu, X. Xie, W. Ma, and H.Zhang "Automatic browsing of large pictures on mobile devices," Proceedings of the eleventh ACM international conference on Multimedia, pp. 148-155, 2003.
6 P. Kohli and P. H. S. Torr, "Dynamic graph cuts for efficient inference in markov random fields," IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI) 29, 12, pp.2079-2088, 2007.   DOI
7 X. Fan and X. Xie and H. Q. Zhou and W. Y. Ma, "Looking into video frames on small displays," ACM on Multimedia, pp. 247-250, 2003.
8 Richard Bellman, "Some Problems in The Theory of Dynamic Programming," Econometrica, Vol. 22, No. 1, pp. 37-48, 1954.   DOI   ScienceOn
9 D. P. Bertsekas, "Dynamic Programming and Optimal Control," Athena Scientific, 2000.
10 L. Chen, X. Xie ,X. Fan, W. Ma, H. Zhang, and H. Zhou, "A visual attention model for adapting images on small displays," Multimedia Systems 9, 4, pp. 353-364, 2003.   DOI   ScienceOn
11 C. Tao and J. Jia and H. Sun, "Active window oriented dynamic video retargeting," ICCV Proc. Workshop on Dynamical Vision, 2007.
12 B. Suh, H. Ling, B. B. Bederson, and D. W. Jacobs, "Automatic thumbnail cropping and its effectiveness," In UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology, ACM Press, New York, NY, USA, pp. 95-104, 2003.
13 B. Chen and P. Sem, "Video Carving," Proc. Eurographics, Short Papers, Apr. 2008.
14 U. Gargi and R. Kasturi, Sh. Strayer, "Performance Characterization of Video-Shot- Change Detection Methods," IEEE Trans. On Circuits and Systems for Video Technology, vol. 10, no. 1, pp. 1-13, 2000.   DOI   ScienceOn
15 Y. Gong, "An accurate and robust method for detecting video shot boundaries," IEEE Multimedia Computing and Systems, vol. 1, pp. 850-854, 1999.
16 M. Rubinstein and A. Shamir and S. Avidan, "Improved seam carving for video retargeting," ACM Transactions on Graphics, Vol. 27, Issue 3, Aug. 2008.
17 F. Liu and M. Gleichar, "Video Retargeting: Automating Pan and Scan," ACM Multimedia, pp. 241-250, Oct. 2006.
18 S. Cho and Y. Matsushita and S. Lee, "Image Retargeting with Importance Diffusion," KIISE, vol. 35, pp. 236-239, Jun. 2008.
19 V. Setlur and T. Lechner and M. Nienhaus and B. Gooch, "Retargeting Images and Video for Preserving Information Saliency," IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 80-88, Oct. 1998.
20 V. Setlur and S. Takagi and R. Raskar and M. Gleicher and B. Gooch, "Automatic Image retargeting," Proc. ACM, Vol. 154, pp. 59-68, 2005.