ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Stereo Video Retargeting with Representative Seams in a Group of Stereoscopic Frames

  • Nguyen, Hai Thanh (Electronics and Electrical Engineering, Dongguk University-Seoul) ;
  • Won, Chee Sun (Electronics and Electrical Engineering, Dongguk University-Seoul)
  • Received : 2013.03.25
  • Accepted : 2013.09.26
  • Published : 2013.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The important requirements for stereo video retargeting are threefold: keeping temporal coherence, preventing depth distortion, and minimizing shape distortions of the retargeted video. To meet these requirements, the left and right video sequences are divided into groups of frames (GoFs), where the GoF is a basic unit for the seam carving and we assign a set of fixed seams for all frames within the GoF. To determine the fixed seams for each GoF, we need to find the GoF boundary in the video first. Then, the representative frame for each GoF is generated by considering the spatial saliency and temporal coherence. Also, the confidence of the stereoscopic correspondence between the left and right frames is considered to prevent depth distortion.

Keywords

References

  1. S. Avidan and A. Shamir, "Seam Carving for Content-Aware Image Resizing," ACM Trans. Graph., vol. 26, no. 3, July 2007, pp. 10.1-10.9. https://doi.org/10.1145/1276377.1276504
  2. M. Rubinstein, A. Shamir, and S. Avidan, "Improved Seam Carving for Video Retargeting," ACM Trans. Graph., vol. 27, no. 3, Aug. 2008, pp. 16.1-16.9.
  3. M. Grundmann et al., "Discontinuous Seam-carving for Video Retargeting," IEEE Conf. Comput. Vis. Pattern Recog., June 2010, pp. 569-576.
  4. K. Utsugi et al., "Seam Carving for Stereo Images," Proc. IEEE 3DTV Conf., June 2010, pp. 1-4.
  5. T. Basha, Y. Moses, and S. Avidan, "Geometrically Consistent Stereo Seam Carving," Proc. IEEE ICCV Int. Conf., Nov. 2011, pp. 1816-1823.
  6. Z. Yuan et al., "Addressing Visual Consistency in Video Retargeting: A Refined Homogeneous Approach," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 6, June 2012, pp. 890-903. https://doi.org/10.1109/TCSVT.2011.2181230
  7. C. Chamaret, G. Boisson, and C. Chevance, "Video Retargeting for Stereoscopic Content under 3D Viewing Constraints," IS&T/SPIE Electron. Imaging, Stereoscopic Displays Appl. XXIII, vol. 8288, Feb. 2012.
  8. Y.S. Wang et al., "Motion-Based Video Retargeting with Optimized Crop-and-Warp," ACM Trans. Graph., vol. 29, no. 4, July 2010, pp. 90.1-90.9.
  9. T.C. Yen, C.M. Tsai, and C.W. Lin, "Maintaining Temporal Coherence in Video Retargeting Using Mosaic-Guided Scaling," IEEE Trans. Image Process., vol. 20, no. 8, Aug. 2011, pp. 2339-2351. https://doi.org/10.1109/TIP.2011.2114357
  10. B. Yan, K. Sun, and L. Liu, "Matching Area Based Seam Carving for Video Retargeting," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 2, Feb. 2013, pp. 302-310. https://doi.org/10.1109/TCSVT.2012.2203740
  11. H.T. Nguyen and C.S. Won, "Video Retargeting Based on Group of Frames," J. Electron. Imaging, vol. 22, no. 2, June 2013, pp. 023023-1-023023-7. https://doi.org/10.1117/1.JEI.22.2.023023
  12. H. Hirschmuller, "Stereo Processing by Semiglobal Matching and Mutual Information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, Feb. 2008, pp. 328-341. https://doi.org/10.1109/TPAMI.2007.1166

Cited by

  1. Stereoscopic Visual Attention Guided Seam Carving for Stereoscopic Image Retargeting vol.12, pp.1, 2013, https://doi.org/10.1109/jdt.2015.2446973
  2. An Energy-Constrained Video Retargeting Approach for Color-Plus-Depth 3D Video vol.12, pp.5, 2013, https://doi.org/10.1109/jdt.2015.2501825
  3. QoE-Guided Warping for Stereoscopic Image Retargeting vol.26, pp.10, 2013, https://doi.org/10.1109/tip.2017.2721546
  4. Vertical Retargeting for Stereoscopic Images via Stereo Seam Carving vol.16, pp.4, 2013, https://doi.org/10.1145/3408295