Browse > Article
http://dx.doi.org/10.6109/jkiice.2011.15.4.943

Attentional mechanisms for video retargeting and 3D compressive processing  

Hwang, Jae-Jeong (군산대학교 전파공학과)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.15, no.4, 2011 , pp. 943-950 More about this Journal
Abstract
In this paper, we presented an attention measurement method in 2D and 3D image/video to be applied for image and video retargeting and compressive processing. 2D attention is derived from the three main components, intensity, color, and orientation, while depth information is added for 3D attention. A rarity-based attention method is presented to obtain more interested region or objects. Displaced depth information is matched to attention probability in distorted stereo images and finally a stereo distortion predictor is designed by integrating low-level HVS responses. As results, more efficient attention scheme is developed from the conventional methods and performance is proved by applying for video retargeting.
Keywords
Video retargeting; 3D image; Attention; HVS;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. Zitnick and T. Kanade, A cooperative algorithm for stereo matching and occlusion detection, Robotics Institute Tech. Report, CMU-RI-TR-99-35, Carnegie Mellon University, Oct. 1999.
2 Q. Li, S. Wang, and X. Zhang, "Hierarchical identification of visually salient image regions," Int. Conf. on Audio, Language and Image Process. (ICALIP'08), pp. 1708-1712, 7-9 July 2008.
3 A.A. Salah, E. Alpaydin, and L. Akarun, "A Selective attention-based method for visual pattern recognition with application to handwritten digit recognition and face recognition," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 420-425, Mar. 2002.   DOI   ScienceOn
4 N. Ouerhani, et al., "Adaptive color image compression based on visual attention," 11th Int. Conf. on Image Analysis and Process., pp. 416-421, 26-28 Sept. 2001.
5 Y.-F. Ma, L. Lu, H.-J. Zhang and M. Li, "A user attention model for video summarization," Proc. the Tenth ACM Int. Conf. on Multimedia, pp. 533-542, Dec. 2002.
6 Y. Zhang, et al., "Stereoscopic visual attention model for 3D video," LNCS., vol. 5916, pp. 314-324, Dec. 2009.
7 M. Mancas, B. Gosselin, and B. Macq, "A three-level computational attention model," Proc. of ICVS Workshop on Comput. Attention & Appl., 2007.
8 S. Daly, "The visible differences predictor: An algorithm for the assessment of image fidelity," Digital Image and Human Vision, Cambridge, MIT press, A. Watson, ed., pp. 179-206, 1993.
9 R. Milanese, H. Wechsler, S. Gill, J. M. Bots and T. Pun, "Integration of bottom-up and top-down cues for visual attention using non-linear relaxation," Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Seattle, pp. 781-785, 1994.
10 L.Q. Chen, et al., "A visual attention model for adapting images on small displays," Multimedia Systems, vol. 9, pp. 353-364, 2003.   DOI   ScienceOn
11 L. Zhang, et al., "Regions of interest extraction based on visual attention model and watershed segmentation," 10th IEEE Int. Symp. on Multimedia (ISM'08), pp. 667-672, 15-17, Dec. 2008.
12 L. Itti and C. Koch, "Computational modeling of visual attention," Nature Rev. Neuroscience, vol. 2, no. 11, pp. 194-203, Mar. 2001.   DOI   ScienceOn
13 ITU-T, Recommendation P.910, Subjective video quality assessment methods for multimedia applications, April 2008.
14 M. Ferre, R. Aracil, and M. Sanchez-Uran, "Stereoscopic human interfaces," IEEE Robotics & Automation Mag., vol. 15, no. 4, pp. 50-57, Dec. 2008.   DOI   ScienceOn
15 W.A. IJsselsteijn, H. de Ridder, J. Vliegen, "Subjective evaluation of stereoscopic images: effects of camera parameters and display duration," IEEE Trans. on Circuits and Systems for Video Technol., vol. 10, no. 2, pp. 225-233, Mar. 2000.   DOI   ScienceOn
16 Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," Proc. the 14th ACM Int. Conf. on Multimedia, pp. 815-824, Dec. 2006.
17 L. M. J. Meesters, W.A. IJsselsteijn, and P. J. H. Seuntiens, "A survey of perceptual evaluations and requirements of three-dimensional TV," IEEE Trans. on Circuits and Systems for Video Technol., vol. 14, no. 3, pp. 381-391, Mar. 2004.   DOI   ScienceOn
18 S. Narkhede and F. Golshani, "Stereoscopic imaging: a real-time, in depth look," IEEE Potentials, vol. 23, no. 1, pp. 38-42, Feb.-Mar. 2004.   DOI   ScienceOn
19 G. Sun and N.S. Holliman, "Evaluating methods for controlling depth perception in stereoscopic cinematography", Stereoscopic Displays and Virtual Reality Systems XX, Proc. of SPIE-IS&T Electronic Imaging, SPIE, vol. 7237, Jan. 2009.
20 [Awawdeh03] A. Awawdeh and G. Fan, "Pseudocepstrum for assessing stereo quality of retinal images," Asilomar Conf. on Signals, Systems and Computers, vol. 2, pp. 1953-1957, 9-12 Nov. 2003.
21 A. Kubota, et al. "Multiview imaging and 3DTV," IEEE Signal Processing Mag.,vol.24, no.6, pp.10-21, Nov. 2007.
22 M.H. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality", IEEE Trans. on Broadcasting, vol.50, no. 3, pp.312-322, Sep. 2004.   DOI   ScienceOn
23 F. Yang, S. Wan, Q. Xie and H.R. Wu, "No-reference quality assessment for networked video via primary analysis of bit stream", IEEE Trans. on Circuits and Systems for Video Technology, 2010.