Browse > Article
http://dx.doi.org/10.5573/IEIESPC.2014.3.3.110

Depth-adaptive Sharpness Adjustments for Stereoscopic Perception Improvement and Hardware Implementation  

Kim, Hak Gu (Department of Electronic Engineering, Inha University)
Kang, Jin Ku (Department of Electronic Engineering, Inha University)
Song, Byung Cheol (Department of Electronic Engineering, Inha University)
Publication Information
IEIE Transactions on Smart Processing and Computing / v.3, no.3, 2014 , pp. 110-117 More about this Journal
Abstract
This paper reports a depth-adaptive sharpness adjustment algorithm for stereoscopic perception improvement, and presents its field-programmable gate array (FPGA) implementation results. The first step of the proposed algorithm was to estimate the depth information of an input stereo video on a block basis. Second, the objects in the input video were segmented according to their depths. Third, the sharpness of the foreground objects was enhanced and that of the background was maintained or weakened. This paper proposes a new sharpness enhancement algorithm to suppress visually annoying artifacts, such as jagging and halos. The simulation results show that the proposed algorithm can improve stereoscopic perception without intentional depth adjustments. In addition, the hardware architecture of the proposed algorithm was designed and implemented on a general-purpose FPGA board. Real-time processing for full high-definition stereo videos was accomplished using 30,278 look-up tables, 24,553 registers, and 1,794,297 bits of memory at an operating frequency of 200MHz.
Keywords
3D; stereo video; sharpness enhancement; object; segmentation; FPGA;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 A. Criminisi, P. Perez, and K. Toyama, "Object removal by exemplar-based inpainting," in Proc. Conf. Computer Vision and Pattern Recognition, Madison, WI, Jun. 2003.
2 J. Park, G. Um, C. Ahn, and C.-T. Ahn, "Virtual control of optical axis of the 3DTV camera for reducing visual fatigue in stereoscopic 3DTV," ETRI Journal, pp. 597-604, 2004.   과학기술학회마을   DOI   ScienceOn
3 N. Holliman, "Mapping perceived depth to regions of interest in stereoscopic images," in Proc. SPIE, Stereoscopic Disp. Virtual Reality Syst. XI, 2004, vol. 5291, pp. 1-12.
4 G. Sun and N. S. Holliman, "Evaluating methods for controlling depth perception in stereoscopic cinematography," in Proc. Stereoscopic Displays Virtual Reality Syst. XX, 2009, vol. 7237, pp.72370I-1-72370I-12.
5 S. J. Daly, R. T. Held, and D. M. Hoffman, "Perceptual issues in stereoscopic signal processing," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 347-361, Jun. 2011.   DOI
6 H. Kim, D. B. Min, S. Choi, and K. Sohn, "Real-time disparity estimation using foreground segmentation for stereo sequences," Optical Engineering, vol. 45, no. 3, pp. 037402(10pages) Mar. 2006.   DOI
7 S. H. Lee and S. Sharma, "Real-time Disparity estimation algorithm for Stereo Camera Systems," IEEE Transaction on Consumer Electronics, vol. 57, pp. 1018-1026, 2011.   DOI
8 D. Tzovaras, M. G. Strintzis, and H. Sahinoglou, "Evaluation of multi resolution block matching techniques for motion and disparity estimation," Signal Processing: Image Communication, vol. 6, no. 1, pp. 59-67, Mar. 1994.   DOI   ScienceOn
9 L. Zhang, "Hierarchical block-based disparity estimation using mean absolute difference and dynamic programming," in Proc. Int. Workshop VeryLow Bit rate Video Coding, 2001, pp. 114-118.
10 E. Lee and Y. Ho, "Generation of multi-view video using a fusion camera system for 3D displays," IEEE Trans. On Consumer Electronics, vol. 56, no. 4, pp. 2797-2805, Dec. 2010.   DOI
11 M. EbroulIzuierdo, "Stereo image analysis for multiviewpoint telepresence applications," Signal Processing: Image Communication, vol. 11, pp. 231-254, 1998.   DOI
12 L. Shapiro, and G. Stockman, Computer Vision, Prentice Hall, pp. 69-73. 2002.
13 A. Polesel, G. Ramponi, and V. Mathews, "Image enhancement via adaptive unsharp masking," IEEE Trans. Image Process., vol. 9, no. 3, pp. 505-510, Mar. 2000.   DOI   ScienceOn
14 Z. Wang, E. P. Simoncelli, and A. C Bovik, "Multiscale structural similarity for image quality assessment," presented at the IEEE Asilomar Conf. Signals, Systems, and Computers, Nov. 2003.
15 G. Deng, "A generalized unsharp masking algorithm," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1249-1261, May 2011.   DOI
16 J. Konrad, B. Lacotte and E. Dubois, "Cancellation of image crosstalk in time sequential displays of stereoscopic video," IEEE Trans. Image Processing, vol. 9, no. 5, pp. 897-908, 2000.   DOI   ScienceOn
17 R.Hartley andA. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2000.
18 D. Kim and W. Sohn, "Depth adjustment for stereoscopic image using visual fatigue prediction and depth-based view synthesis," Proc. Of IEEE International Conference on Multimedia and Expo, pp. 956-961, Jul. 2010.
19 S. Kishi, S. H. Kim, T. Shibata, T.Kawai, J. Hakkinen, J. Takatalo, and G. Nyman, "Scalable 3D image conversion and ergonomic evaluation," Proc. SPIE, vol. 6803, 2008.