Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2007.14-B.5.351

Completion of Occluded Objects in a Video Sequence using Spatio-Temporal Matching  

Heo, Mi-Kyoung (경북대학교 컴퓨터공학과)
Moon, Jae-Kyoung (경북대학교 전자전기컴퓨터학부 BK21)
Park, Soon-Yong (경북대학교 컴퓨터공학과)
Publication Information
The KIPS Transactions:PartB / v.14B, no.5, 2007 , pp. 351-360 More about this Journal
Abstract
Video Completion refers to a computer vision technique which restores damaged images by filling missing pixels with suitable color in a video sequence. We propose a new video completion technique to fill in image holes which are caused by removing an unnecessary object in a video sequence, where two objects cross each other in the presence of camera motion. We remove the closer object from a camera which results in image holes. Then these holes are filled by color information of some others frames. First of all, spatio-temporal volumes of occluding and occluded objects are created according to the centroid of the objects. Secondly, a temporal search technique by voxel matching separates and removes the occluding object. Finally. these holes are filled by using spatial search technique. Seams on the boundary of completed pixels we removed by a simple blending technique. Experimental results using real video sequences show that the proposed technique produces new completed videos.
Keywords
Video Completion; Voxel Matching; Spatio-Temporal Volume; Digital Video Special Effects;
Citations & Related Records
연도 인용수 순위
  • Reference
1 jiaya Jia, Tai-Pang Wu, Yu-Wing Tai, Chi-Keung Tang, 'Video Repairing: Inference of Foreground and Background under Severe Occlusion,' IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 364-371, 2004   DOI
2 K. A. Patwardhan, G. Sapiro, and M. Bertalmio, 'Video inpainting of occluding and occluded objects,' Proceedings of IEEE. International Conference on Image Processing Genoa, Italy, 2005   DOI
3 Takaaki Shiratori, Yasuyuki Matsushita, Sing Bing Kang, and Xiaoou Tang, 'Video completion by motion field transfer,' IEEE Computer Vision and Pattern Recognition, Vol 1, pp. 411-418, 2006
4 Richard Hartley and Andrew Zisserman, 'Multiple View Geometry in Computer Vision', 2nd Ed., Cambridge University Press, 2004
5 Y. Zhang, J. Xiao, M. Shah, 'Motion Layer Based Object Removal in Videos,' IEEE Workshop on Application on Computer Vision, Jan 5-6, Breckenridge,Colorado, 2005   DOI
6 M. Bertalmio, G. Sapiro, C. Ballester, and V. Caselles, 'Image Inpainting,' Proc. SIGGRAPH, pp. 417-424, 2000   DOI
7 Soon-Yong Park, Chang-Joon Park, and Inho Lee,'Moving Object Removal and Background Completion in a Video Sequence,' IVCNZ2005, 2005   DOI
8 R. Szeliski, 'Video Mosaics for Virtual Environments,' IEEE Computer Graphics and Applications, pp. 22-30, 1996   DOI   ScienceOn
9 J. Shi and C. Tomasi.'Good features to track,' In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1994
10 Y. Wexler, E. Shechtman, M. Irani. 'Space-Time Video Completion,' IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 120-127, 2004   DOI
11 Yun-Tao Jia, Shi-Min Hu, Ralph R. Martin, 'Video completion using tracking and fragment merging,' The Visual Computer, Vol. 21, No. 8-10, pp. 601-610, 2005   DOI
12 A. Schodl, R. Szeliski, D. Salesin, and I. Essa, 'Video Textures,' Proc. SIGGRAPH, pp. 489-498, 2000   DOI
13 Soon-Yong Park,'Moving Object Removal Based on Global Feature Registration,' ACIVS 2006, LNCS 4179, pp.275-286, 2006   DOI   ScienceOn