Browse > Article

Real-Time Foreground Segmentation and Background Substitution for Protecting Privacy on Visual Communication  

Bae, Gun-Tae (연세대학교 컴퓨터과학과)
Kwak, Soo-Yeong (연세대학교 컴퓨터과학과)
Byun, Hye-Ran (연세대학교 컴퓨터과학과)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.34, no.5C, 2009 , pp. 505-513 More about this Journal
Abstract
This paper proposes a real-time foreground segmentation and background substitution method for protecting the privacy on visual communication. Previous works on this topic have some problems with the color and shape of foreground and the capture device such as stereo camera. we provide a solution which can segment the foreground in real-time using fixed mono camera. For improving the performance of a foreground extraction, we propose the Temporal Foreground Probability Model (TFPM) by modeling temporal information of a video. Also we provide an boundary processing method for natural and smooth synthesizing that using alpha matte and simple post-processing method.
Keywords
real-time foreground segmentation; natural background substitution; Temporal Foreground Probability Model(TFPM); alpha matte; visual communication;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Kumar, S. Ranganath, W. Huang, 'Queue based fast background modelling and fast hysteresis thresholding for better foreground segmentation', The 2003 Joint Conference of the Fourth ICICS and PCM, Vol. 2, pp. 15-18, 2003
2 V. Kolmogorov, A. Criminisi, A. Blake, G. Cross and C. Rother, 'Probabilistic fusion of stereo with color and contrast for bi-layer segmentation', IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol. 76, No. 2, pp. 1480-1492, 2006   DOI   ScienceOn
3 Y. Chuang, B. Curless, D. Salesin, and R. Szeliski, 'A bayesian approach to digital matting', in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR 2001), Vol. 2, pp. 264-271, 2001
4 J. Wang and M. Cohen, 'Optimized color sampling for robust matting', in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2007), pp. 1-8, 2007
5 T. Horprasert, D. Harwood and L.S. Davis 'A Statistical Approach for Real-time Robust Background Subtraction and Shadow Detection', in Proceedings of the 7th IEEE International Conference on Computer Vision, Frame Rate Workshop(ICCV'99), pp. 1-19, 1999
6 Blinn, J.F, 'Compositing. 1. Theory', IEEE Computer Graphics and Applications, Vol. 14, pp. 83-87, 1994   DOI   ScienceOn
7 H. Luo, Eleftheriadis, A., 'Model-based segmentation and tracking of head-and-shoulder video objects for real time multimedia services', IEEE Transactions on Multimedia, Vol. 5, No. 3, pp. 379-389, 2003   DOI   ScienceOn
8 A. R. Smith and J. F. Blinn, 'Blue Screen Matting', in SIGGRAPH '96: Proceeding of the 23rd annual conference on Computer graphics, pp. 259-268, 1996   DOI
9 J. Badenas, J. M. Sanchiz, F. Pla, 'Motion-based segmentation and region tracking in image sequences', Pattern Recognition, Vol. 34, No. 3, pp. 661-670, 2001   DOI   ScienceOn
10 V. Kolmogorov, A. Criminisi, A. Blake, G. Cross and C. Rother, 'Bi-layer segmentation of binocular stereo video', in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Vol. 2, No. 2, pp. 1186-1193, 2005
11 J.H. Ahn and H, Byun, 'Human Silhouette Extraction Method using Region Based Background Subtraction', Mirage 2007: Computer Vision/Computer Graphics Collaboration Techniques and Applications, Lecture Notes in Computer Science, Vol. 4418, pp.412-420, 2007   DOI   ScienceOn
12 C. Stauffer, W. Grimson, 'Adaptive background mixture models for real-time tracking', in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 246-252, 1999   DOI
13 G. Y. Tian, D. Gledhill, D. Taylor, D. Clarke, 'Colour Correction for Panoramic imaging', in Proceedings of the Sixth International Conference on Information Visualization(IV'02), pp. 483-488, 2002   DOI
14 L. Zhao, L.S. Davis, 'Closely coupled object detection and segmentation', in Proceedings of the 10th IEEE International Conference on Computer Vision(ICCV'05), Vol. 1, pp. 454-461, 2005   DOI