Browse > Article

Automatic Extraction of Focused Video Object from Low Depth-of-Field Image Sequences  

Park, Jung-Woo (한국정보통신대학교 공학부)
Kim, Chang-Ick (한국정보통신대학교 공학부)
Abstract
The paper proposes a novel unsupervised video object segmentation algorithm for image sequences with low depth-of-field (DOF), which is a popular photographic technique enabling to represent the intention of photographer by giving a clear focus only on an object-of-interest (OOI). The proposed algorithm largely consists of two modules. The first module automatically extracts OOIs from the first frame by separating sharply focused OOIs from other out-of-focused foreground or background objects. The second module tracks OOIs for the rest of the video sequence, aimed at running the system in real-time, or at least, semi-real-time. The experimental results indicate that the proposed algorithm provides an effective tool, which can be a basis of applications, such as video analysis for virtual reality, immersive video system, photo-realistic video scene generation and video indexing systems.
Keywords
Object of interest; low depth of field; video object segmentation; immersive video;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. Kim and J.-N. Hwang, 'Video Object Extraction for Object-Oriented Applications,' Journal of VLSI Signal Processing - Systems for Signal, Image, and Video Technology, Special Issue on Multimedia Signal Processing, vol. 29, no.1/2, pp. 7-21, August 2001
2 K. Aizawa, A. Kubota, K. Kodama, 'Implicit 3D Approach to Image Generation: Object-Based Visual Effects by Linear Processing of Multiple Differently Focused Images,' in Proc. 10th International Workshop on Theoretical Foundations of Computer Vision, Vol. 2032, pp. 226-237, Dagstuhl Castle, Germany, March 2000
3 D. Comaniciu, P. Meer, 'Robust Analysis of Feature Spaces: Color Image Segmentation,' in Proc. IEEE Conf, Computer Vision and Pattern Recognition (CVPR'97), San Juan, Puerto Rico, 750-755, 1997   DOI
4 C. Kim, 'Segmenting a Low Depth-of-Field Image Using Morphological Filters and Region Merging,' IEEE Tr. on Image Processing, vol. 14, issue 10, pp. 1503-1511, Oct. 2005   DOI   ScienceOn
5 M. Kass, A. Witkin, and D. Terzopoulos, 'Snake: active contour model,' in Proc. of First International Conference on Computer Vision, pp. 259-269, 1987
6 P.J. Besl and R.C. Jain, 'Segmentation through variable - order surface fitting,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, pp. 167-192, March 1988   DOI   ScienceOn
7 L.M. Lifshitz and S.M. Pizer, 'A multiresolution hierarchical approach to image segmentation based on intensity extrema,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 529-540, June 1990   DOI   ScienceOn
8 J. Pan, S. Li, and Y. Zhang, 'Automatic extraction of moving object using multiple features and multiple frames,' in Proc. of IEEE International Symposium on Circuits and Systems, vol. 1, pp. 36-39, May. 2000   DOI
9 C. Gu and M.C. Lee, 'Semiautomatic Segmentation and Tracking of Semantic Video Objects,' IEEE Trans. Circuits Syst. Video Technol. VOL 8, NO. 5, Sept. 1998   DOI   ScienceOn
10 J.Z. Wang, J. Li, R.M. Gray, and G. Wiederhold, 'Unsupervised multiresolution segmentation for images with low depth of field,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no.1, pp. 85-90, Jan. 2001   DOI   ScienceOn
11 Ju Guo, J. Kim, and C.-C. Jaykuo, 'Fast and Accurate Moving Object Extraction Technique for MPEG-4 Object-Based Video Coding,' in Proc. SPIE, vol. 3653, pp. 1210-1221, 1999
12 G. Gelle, M. Colas, G. Delaunay, 'Higher Order Statistics for Detection and Classification of Faulty Fanbelts Using Acoustical Analysis,' in Proc. IEEE Signal Processing Workshop on Higher-Order Statistics (SPW-HOS '97), pp. 43-46, Banff, Canada, July 21-23, 1997   DOI
13 P. Salembier and M. Pardas, 'Hierarchical Morphological segmentation for Image sequence Coding,' IEEE Transactions on Image Processing, vol. 3, no. 5, pp. 639-651, Sept. 1994   DOI   ScienceOn
14 M. Bierling, 'Displacement estimation by hierarchical blockmatching,' in Proc. SPIE Visual Commun. Image Processing, VCIP'88, vol. 1001, pp. 942-951, Cambridge, MA, Nov. 1988
15 M. Wollbom and R. Mech, 'Refined procedure for objective evaluation of video generation algorithms,' Doc. ISO/IEC JTC1/SC29/WG11 M3448, March 1998
16 M. Kim, J.G. Choi, D. Kim, H. Lee, M.H. Lee, and Y. Ho, 'A VOP Generation Tool: Automatic Segmentation of Moving Objects in Image Sequences Based on Spatio-Temporal Information,' IEEE Trans. Circuits Syst. Video Technology, vol. 9, no. 8, 1999   DOI   ScienceOn
17 G. Borgefors, 'Distance Transformations in Digital Images,' Computer Vision, Graphics, and Image Processing, vol. 34, pp. 344-371, 1986   DOI