Journal of KIISE:Computing Practices and Letters (한국정보과학회논문지:컴퓨팅의 실제 및 레터)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

A Robust Algorithm for Moving Object Segmentation and VOP Extraction in Video Sequences

비디오 시퀸스에서 움직임 객체 분할과 VOP 추출을 위한 강력한 알고리즘

  • Kim, Jun-Ki (Dept. of Computer Engineering, Hoseo University) ;
  • Lee, Ho-Suk (Dept. of Computer Engineering, Hoseo University)
  • 김준기 (호서대학교 컴퓨터공학부) ;
  • 이호석 (호서대학교 컴퓨터공학부)
  • Published : 2002.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

Video object segmentation is an important component for object-based video coding scheme such as MPEG-4. In this paper, a robust algorithm for segmentation of moving objects in video sequences and VOP(Video Object Planes) extraction is presented. The points of this paper are detection, of an accurate object boundary by associating moving object edge with spatial object edge and generation of VOP. The algorithm begins with the difference between two successive frames. And after extracting difference image, the accurate moving object edge is produced by using the Canny algorithm and morphological operation. To enhance extracting performance, we app]y the morphological operation to extract more accurate VOP. To be specific, we apply morphological erosion operation to detect only accurate object edges. And moving object edges between two images are generated by adjusting the size of the edges. This paper presents a robust algorithm implementation for fast moving object detection by extracting accurate object boundaries in video sequences.

비디오 객체 분할은 MPEG-4와 같은 객체기반 비디오 코딩을 위한 중요한 구성 요소이다. 본논문은 비디오 시퀸스에서 움직임 객체 분할을 위한 새로운 알고리즘과 VOP(Video Object Plane)추출 방법을 소개한다. 본 논문의 핵심은 시간적으로 변하는 움직임 객체 에지와 공간적 객체 에지 검출 결과를 효율적으로 조합하여 정확한 객체 경계를 추출하는 것이다. 이후 추출된 에지를 통하여 VOP를 생성한다. 본 알고리즘은 첫 번째 프레임을 기준영상으로 설정한 후 두 개의 연속된 프레임 사이의 움직임 픽셀 차이 값으로부터 시작된다. 차이영상을 추출한 후 차이영상에 Canny 에지 연산과 수리형태 녹임 연산(erosion)을 적용하고, 다음 프레임의 영상에 Canny 에지 연산과 수리형태 녹임 연산을 적용하여 두 프레임 사이의 에지 비교를 통하여 정확한 움직임 객체 경계를 추출한다. 이 과정에서 수리형태학 녹임 연산은 잘못된 객체 에지의 검출을 방지하는 작용을 한다. 두 영상 사이의 정확한 움직임 객체 에지(moving object edge)는 에지 크기를 조절하여 생성한다. 본 알고리즘은 픽셀 범위까지 고려한 정화한 객체의 경계를 얻음으로서 매우 쉬운 구현과 빠른 객체 추출을 보였다.

Keywords

References

  1. T. Sikora, 'The MPGE-4 Video Standard Verification Model,' IEEE Trans. on Circuits ans System for Video Technology, Vol. 7, p. 19-31, Feb., 1998 https://doi.org/10.1109/76.554415
  2. M.C. Kim, J.G. Choi, and D.H. Kim et al., 'A VOP Generation Tool : Automatic Segmentation of Moving Objects in Image Sequences based on Spatio-Temporal Information,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 9, No. 8, Dec., 1999 https://doi.org/10.1109/76.809157
  3. T. Meier and K.N. Ngan, 'Automatic segmentation of moving objects for video object plane generation,' IEEE Trans. on Pattern Anal. Maxhine Intell., Vol. 15, pp. 525-538, Sept., 1998 https://doi.org/10.1109/76.718500
  4. P. Bouthemy and E. Francois, 'Motion segmentation and qualitative dynamic scene analysis from a image sequence,' Int. J. Computer Vision, Vol. 10, No. 2, pp. 157-182, 1993 https://doi.org/10.1007/BF01420735
  5. D. Wang, 'Unsupervised Video Segmentation Based on Watersheds and Temporal Tracking,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8, No. 5, Sept., 1998 https://doi.org/10.1109/76.718501
  6. J. Scharcanski and A.N.Venetsanopoulos, 'Edge detection of color image using directional operator,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 7, No. 2, April 1997 https://doi.org/10.1109/76.564116
  7. A. M. Tekalp, Digital Video Processing, Prentice Hall, Inc., 1996
  8. M.M. Chang, A.M. Tekalp and M.I. Sezan, 'Simultaneous motion estimation and segmentation,' IEEE Trans. on Image Processing, Vol. 6, pp.1326-1333, Sept., 1997 https://doi.org/10.1109/83.623196
  9. J.Y.A. Wang and E.H. Adelson, 'Representing moving images with layers,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 3, No. 5, Sept., 1994 https://doi.org/10.1109/83.334981
  10. C. Cuand M.-C. Lee, 'Semiautomatic segmentation and Tracking of Semantic Video Object,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8, No. 5, Sept., 1998 https://doi.org/10.1109/76.718504
  11. C. Cu and M.-C. Lee, 'Tracking of Multiple semantic Video Objects for Internet Applications,' SPIE, Visual Communications and Image Processing'99, Vol. 3653 https://doi.org/10.1117/12.334733
  12. R. Castango, T. Ebrahimi and M. Kunt, 'Video Segmentation based on multiple Features for Interactive Multimedia Application,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8, No. 5, Sept., 1998 https://doi.org/10.1109/76.718503
  13. J.G. Choi, M. Kim, M.H. Lee, and C. Ahn, 'Automatic segmentation based on spatio-temporal information,' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8, pp. 525-538, Sept., 1998 https://doi.org/10.1109/76.718500
  14. Ju Cuo et al., 'Fast and accurate moving object extraction technique for MPGE-4 object-based video coding,' SPIE, Vol. 3653, pp. 1210-1221, January 1999 https://doi.org/10.1117/12.334628
  15. B.K.P. Horn and B.G. Schunck, 'Determining optical flow,' Artifi Intell., Vol. 17, pp. 185-203, 1981 https://doi.org/10.1016/0004-3702(81)90024-2
  16. J. Canny, 'A computational approach to edge detection,' IEEE Trans. on Pattern Anal. Machine Intell., Vol. PAMI-8, pp. 679-698, Nov., 1986 https://doi.org/10.1109/TPAMI.1986.4767851