DOI QR코드

DOI QR Code

Real-Time Object Segmentation in Image Sequences

연속 영상 기반 실시간 객체 분할

  • Received : 2010.12.02
  • Accepted : 2011.04.20
  • Published : 2011.08.31

Abstract

This paper shows an approach for real-time object segmentation on GPU (Graphics Processing Unit) using CUDA (Compute Unified Device Architecture). Recently, many applications that is monitoring system, motion analysis, object tracking or etc require real-time processing. It is not suitable for object segmentation to procedure real-time in CPU. NVIDIA provide CUDA platform for Parallel Processing for General Computation to upgrade limit of Hardware Graphic. In this paper, we use adaptive Gaussian Mixture Background Modeling in the step of object extraction and CCL(Connected Component Labeling) for classification. The speed of GPU and CPU is compared and evaluated with implementation in Core2 Quad processor with 2.4GHz.The GPU version achieved a speedup of 3x-4x over the CPU version.

본 논문은 GPU(Graphics Processing Unit) 에서 CUDA(Compute Unified Device Architecture)를 사용하여 실시간으로 객체를 분할하는 방법을 소개한다. 최근에 감시 시스템, 오브젝트 추적, 모션 분석 등의 많은 응용 프로그램들은 실시간 처리가 요구된다. 이러한 단계의 선행부분인 객체 분할 기법은 기존 CPU 기반의 시스템으로는 실시간 처리에 제약이 발생한다. NVIDIA에서는 Parallel Processing for General Computation 을 위해 그래픽 하드웨어 제약을 개선한 CUDA platform을 제공하고 있다. 본 논문에서는 객체 추출 단계에 대표적인 적응적 가우시안 혼합 배경 모델링(Adaptive Gaussian Mixture Background Modeling) 알고리즘과 Classification 기법으로 사용되는 CCL (Connected Component Labeling) 알고리즘을 적용하였다. 본 논문은 2.4GHz를 갖는 Core2 Quad 프로세서와 비교하여 평가하였고 그 결과 3~4배 이상의 성능향상을 확인할 수 있었다.

Keywords

References

  1. P. Kaew, T. Pong and R. Bowden, "An Improved Adaptive Background Mixture Model for Real-Time Tracking with Shadow Detection," Proc. European Workshop Advanced Video Based Surveillance Systems, Sep., 2001
  2. G. Wel, S. C. Romano R. Lee L. "Using adaptive tracking to classify and monitor activities in a site," in Proceedings.1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998. https://doi.org/10.1109/CVPR.1998.698583
  3. Stauffer C, Grimson W. E. L, "Learning patterns of activity using real-time tracking," IEEE Transactions on Pattern Analysis &Machine Intelligence, vol.22(8), pp.747-57, 2000. https://doi.org/10.1109/34.868677
  4. G. M. Harville and J. Woodfill."Foreground Segmentation Usingadaptive Mixture Models in Color and Depth," Workshopon Detection and Recognition of Events in Video, 2001.
  5. P. W.Power and J. A.Schoonees. "Understanding backgroundmixture models for foreground segmentation," IVCNZ, Nov., 2002.
  6. K. Suzuki, I. Horiba and N. Sugie, "Linear-time connected component labeling based on sequential local operations," Comput. Vis. Image Underst. 89(1), pp.1-23, 2003. https://doi.org/10.1016/S1077-3142(02)00030-9
  7. L. He, Y. Chao, K. Suzuki and K. Wu, "Fast connected-component labeling," Pattern Recognition.42, pp.1977-1987, 2009. https://doi.org/10.1016/j.patcog.2008.10.013
  8. K. Wu, E. Otoo, K. Suzuki, "Optimizing two-pass connected-component labeling algorithms," Pattern Anal. Applic.12, pp.117-135, 2009. https://doi.org/10.1007/s10044-008-0109-y
  9. J. D. Owens, D. Luebke, N. Govindaraju, M. Harris, J. Kruger, A. E. Lefohn, and T. J. Purcell, "A Survey of General-Purpose Computation on Graphics Hardware," Comput. Graph.Forum 26, pp.80-113, 2007. https://doi.org/10.1111/j.1467-8659.2007.01012.x
  10. M. Pharr and R. Fernando, "GPU Gems 2: Programming Techniques for High-Performance Graphics and General-Purpose Computation", Addison Wesley, Messachusetts, 2005.
  11. NVIDIA, 2007, CUDA Technology. Available from: http://www.nvidia.com/CUDA.
  12. Nickolls, J. Buck, I. Garland, M. Skadron. K,"Scalable Parallel Programming with CUDA", ACM6(2), pp.40-53, 2008
  13. Halfhill, T.R.,2008, "Parallel Processing With CUDA", Microprocessor Report [Online] Available from: http://www.MPRonline.com
  14. P. Kumar, K. Palaniappan, A. Mittal, and G. Seetharaman, "Parallel Blob Extraction Using the Multi-core Cell Processor", ACIVS 2009, LNCS 5807, pp.320-332, 2009.
  15. C.Stauffer, W.E.L. Grimson. "Adaptive Backgroud Mixture Models for Real-Time Tracking," Proc. CVPR, Vol.2, pp. 246-252, 1999. https://doi.org/10.1109/CVPR.1999.784637
  16. M.Harville, G.Gordon, and J. Woodfill"Adaptive Video Background Modeling Using Color and Depth," Proc. IEEE. Published in the 2001 International Conference on Image Processing (ICIP-2001), October, 7-10, 2001 https://doi.org/10.1109/ICIP.2001.958058
  17. D. S. Lee"Effective Gaussian Mixture Learning for Video Background Subtraction," IEEE Transactions on Pattern Analysis and Machine Inteeligence, Vol.27, No.5, May, 2005. https://doi.org/10.1109/TPAMI.2005.102