DOI QR코드

DOI QR Code

Depth edge detection by image-based smoothing and morphological operations

  • Received : 2015.12.03
  • Accepted : 2016.02.10
  • Published : 2016.07.01

Abstract

Since 3D measurement technologies have been widely used in manufacturing industries edge detection in a depth image plays an important role in computer vision applications. In this paper, we have proposed an edge detection process in a depth image based on the image based smoothing and morphological operations. In this method we have used the principle of Median filtering, which has a renowned feature for edge preservation properties. The edge detection was done based on Canny Edge detection principle and was improvised with morphological operations, which are represented as combinations of erosion and dilation. Later, we compared our results with some existing methods and exhibited that this method produced better results. However, this method works in multiframe applications with effective framerates. Thus this technique will aid to detect edges robustly from depth images and contribute to promote applications in depth images such as object detection, object segmentation, etc.

Keywords

References

  1. Cass TA. Robust affine structure matching for 3D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998;20:1265-74. https://doi.org/10.1109/34.730560
  2. Weiss I, Ray M. Model-based recognition of 3D object from single images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001;23:116-28. https://doi.org/10.1109/34.908963
  3. Gokturk SB, Yalcin H, Bamji C. A time-of-flight depth sensor system description, issues and solutions. In: Conference on Computer Vision and Pattern Recognition Workshop, 2004. CVPRW'04. IEEE; 2004.
  4. Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D. Object detection with discriminatively trained part based models. Pattern Analysis and Machine Intelligence 2010.
  5. Malisiewicz T, Gupta A, Efros AA. Ensemble of exemplar-SVMs for object detection and beyond. In: Proceedings of ICCV. 2011.
  6. Wang X, Yang M, Zhu S, Lin Y. Regionlets for generic object detection. In: Proceedings of ICCV. 2013.
  7. Rovira-Mas F, Zhang Q, Reid JF. Stereo vision three-dimensional terrain maps for precision agriculture. Computers Electronics in Agriculture 2008;60(2)133-43. https://doi.org/10.1016/j.compag.2007.07.007
  8. Orteu J. 3-D computer vision in experimental mechanics. Optics Lasers in Engineering 2009;47(3-4)282-91. https://doi.org/10.1016/j.optlaseng.2007.11.009
  9. Coudrin B, Devy M, Orteu JJ, Brethes L. An innovative hand-held vision-based digitizing system for 3D modelling. Optics Lasers in Engineering 2011;49(9-10)1168-76. https://doi.org/10.1016/j.optlaseng.2011.05.004
  10. Dias P, Matos M, Santos V. 3D reconstruction of real world scenes using a low cost 3D range scanner. Computer Aided Civil Infrastructure Engineering 2006;21(7)486-97. https://doi.org/10.1111/j.1467-8667.2006.00453.x
  11. Cole DM, Newman PM. Using laser range data for 3D SLAM in outdoor environments. In: 2006 IEEE international conference on robotics and automation. Orlando, FL; 2006. p. 1556-63.
  12. Xu J, Xi N, Zhang C, Shi QA, Gregory J. Real-time 3D shape inspection system of automotive parts based on structured light pattern. Optics Laser Technology 2011;43(1)1-8. https://doi.org/10.1016/j.optlastec.2010.04.008
  13. Gorthi SS, Rajshekhar G, Rastogi P. Three dimensional shape measure-ment using high-order instantaneous moments based fringe projection method. Optics Laser Technology 2011;43(1)40-4. https://doi.org/10.1016/j.optlastec.2010.05.002
  14. Zuo C, Chen Q, Gu GH, Feng SJ, Feng FXY, Li, RB, et al. High-speed three dimensional shape measurement for dynamic scenes using high-frequency tri-polar pulse-width-modulation fringe projection. Optics and Lasers in Engineering 2013;51(8)953-60. https://doi.org/10.1016/j.optlaseng.2013.02.012
  15. Wu K, Xi JT, Yu YG, Yang ZK. 3D profile measurement based on estimation of spatial shifts between intensity ratios from multiple-step triangular patterns. Optics and Lasers in Engineering 2013;51(4)440-5. https://doi.org/10.1016/j.optlaseng.2012.11.007
  16. Izadi S, Kim D, Hilliges O, Molyneaux D, Newcombe R, Kohli P, et al. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th annual ACM symposium on user interface software and technology. ACM; 2011.
  17. Nathan Silberman, Derek Hoiem PK, Fergus R. Indoor segmentation and support inference from rgbd images. In: Proceedings of Computer Vision -ECCV. Berlin, Heidelberg: Springer; 746-60.
  18. Shotton J, Girshick R, Fitzgibbon A, Sharp T, Cook M, Finocchio M, Moore R, Kohli P, Criminisi A, Kipman A, Kipman A, Blake A. Efficient human pose estimation from single depth images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2013;35(12)2821-40. https://doi.org/10.1109/TPAMI.2012.241
  19. Shotton J, Sharp T, Kipman A, Fitzgibbon A, Finocchio M, Blake A, Cook M, Moore R. Real-time human pose recognition in parts from single depth images. Communications of the ACM 2013;56(1)116-24. https://doi.org/10.1145/2398356.2398381
  20. Xia, Lu, Chia-Chih Chen, Aggarwal Jake K. Human detection using depth information by kinect. In: 2011 IEEE Computer Society Con-ference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE.
  21. Eum Hyukmin, Yoon Changyong, Lee Heejin, Park Mignon. Continuous human action recognition using depth-MHI-HOG and a spotter model. Sensors 2015;15(3)5197-227. https://doi.org/10.3390/s150305197
  22. Lejeune A, Pienard S, Van Droogenbroeck M, Verly J. A new jump edge detection method for 3D cameras. In: Proceedings of the International Conference on 3D Imaging (IC3D). Liege, Belgium; 2011.
  23. Chen W, Yue H, Wang J, Wu X. An improved edge detection algorithm for depth map inpainting. Optics and Lasers in Engineering 2014;55: 69-77. https://doi.org/10.1016/j.optlaseng.2013.10.025
  24. Huang T, Yang G, Tang G. A fast two-dimensional median filtering algorithm. IEEE Transactions on Acoustics, Speech and Signal Proces-sing 1979;27(1)13-8. https://doi.org/10.1109/TASSP.1979.1163188
  25. Canny John. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 1986;6: 679-98.
  26. Moeslund T. Canny Edge detection. Denmark: Laboratory of Computer Vision and Media Technology, Aalborg University. [March 2009].
  27. Morphological image analysis. Principles and applications by Pierre Soille. ISBN 3-540-65671-5 (1999), 2nd edition (2003).

Cited by

  1. Registration of 3D scan data using image reprojection vol.18, pp.9, 2016, https://doi.org/10.1007/s12541-017-0143-z
  2. A Novel Edge Detection Algorithm for Mobile Robot Path Planning vol.2018, pp.None, 2016, https://doi.org/10.1155/2018/1969834
  3. Towards a CAD-based automatic procedure for patient specific cutting guides to assist sternal osteotomies in pectus arcuatum surgical correction vol.6, pp.1, 2016, https://doi.org/10.1016/j.jcde.2018.01.001
  4. Detection of Brain Tumor in MRI Images, Using a Combination of Fuzzy C-Means and Thresholding : vol.11, pp.1, 2016, https://doi.org/10.4018/ijapuc.2019010104
  5. A Corporative System of Edge Mapping and Hybrid Path A*-Douglas-Pucker Algorithm Planning Method vol.54, pp.5, 2019, https://doi.org/10.35741/issn.0258-2724.54.5.43
  6. A simplified and open-source approach for multiple-valued water surface measurements in 2D hydrodynamic experiments vol.42, pp.12, 2016, https://doi.org/10.1007/s40430-020-02702-x
  7. Modeling Two-Person Segmentation and Locomotion for Stereoscopic Action Identification: A Sustainable Video Surveillance System vol.13, pp.2, 2016, https://doi.org/10.3390/su13020970