Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Development of a Reliable Real-time 3D Reconstruction System for Tiny Defects on Steel Surfaces

금속 표면 미세 결함에 대한 신뢰성 있는 실시간 3차원 형상 추출 시스템 개발

  • Received : 2013.08.20
  • Accepted : 2013.10.04
  • Published : 2013.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

In the steel industry, the detection of tiny defects including its 3D characteristics on steel surfaces is very important from the point of view of quality control. A multi-spectral photometric stereo method is an attractive scheme because the shape of the defect can be obtained based on the images which are acquired at the same time by using a multi-channel camera. Moreover, the calculation time required for this scheme can be greatly reduced for real-time application with the aid of a GPU (Graphic Processing Unit). Although a more reliable shape reconstruction of defects can be possible when the numbers of available images are increased, it is not an easy task to construct a camera system which has more than 3 channels in the visible light range. In this paper, a new 6-channel camera system, which can distinguish the vertical/horizontal linearly polarized lights of RGB light sources, was developed by adopting two 3-CCD cameras and two polarized lenses based on the fact that the polarized light is preserved on the steel surface. The photometric stereo scheme with 6 images was accelerated by using a GPU, and the performance of the proposed system was validated through experiments.

Keywords

References

  1. R. Woodham, "Photometric method for determining surface orientation from multiple images," Optical Engineeing, vol. 19, pp. 139-144, 1980.
  2. H. Tagare and R. deFigueiredo, "A theory of photometric stereo for a class of diffuse non-Lambertian surfaces," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 13, no. 2 pp. 133-152, 1991. https://doi.org/10.1109/34.67643
  3. J. Sun, M. Smith, L. Smith, S. Midha, and J. Bamber, "Object surface recovery using a multi-light photometric stereo technique for non-Lambertian surfaces subject to shadows and specularities," Image and Vision Computing, vol. 25, pp. 1050-1057, 2007. https://doi.org/10.1016/j.imavis.2006.04.025
  4. M. L. Smith and L. N. Smith, "Dynamic photometric stereo-a new technique for moving surface analysis," Image and Vision Computing, vol. 23, pp. 841-852, 2005. https://doi.org/10.1016/j.imavis.2005.01.007
  5. B. Bringier, D. Helbert, and M. Khoudeir, "Photometric reconstruction of a dynamic textured surface from just one color image acquisition," Journal of the Optical Society of America. A, vol. 25, no. 3. pp. 566-574, 2008. https://doi.org/10.1364/JOSAA.25.000566
  6. D.-Y. Kang, Y. J. Jang, and S.-C. Won, "Development of an inspection system for planar steel surface using multispectral photometric stereo," Optical Engineering, vol. 52, no. 3, 039701, 2013. https://doi.org/10.1117/1.OE.52.3.039701
  7. T. Malzbender, B. Wilburn, D. Gelb, and B. Ambrisco, "Surface enhancement using real-time photometric stereo and reflectance transformation," Proc. of the European Symposium on Rendering, 2006.
  8. A. Varnavas, V. Argyriou, J. Ng, and A. A. Bharath, "Dense photometric stereo reconstruction on many core GPUs," Proc. of IEEE Computer Vision and Pattern Recognition Workshops, pp. 59-65, 2010.
  9. R. T. Frankot and R. Chellappa, "A method for enforcing integrability in shape from shading algorithms," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 10, no. 4, 1988.
  10. T. Wei and R. Klette, "Height from gradient with surface curvature and area constraints," Indian Conference on Computer Vision, Graphics & Image Processing, Ahmadabad, India, Dec. 2002.
  11. B. K. P. Horn and M. J. Brooks, "The variational approach to shape from shading," Computer Vision, Graphics, and Image Processing, vol. 33, no. 2, pp. 174-208, 1986. https://doi.org/10.1016/0734-189X(86)90114-3
  12. J. M. McDonough, "Lectures on computational numerical analysis of partial differential equations," University of Kentucky, 2008.
  13. V. Nozick, "Pyramidal normal map integration for real- time photometric stereo," in Proc. Europe-Asia Congress on Mechatronics, pp. 128-132, Yokohama, Japan, 2010.
  14. R. Laganiere, OpenCV 2 Computer Vision Application Programming Cookbook, Packt Publishing, 2011.
  15. R. Farber, CUDA Application Design and Development, Elsevier Inc., 2011. 1989.
  16. J. Sanders and E, Kandrot, CUDA by Example: An Introduction to General-Purpose GPU Programming, Addison-Wesley Professional, 2010.
  17. D, B. Kirk and W. W. Hwu, Programming Massively Parallel Processors: A Hands-on Approach, Elsivier Inc., 2010.

Cited by

  1. Analyzing Refractory Bricks of Ladles using Infrared Images vol.21, pp.4, 2015, https://doi.org/10.5302/J.ICROS.2015.14.8036
  2. Development of a 3D Shape Reconstruction System for Defects on a Hot Steel Surface vol.21, pp.5, 2015, https://doi.org/10.5302/J.ICROS.2015.14.0147
  3. Surface roughness inspection in milling operations with photometric stereo and PNN vol.81, pp.5-8, 2015, https://doi.org/10.1007/s00170-015-7249-1