International Journal of Contents

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

A Review of Advanced Bridge Inspection Technologies Based on Robotic Systems and Image Processing

  • Jo, Byung-Wan (Dept. of Civil and Environmental Engineering Hanyang University) ;
  • Lee, Yun-Sung (Dept. of Civil and Environmental Engineering Hanyang University) ;
  • Kim, Jung-Hoon (Dept. of Civil and Environmental Engineering Hanyang University) ;
  • Yoon, Kwang-Won (Dept. of Safety Management Seoul Metropolitan Government)
  • Received : 2017.10.27
  • Accepted : 2018.09.07
  • Published : 2018.09.28
Download PDF
⟨ Previous Next ⟩

Abstract

To ensure safety of bridges, it is critical to inspect and assess physical and functional conditions regularly. Presently, most highway bridges in the U.S. are inspected visually. However, this method of inspection is often influenced by the bridge inspector's knowledge and experience. So, reliability and accuracy of inspection results may be problematic. To solve such problems, an extensive number of robotics systems and image processing techniques for bridge inspection methods have been proposed. These robotics systems and image processing techniques are used to measure various bridge conditions, such as apparent damage, displacement and dynamic characteristics. This paper provides a comprehensive review of robotics systems and image processing technologies used in bridge inspection.

Keywords

References

  1. B. A. Graybeal, B. M. Phares, D. D. Rolander, M. Moore, and G. Washer, "Visual inspection of highway bridges," Journal of Nondestructive Evaluation, vol. 21, no. 3, 2002, pp. 67-83. https://doi.org/10.1023/A:1022508121821
  2. M. R. Jahanshahi, J. S. Kelly, S. F. Masri, and G. S. Sukhatme, "A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures," Structure and Infrastructure Engineering, vol. 5, no. 6, 2009, pp. 455-486. https://doi.org/10.1080/15732470801945930
  3. H. B. Yun, S. H. Kim, L. L. Wu, and J. J. Lee, "Development of Inspection Robots for Bridge Cables," Scientific World Journal, vol. 2013, 2013.
  4. D. Tenzera, G. Puz, and J. Radic, "Visual inspection in evaluation of bridge condition," Gradevinar, vol. 64, no. 9, 2012, pp. 717-726.
  5. S. N. Laboratories, Visual Inspection : A Review of the Literature, Sandia Report SAND2012-8590, Sandia National Laboratories, Albuquerque, New Mexico, 2012.
  6. E. D. Megaw, "Factors Affecting Visual Inspection Accuracy," Applied Ergonomics, vol. 10, no. 1, 1979, pp. 27-32. https://doi.org/10.1016/0003-6870(79)90006-1
  7. M. Moore, B. M. Phares, B. Graybeal, D. Rolander, and G. Washer, Reliability of visual inspection for highway bridges, volume I: Final report, FHWA Rep. No. FHWARD-01-020, FHWA, U.S. Dept. of Transportation, Washington, D.C., 2001.
  8. D. Agdas, J. A. Rice, J. R. Martinez, and I. R. Lasa, "Comparison of visual inspection and structural-health monitoring as bridge condition assessment methods," Journal of Performance of Constructed Facilities, vol. 30, no. 3, 2015, pp. 1-21.
  9. M. Salman and V. Baporikar, "Image based detection and inspection of cracks on bridge surface using an autonomous robot[review]," International Journal on Recent and Innovation Trends in Computing and Communication, vol. 3, no. 2, 2015, pp. 23-27.
  10. R. S. Lim, H. M. La, and W. Sheng, "A robotic crack inspection and mapping system for bridge deck maintenance," IEEE Transactions on Automation Science and Engineering, vol. 11, no. 2, 2014, pp. 367-378. https://doi.org/10.1109/TASE.2013.2294687
  11. B. Chu, D. Kim, and D. Hong, "Robotic automation technologies in construction: a review," International Journal of Precision Engineering and Manufacturing, vol. 9, no. 3, 2008, pp. 85-91.
  12. C. Koch, K. Georgieva, V. Kasireddy, B. Akinci, and P. Fieguth, "A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure," Advanced Engineering Informatics, vol. 29, no. 2, 2015, pp. 196-210. https://doi.org/10.1016/j.aei.2015.01.008
  13. D. Schmidt and K. Berns, "Climbing robots for maintenance and inspections of vertical structures A survey of design aspects and technologies," Robotics and Autonomous Systems, vol. 61, no. 12, 2013, pp. 1288-1305. https://doi.org/10.1016/j.robot.2013.09.002
  14. T.D.o. Transportation, Bridge inspection manual, http://onlinemanuals.txdot.gov/txdotmanuals/ins/index.htm.
  15. C.o.F. Regulations, "National Bridge Inspections Standards Regulation (NBIS)," https://www.fhwa.dot.gov/bridge/nbis.cfm.
  16. D. Rolander, B. Phares, B. Graybeal, M. Moore, and G. Washer, "Highway bridge inspection: State-of-the-practice survey," Transportation Research Record: Journal of the Transportation Research Board, no. 1749, 2001, pp. 73-81.
  17. A. Georgopoulos, A. Loizos, and A. Flouda, "Digital image processing as a tool for pavement distress evaluation," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 50, no. 1, 1995, pp. 23-33. https://doi.org/10.1016/0924-2716(95)91844-A
  18. B. J. Lee and H. Lee, "Position-Invariant Neural Network for Digital Pavement Crack Analysis," Computer-Aided Civil and Infrastructure Engineering, vol. 19, no. 2, 2004, pp. 105-118. https://doi.org/10.1111/j.1467-8667.2004.00341.x
  19. O. Abudayyeh, M. Al Bataineh, and I. Abdel-Qader, "An imaging data model for concrete bridge inspection," Advances in Engineering Software, vol. 35, no. 8, 2004, pp. 473-480. https://doi.org/10.1016/j.advengsoft.2004.06.010
  20. T. C. Hutchinson and Z. Chen, "Improved image analysis for evaluating concrete damage," Journal of Computing in Civil Engineering, vol. 20, no. 3, 2006, pp. 210-216. https://doi.org/10.1061/(ASCE)0887-3801(2006)20:3(210)
  21. L. Abdel-Qader, O. Abudayyeh, and M. E. Kelly, "Analysis of edge-detection techniques for crack identification in bridges," Journal of Computing in Civil Engineering, vol. 17, no. 4, 2003, pp. 255-263. https://doi.org/10.1061/(ASCE)0887-3801(2003)17:4(255)
  22. I. Abdel-Qader, S. Pashaie-Rad, O. Abudayyeh, and S. Yehia, "PCA-based algorithm for unsupervised bridge crack detection," Advances in Engineering Software, vol. 37, no. 12, 2006, pp. 771-778. https://doi.org/10.1016/j.advengsoft.2006.06.002
  23. T. Yamaguchi and S. Hashimoto, "Image processing based on percolation model," Ieice Transactions on Information and Systems, vol. E89d, no. 7, 2006, pp. 2044-2052.
  24. T. Yamaguchi and S. Hashimoto, "Fast crack detection method for large-size concrete surface images using percolation-based image processing," Machine Vision and Applications, vol. 21, no. 5, 2010, pp. 797-809. https://doi.org/10.1007/s00138-009-0189-8
  25. Y. Fujita and Y. Hamamoto, "A robust automatic crack detection method from noisy concrete surfaces," Machine Vision and Applications, vol. 22, no. 2, 2011, pp. 245-254. https://doi.org/10.1007/s00138-009-0244-5
  26. B. Y. Lee, Y. Y. Kim, S. T. Yi, and J. K. Kim, "Automated image processing technique for detecting and analysing concrete surface cracks," Structure and Infrastructure Engineering, vol. 9, no. 6, 2013, pp. 567-577. https://doi.org/10.1080/15732479.2011.593891
  27. X. Tong, J. Guo, Y. Ling, and Z. Yin, "A new image-based method for concrete bridge bottom crack detection," 2011 International Conference on Image Analysis and Signal Processing, 2011, pp. 568-571.
  28. G. Bu, S. Chanda, H. Guan, J. Jo, M. Blumenstein, and Y. Loo, "Crack Detection using a Texture Analysis-based Technique for Visual Bridge Inspection," Electronic Journal of Structural Engineering, vol. 14, no. 1, 2015.
  29. H. G. Sohn, Y. M. Lim, K. H. Yun, and G. H. Kim, "Monitoring crack changes in concrete structures," Computer-Aided Civil and Infrastructure Engineering, vol. 20, no. 1, 2005, pp. 52-61. https://doi.org/10.1111/j.1467-8667.2005.00376.x
  30. L. C. Chen, Y. C. Shao, H. H. Jan, C. W. Huang, and Y. M. Tien, "Measuring system for cracks in concrete using multitemporal images," Journal of Surveying Engineering-Asce, vol. 132, no. 2, 2006, pp. 77-82. https://doi.org/10.1061/(ASCE)0733-9453(2006)132:2(77)
  31. K. Ehrig, J. Goebbels, D. Meinel, O. Paetsch, S. Prohaska, and V. Zobel, "Comparison of crack detection methods for analyzing damage processes in concrete with computed tomography," International Symposium on Digital Industrial Radiology and Computed Tomography, Berlin, Germany P, vol. 2, 2011.
  32. Y. S. Yang, C. M. Yang, and C. W. Huang, "Thin crack observation in a reinforced concrete bridge pier test using image processing and analysis," Advances in Engineering Software, vol. 83, 2015, pp. 99-108. https://doi.org/10.1016/j.advengsoft.2015.02.005
  33. M. R. Jahanshahi and S. F. Masri, "Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures," Automation in Construction, vol. 22, 2012, pp. 567-576. https://doi.org/10.1016/j.autcon.2011.11.018
  34. M. R. Jahanshahi and S. F. Masri, "A new methodology for non-contact accurate crack width measurement through photogrammetry for automated structural safety evaluation," Smart materials and structures, vol. 22, no. 3, 2013, p. 035019. https://doi.org/10.1088/0964-1726/22/3/035019
  35. Z. Zhu, S. German, and I. Brilakis, "Detection of large-scale concrete columns for automated bridge inspection," Automation in Construction, vol. 19, no. 8, 2010, pp. 1047-1055. https://doi.org/10.1016/j.autcon.2010.07.016
  36. S. German, I. Brilakis, and R. DesRoches, "Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments," Advanced Engineering Informatics, vol. 26, no. 4, 2012, pp. 846-858. https://doi.org/10.1016/j.aei.2012.06.005
  37. R. S. Adhikari, O. Moselhi, and A. Bagchi, "A study of Image-based Element Condition Index for Bridge Inspection," FUTURE, 2013.
  38. S. Lee, L. M. Chang, and M. Skibniewski, "Automated recognition of surface defects using digital color image processing," Automation in Construction, vol. 15, no. 4, 2006, pp. 540-549. https://doi.org/10.1016/j.autcon.2005.08.001
  39. P. H. Chen, H. K. Shen, C. Y. Lei, and L. M. Chang, "Support-vector-machine-based method for automated steel bridge rust assessment," Automation in Construction, vol. 23, 2012, pp. 9-19. https://doi.org/10.1016/j.autcon.2011.12.001
  40. G. Stephen, J. Brownjohn, and C. Taylor, "Measurements of static and dynamic displacement from visual monitoring of the Humber Bridge," Engineering Structures, vol. 15, no. 3, 1993, pp. 197-208. https://doi.org/10.1016/0141-0296(93)90054-8
  41. P. Olaszek, "Investigation of the dynamic characteristic of bridge structures using a computer vision method," Measurement, vol. 25, no. 3, 1999, pp. 227-236. https://doi.org/10.1016/S0263-2241(99)00006-8
  42. D. V. Jauregui, K. R. White, C. B. Woodward, and K. R. Leitch, "Noncontact photogrammetric measurement of vertical bridge deflection," Journal of Bridge Engineering, vol. 8, no. 4, 2003, pp. 212-222. https://doi.org/10.1061/(ASCE)1084-0702(2003)8:4(212)
  43. U. Poudel, G. Fu, and J. Ye, "Structural damage detection using digital video imaging technique and wavelet transformation," Journal of Sound and Vibration, vol. 286, no. 4, 2005, pp. 869-895. https://doi.org/10.1016/j.jsv.2004.10.043
  44. G. Fu and A. G. Moosa, "An optical approach to structural displacement measurement and its application," Journal of Engineering Mechanics, vol. 128, no. 5, 2002, pp. 511-520. https://doi.org/10.1061/(ASCE)0733-9399(2002)128:5(511)
  45. A. M. Wahbeh, J. P. Caffrey, and S. F. Masri, "A vision-based approach for the direct measurement of displacements in vibrating systems," Smart Materials and Structures, vol. 12, no. 5, 2003, p. 785. https://doi.org/10.1088/0964-1726/12/5/016
  46. P. Kohut, K. Holak, T. Uhl, L. Ortyl, T. Owerko, P. Kuras, and R. Kocierz, "Monitoring of a civil structure's state based on noncontact measurements," Structural Health Monitoring, vol. 12, no. 5-6, 2013, pp. 411-429. https://doi.org/10.1177/1475921713487397
  47. J. J. Lee and M. Shinozuka, "Real-time displacement measurement of a flexible bridge using digital image processing techniques," Experimental mechanics, vol. 46, no. 1, 2006, pp. 105-114. https://doi.org/10.1007/s11340-006-6124-2
  48. J. J. Lee and M. Shinozuka, "A vision-based system for remote sensing of bridge displacement," Ndt & E International, vol. 39, no. 5, 2006, pp. 425-431. https://doi.org/10.1016/j.ndteint.2005.12.003
  49. J. J. Lee, M. Shinozuka, and C. G. Lee, "Evaluation of bridge load carrying capacity based on dynamic displacement measurement using real-time image processing techniques," International Journal of Steel Structures, vol. 6, no. 5, 2006, pp. 377-385.
  50. Y. Fukuda, M. Q. Feng, and M. Shinozuka, "Cost-effective vision-based system for monitoring dynamic response of civil engineering structures," Structural Control and Health Monitoring, vol. 17, no. 8, 2010, pp. 918-936. https://doi.org/10.1002/stc.360
  51. H. S. Choi, J. H. Cheung, S. H. Kim, and J. H. Ahn, "Structural dynamic displacement vision system using digital image processing," NDT & E International, vol. 44, no. 7, 2011, pp. 597-608. https://doi.org/10.1016/j.ndteint.2011.06.003
  52. H. N. Ho, J. H. Lee, Y. S. Park, and J. J. Lee, "A synchronized multipoint vision-based system for displacement measurement of civil infrastructures," The Scientific World Journal, vol. 2012, 2012.
  53. L. Tian and B. Pan, "Remote Bridge Deflection Measurement Using an Advanced Video Deflectometer and Actively Illuminated LED Targets," Sensors, vol. 16, no. 9, 2016, p. 1344. https://doi.org/10.3390/s16091344
  54. S. Yoneyama, A. Kitagawa, S. Iwata, K. Tani, and H. Kikuta, "Bridge deflection measurement using digital image correlation," Experimental Techniques, vol. 31, no. 1, 2007, pp. 34-40. https://doi.org/10.1111/j.1747-1567.2006.00132.x
  55. G. Busca, A. Cigada, P. Mazzoleni, and E. Zappa, "Vibration Monitoring of Multiple Bridge Points by Means of a Unique Vision-Based Measuring System," Experimental Mechanics, vol. 54, no. 2, 2014, pp. 255-271. https://doi.org/10.1007/s11340-013-9784-8
  56. D. M. Feng, M. Q. Feng, E. Ozer, and Y. Fukuda, "A Vision-Based Sensor for Noncontact Structural Displacement Measurement," Sensors, vol. 15, no. 7, 2015, pp. 16557-16575. https://doi.org/10.3390/s150716557
  57. D. Ribeiro, R. Calcada, J. Ferreira, and T. Martins, "Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system," Engineering Structures, vol. 75, 2014, pp. 164-180. https://doi.org/10.1016/j.engstruct.2014.04.051
  58. M. Q. Feng, Y. Fukuda, D. Feng, and M. Mizuta, "Nontarget vision sensor for remote measurement of bridge dynamic response," Journal of Bridge Engineering, vol. 20, no. 12, 2015, p. 04015023. https://doi.org/10.1061/(ASCE)BE.1943-5592.0000747
  59. H. Jeon, Y. Bang, and H. Myung, "A paired visual servoing system for 6-DOF displacement measurement of structures," Smart Materials and Structures, vol. 20, no. 4, 2011, p. 045019. https://doi.org/10.1088/0964-1726/20/4/045019
  60. S. Park, H. Park, J. Kim, and H. Adeli, "3D displacement measurement model for health monitoring of structures using a motion capture system," Measurement, vol. 59, 2015, pp. 352-362. https://doi.org/10.1016/j.measurement.2014.09.063
  61. C. Chang and X. Xiao, "Three-dimensional structural translation and rotation measurement using monocular videogrammetry," Journal of engineering mechanics, vol. 136, no. 7, 2009, pp. 840-848.
  62. Y. Ji and C. Chang, "Nontarget image-based technique for small cable vibration measurement," Journal of Bridge Engineering, vol. 13, no. 1, 2008, pp. 34-42. https://doi.org/10.1061/(ASCE)1084-0702(2008)13:1(34)
  63. Y. Ji and C. Chang, "Nontarget stereo vision technique for spatiotemporal response measurement of line-like structures," Journal of engineering mechanics, vol. 134, no. 6, 2008, pp. 466-474. https://doi.org/10.1061/(ASCE)0733-9399(2008)134:6(466)
  64. S. W. Kim and N. S. Kim, "Dynamic characteristics of suspension bridge hanger cables using digital image processing," NDT & E International, vol. 59, 2013, pp. 25-33. https://doi.org/10.1016/j.ndteint.2013.05.002
  65. B. H. Kim, "Extracting modal parameters of a cable on shaky motion pictures," Mechanical Systems and Signal Processing, vol. 49, no. 1, 2014, pp. 3-12. https://doi.org/10.1016/j.ymssp.2014.02.002
  66. C. C. Chen, W. H. Wu, H. Z. Tseng, C. H. Chen, and G. Lai, "Application of digital photogrammetry techniques in identifying the mode shape ratios of stay cables with multiple camcorders," Measurement, vol. 75, 2015, pp. 134-146. https://doi.org/10.1016/j.measurement.2015.07.037
  67. R. Montero, J. G. Victores, S. Martinez, A. Jardon, and C. Balaguer, "Past, present and future of robotic tunnel inspection," Automation in Construction, vol. 59, 2015, pp. 99-112. https://doi.org/10.1016/j.autcon.2015.02.003
  68. P. C. Tung, Y. R. Hwang, and M. C. Wu, "The development of a mobile manipulator imaging system for bridge crack inspection," Automation in Construction, vol. 11, no. 6, 2002, pp. 717-729. https://doi.org/10.1016/S0926-5805(02)00012-2
  69. J. K. Oh, G. Jang, S. Oh, J. H. Lee, B. J. Yi, Y. S. Moon, J. S. Lee, and Y. Choi, "Bridge inspection robot system with machine vision," Automation in Construction, vol. 18, no. 7, 2009, pp. 929-941. https://doi.org/10.1016/j.autcon.2009.04.003
  70. B. J. Lee, H. T. Kang, J. I. Shin, and C. H. Park, "The Scientific Inspection Method for a PSC Box Bridge Using a Remote-Control Tarantula Robot," 13th Conference of REAAA, 2009.
  71. H. M. La, R. S. Lim, B. B. Basily, N. Gucunski, J. Yi, A. Maher, F. A. Romero, and H. Parvardeh, "Mechatronic systems design for an autonomous robotic system for high-efficiency bridge deck inspection and evaluation," IEEE/ASME Transactions on Mechatronics, vol. 18, no. 6, 2013, pp. 1655-1664. https://doi.org/10.1109/TMECH.2013.2279751
  72. S. Gibb, H. M. La, T. Le, L. Nguyen, R. Schmid, and H. Pham, "Nondestructive evaluation sensor fusion with autonomous robotic system for civil infrastructure inspection," Journal of Field Robotics, 2018, pp. 1-17. https://doi.org/10.1002/rob.21791.
  73. C. Hillenbrand, D. Schmidt, and K. Berns, "CROMSCI: development of a climbing robot with negative pressure adhesion for inspections," Industrial Robot-an International Journal, vol. 35, no. 3, 2008, pp. 228-237. https://doi.org/10.1108/01439910810868552
  74. A. Mazumdar and H. H. Asada, "An Underactuated, Magnetic-Foot Robot for Steel Bridge Inspection," Journal of Mechanisms and Robotics-Transactions of the Asme, vol. 2, no. 3, 2010.
  75. R. Wang and Y. Kawamura, "An Automated Sensing System for Steel Bridge Inspection Using GMR Sensor Array and Magnetic Wheels of Climbing Robot," Journal of Sensors, vol. 2016, 2016, pp. 1-15.
  76. Y. Luo, S. R. Xie, Z. B. Gong, and T. S. Lu, "Development of cable maintenance robot for cable-stayed bridges," Industrial Robot-an International Journal, vol. 34, no. 4, 2007, pp. 303-309. https://doi.org/10.1108/01439910710749627
  77. F. Y. Xu, X. S. Wang, and L. Wang, "Cable Inspection Robot for Cable-Stayed Bridges: Design, Analysis, and Application," Journal of Field Robotics, vol. 28, no. 3, 2011, pp. 441-459. https://doi.org/10.1002/rob.20390
  78. K. H. Cho, H. M. Kim, Y. H. Jin, F. Liu, H. Moon, J. C. Koo, and H. R. Choi, "Inspection Robot for Hanger Cable of Suspension Bridge: Mechanism Design and Analysis," Ieee-Asme Transactions on Mechatronics, vol. 18, no. 6, 2013, pp. 1665-1674. https://doi.org/10.1109/TMECH.2013.2280653
  79. H. M. La, T. H. Dinh, N. H. Pham, Q. P. Ha, and A. Q. Pham, "Automated robotic monitoring and inspection of steel structures and bridges," Robotica, 2018, pp. 1-21. https://doi.org/10.1017/S0263574717000601.
  80. P. Psimoulis, S. Pytharouli, D. Karambalis, and S. Stiros, "Potential of Global Positioning System (GPS) to measure frequencies of oscillations of engineering structures," Journal of Sound and Vibration, vol. 318, no. 3, 2008, pp. 606-623. https://doi.org/10.1016/j.jsv.2008.04.036