Smart Structures and Systems

Techno-Press (테크노프레스)
권호 표지
DOI QR코드

DOI QR Code

A vision-based system for dynamic displacement measurement of long-span bridges: algorithm and verification

  • Ye, X.W. (Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University) ;
  • Ni, Y.Q. (Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University) ;
  • Wai, T.T. (Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University) ;
  • Wong, K.Y. (Highways Department, The Hong Kong SAR Government) ;
  • Zhang, X.M. (Intelligent Structural Health Monitoring R&D Centre, The Hong Kong Polytechnic University Shenzhen Research Institute) ;
  • Xu, F. (Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University)
  • Received : 2013.01.12
  • Accepted : 2013.02.15
  • Published : 2013.09.25
⟨ Previous Next ⟩

Abstract

Dynamic displacement of structures is an important index for in-service structural condition and behavior assessment, but accurate measurement of structural displacement for large-scale civil structures such as long-span bridges still remains as a challenging task. In this paper, a vision-based dynamic displacement measurement system with the use of digital image processing technology is developed, which is featured by its distinctive characteristics in non-contact, long-distance, and high-precision structural displacement measurement. The hardware of this system is mainly composed of a high-resolution industrial CCD (charge-coupled-device) digital camera and an extended-range zoom lens. Through continuously tracing and identifying a target on the structure, the structural displacement is derived through cross-correlation analysis between the predefined pattern and the captured digital images with the aid of a pattern matching algorithm. To validate the developed system, MTS tests of sinusoidal motions under different vibration frequencies and amplitudes and shaking table tests with different excitations (the El-Centro earthquake wave and a sinusoidal motion) are carried out. Additionally, in-situ verification experiments are performed to measure the mid-span vertical displacement of the suspension Tsing Ma Bridge in the operational condition and the cable-stayed Stonecutters Bridge during loading tests. The obtained results show that the developed system exhibits an excellent capability in real-time measurement of structural displacement and can serve as a good complement to the traditional sensors.

Keywords

Acknowledgement

Supported by : The Hong Kong Polytechnic University

References

  1. Chang, C.C. and Ji, Y.F. (2007), "Flexible videogrammetric technique for three-dimensional structural vibration measurement", J. Eng. Mech. - ASCE, 133(6), 656-664. https://doi.org/10.1061/(ASCE)0733-9399(2007)133:6(656)
  2. Choi, H.S., Cheung, J.H., Kim, S.H. and Ahn, J.H. (2011), "Structural dynamic displacement vision system using digital image processing", NDT& E. Int., 44(7), 597-608. https://doi.org/10.1016/j.ndteint.2011.06.003
  3. Fukuda, Y., Feng, M.Q. and Shinozuka, M. (2010), "Cost-effective vision-based system for monitoring dynamic response of civil engineering structures", Struct. Health Monit., 17(8), 918-936. https://doi.org/10.1002/stc.360
  4. Gonzalez, R.C. and Woods, R.E. (2008), Digital image processing, 3rd Ed, Pearson Prentice Hall, Upper Saddle River, NJ.
  5. Jauregui, D.V., White, K.R., Woodward, C.B. and Leitch, K.R. (2003), "Noncontact photogrammetric measurement of vertical bridge deflection", J. Bridge Eng. - ASCE, 8(4), 212-222. https://doi.org/10.1061/(ASCE)1084-0702(2003)8:4(212)
  6. Jurjo, D.L.B.R., Magluta, C., Roitman, N. and Goncalves, P.B. (2010), "Experimental methodology for the dynamic analysis of slender structures based on digital image processing techniques", Mech. Syst. Signal Pr., 24(5), 1369-1382. https://doi.org/10.1016/j.ymssp.2009.12.006
  7. Kim, N.S. and Cho, N.S. (2004), "Estimating deflection of a simple beam model using fiber optic Bragg-grating sensors" , Exp. Mech., 44(4), 433-439. https://doi.org/10.1007/BF02428097
  8. Kim, W. and Laman, J.A. (2012), "Seven-year field monitoring of four integral abutment bridges", J. Perform. Constr. Fac. - ASCE, 26(1), 54-64. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000250
  9. Ko, J.M. and Ni, Y.Q. (2005), "Technology developments in structural health monitoring of large-scale bridges", Eng. Struct., 27(12), 1715-1725. https://doi.org/10.1016/j.engstruct.2005.02.021
  10. Lee, J.J. and Shinozuka, M. (2006), "A vision-based system for remote sensing of bridge displacement", NDT& E. Int., 39(5), 425-431. https://doi.org/10.1016/j.ndteint.2005.12.003
  11. Nassif, H.H., Gindy, M. and Davis, J. (2005), "Comparison of laser Doppler vibrometer with contact sensors for monitoring bridge deflection and vibration", NDT&E. Int., 38(3), 213-218. https://doi.org/10.1016/j.ndteint.2004.06.012
  12. Ni, Y.Q., Xia, Y., Liao, W.Y. and Ko, J.M. (2009), "Technology innovation in developing the structural health monitoring system for Guangzhou New TV Tower", Struct. Health Monit., 16(1), 73-98. https://doi.org/10.1002/stc.303
  13. Okasha, N.M. and Frangopol, D.M. (2012), "Integration of structural health monitoring in a system performance based life-cycle bridge management framework", Struct. Infrastruct. E., 8(11), 999-1016.
  14. Park, K.T., Kim, S.H., Park, H.S. and Lee, K.W. (2005), "The determination of bridge displacement using measured acceleration", Eng. Struct., 27(3), 371-378. https://doi.org/10.1016/j.engstruct.2004.10.013
  15. Santos, C.A., Costa, C.O. and Batista, J.P. (2012), "Calibration methodology of a vision system for measuring the displacements of long-deck suspension bridges", Struct. Health Monit., 19(3), 385-404. https://doi.org/10.1002/stc.438
  16. Stull, C.J., Hemez, F.M. and Farrar, C.R. (2012), "On assessing the robustness of structural health monitoring technologies", Struct. Health Monit., 11(6), 712-723. https://doi.org/10.1177/1475921712451956
  17. Wahbeh, A.M., Caffrey, J.P. and Masri, S.F. (2003), "A vision-based approach for the direct measurement of displacements in vibrating systems", Smart Mater. Struct., 12(5), 785-794. https://doi.org/10.1088/0964-1726/12/5/016
  18. Wong, K.Y. (2004), "Instrumentation and health monitoring of cable-supported bridges", Struct. Health Monit., 11(2), 91-124. https://doi.org/10.1002/stc.33
  19. Wong, K.Y. (2007), "Design of a structural health monitoring system for long-span bridges", Struct. Infrastruct. E., 3(2), 169-185. https://doi.org/10.1080/15732470600591117
  20. Xu, L., Guo, J.J. and Jiang, J.J. (2002), "Time-frequency analysis of a suspension bridge based on GPS", J. Sound Vib., 254(1), 105-116. https://doi.org/10.1006/jsvi.2001.4087
  21. Yi, T.H., Li, H.N. and Gu, M. (2011), "Characterization and extraction of global positioning system multipath signals using improved particle filtering algorithm", Meas. Sci. Technol., 22(7), Article ID 075101: 1-11.
  22. Yi, T.H., Li, H.N. and Gu, M. (2012). "Recent research and applications of GPS-based monitoring technology for high-rise structures", Struct. Health Monit., DOI: 10.1002/stc.1501.
  23. Yi, T.H., Li, H.N. and Gu, M. (2013), "Experimental assessment of high-rate GPS receivers for deformation monitoring of bridge", Measurement, 46(1), 420-432. https://doi.org/10.1016/j.measurement.2012.07.018
  24. Zaurin, R. and Catbas, F.N. (2010), "Integration of computer imaging and sensor data for structural health monitoring of bridges", Smart Mater. Struct., 19(1), 1-15.

Cited by

  1. Structural Monitoring of Metro Infrastructure during Shield Tunneling Construction vol.2014, 2014, https://doi.org/10.1155/2014/784690
  2. Multi-point displacement monitoring of bridges using a vision-based approach vol.20, pp.2, 2015, https://doi.org/10.12989/was.2015.20.2.315
  3. A hybrid self-adaptive Firefly-Nelder-Mead algorithm for structural damage detection vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.957
  4. Deflection monitoring and assessment for a suspension bridge using a connected pipe system: a case study in China vol.22, pp.12, 2015, https://doi.org/10.1002/stc.1751
  5. Stationary and nonstationary analysis on the wind characteristics of a tropical storm vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.1067
  6. Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection – A review vol.156, 2018, https://doi.org/10.1016/j.engstruct.2017.11.018
  7. Review of machine-vision based methodologies for displacement measurement in civil structures vol.8, pp.1, 2018, https://doi.org/10.1007/s13349-017-0261-4
  8. A Practical Monitoring System for the Structural Safety of Mega-Trusses Using Wireless Vibrating Wire Strain Gauges vol.13, pp.12, 2013, https://doi.org/10.3390/s131217346
  9. Structural Health Monitoring of Civil Infrastructure Using Optical Fiber Sensing Technology: A Comprehensive Review vol.2014, 2014, https://doi.org/10.1155/2014/652329
  10. Performance indicator of the atmospheric corrosion monitor and concrete corrosion sensors in Kuwait field research station vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.981
  11. Automated condition assessment of concrete bridges with digital imaging vol.13, pp.6, 2014, https://doi.org/10.12989/sss.2014.13.6.901
  12. Measurement of rivulet movement and thickness on inclined cable using videogrammetry vol.18, pp.3, 2016, https://doi.org/10.12989/sss.2016.18.3.485
  13. Structural damage alarming and localization of cable-supported bridges using multi-novelty indices: a feasibility study vol.54, pp.2, 2015, https://doi.org/10.12989/sem.2015.54.2.337
  14. Long-span bridges: Enhanced data fusion of GPS displacement and deck accelerations vol.147, 2017, https://doi.org/10.1016/j.engstruct.2017.06.018
  15. Analysis of three-dimensional thermal gradients for arch bridge girders using long-term monitoring data vol.15, pp.2, 2015, https://doi.org/10.12989/sss.2015.15.2.469
  16. Computer vision-based displacement and vibration monitoring without using physical target on structures vol.13, pp.4, 2017, https://doi.org/10.1080/15732479.2016.1164729
  17. An anisotropic ultrasonic transducer for Lamb wave applications vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.1055
  18. Structural displacement and strain monitoring based on the edge detection operator vol.20, pp.2, 2017, https://doi.org/10.1177/1369433216660220
  19. Dynamic testing of a laboratory model via vision-based sensing vol.60, 2014, https://doi.org/10.1016/j.engstruct.2013.12.002
  20. Identification of structural dynamic characteristics based on machine vision technology 2018, https://doi.org/10.1016/j.measurement.2017.09.043
  21. Operational modal analysis of reinforced concrete bridges using autoregressive model vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.1017
  22. Identification of structural stiffness and excitation forces in time domain using noncontact vision-based displacement measurement vol.406, 2017, https://doi.org/10.1016/j.jsv.2017.06.008
  23. Extension of indirect displacement estimation method using acceleration and strain to various types of beam structures vol.14, pp.4, 2014, https://doi.org/10.12989/sss.2014.14.4.699
  24. Statistical analysis and probabilistic modeling of WIM monitoring data of an instrumented arch bridge vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.1087
  25. Image-based structural dynamic displacement measurement using different multi-object tracking algorithms vol.17, pp.6, 2016, https://doi.org/10.12989/sss.2016.17.6.935
  26. Force monitoring of steel cables using vision-based sensing technology: methodology and experimental verification vol.18, pp.3, 2016, https://doi.org/10.12989/sss.2016.18.3.585
  27. Vision-based structural displacement measurement: System performance evaluation and influence factor analysis vol.88, 2016, https://doi.org/10.1016/j.measurement.2016.01.024
  28. Experimental validation of cost-effective vision-based structural health monitoring vol.88, 2017, https://doi.org/10.1016/j.ymssp.2016.11.021
  29. Geotechnical monitoring and analyses on the stability and health of a large cross-section railway tunnel constructed in a seismic area 2017, https://doi.org/10.1016/j.measurement.2017.10.039
  30. Computer vision and deep learning–based data anomaly detection method for structural health monitoring pp.1741-3168, 2018, https://doi.org/10.1177/1475921718757405
  31. Statistical Analysis of Stress Signals from Bridge Monitoring by FBG System vol.18, pp.2, 2018, https://doi.org/10.3390/s18020491
  32. Vision-based systems for structural deformation measurement: case studies vol.171, pp.12, 2018, https://doi.org/10.1680/jstbu.17.00134
  33. A non-contact vision-based system for multipoint displacement monitoring in a cable-stayed footbridge vol.25, pp.5, 2018, https://doi.org/10.1002/stc.2155
  34. A parallel stereovision method used for monitoring the collapse of a three-story frame model subjected to seismic loading vol.14, pp.9, 2018, https://doi.org/10.1177/1550147718800626
  35. Spurious mode distinguish by modal response contribution index in eigensystem realization algorithm vol.27, pp.12, 2018, https://doi.org/10.1002/tal.1491
  36. Modal testing and detection of pretension deviation in a cable dome structure pp.2048-4011, 2018, https://doi.org/10.1177/1369433218789197
  37. Strain-based structural condition assessment of an instrumented arch bridge using FBG monitoring data vol.20, pp.2, 2013, https://doi.org/10.12989/sss.2017.20.2.139
  38. Outlier detection of GPS monitoring data using relational analysis and negative selection algorithm vol.20, pp.2, 2013, https://doi.org/10.12989/sss.2017.20.2.219
  39. Analysis and probabilistic modeling of wind characteristics of an arch bridge using structural health monitoring data during typhoons vol.63, pp.6, 2013, https://doi.org/10.12989/sem.2017.63.6.809
  40. Structural health monitoring data reconstruction of a concrete cable-stayed bridge based on wavelet multi-resolution analysis and support vector machine vol.20, pp.5, 2013, https://doi.org/10.12989/cac.2017.20.5.555
  41. Vision-based multipoint measurement systems for structural in-plane and out-of-plane movements including twisting rotation vol.20, pp.5, 2013, https://doi.org/10.12989/sss.2017.20.5.563
  42. Structural performance monitoring of an urban footbridge vol.5, pp.1, 2013, https://doi.org/10.12989/smm.2018.5.1.129
  43. Train-induced dynamic behavior analysis of longitudinal girder in cable-stayed bridge vol.21, pp.5, 2013, https://doi.org/10.12989/sss.2018.21.5.549
  44. Blast vibration of a large-span high-speed railway tunnel based on microseismic monitoring vol.21, pp.5, 2013, https://doi.org/10.12989/sss.2018.21.5.561
  45. Study on mechanical behaviors of large diameter shield tunnel during assembling vol.21, pp.5, 2013, https://doi.org/10.12989/sss.2018.21.5.623
  46. Measuring Structural Deformations in the Laboratory Environment Using Smartphones vol.5, pp.None, 2019, https://doi.org/10.3389/fbuil.2019.00044
  47. Post-yielding tension stiffening of reinforced concrete members using an image analysis method with a consideration of steel ratios vol.7, pp.2, 2013, https://doi.org/10.12989/acc.2019.7.2.117
  48. Real-time geometry identification of moving ships by computer vision techniques in bridge area vol.23, pp.4, 2013, https://doi.org/10.12989/sss.2019.23.4.359
  49. Condition Assessment of Bridge Structures Based on a Liquid Level Sensing System: Theory, Verification and Application vol.44, pp.5, 2013, https://doi.org/10.1007/s13369-018-3425-6
  50. An Improved Step-Type Liquid Level Sensing System for Bridge Structural Dynamic Deflection Monitoring vol.19, pp.9, 2013, https://doi.org/10.3390/s19092155
  51. Non-Target Structural Displacement Measurement Using Reference Frame-Based Deepflow vol.19, pp.13, 2019, https://doi.org/10.3390/s19132992
  52. A review on deep learning-based structural health monitoring of civil infrastructures vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.567
  53. Flexible camera series network for deformation measurement of large scale structures vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.587
  54. Local damage detection of a fan blade under ambient excitation by three-dimensional digital image correlation vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.597
  55. Development of monocular video deflectometer based on inclination sensors vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.607
  56. A completely non-contact recognition system for bridge unit influence line using portable cameras and computer vision vol.24, pp.5, 2019, https://doi.org/10.12989/sss.2019.24.5.617
  57. Structural modal identification and MCMC-based model updating by a Bayesian approach vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.631
  58. Vision-based support in the characterization of superelastic U-shaped SMA elements vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.641
  59. Drift error compensation for vision-based bridge deflection monitoring vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.649
  60. Assessment of speckle image through particle size and image sharpness vol.24, pp.5, 2013, https://doi.org/10.12989/sss.2019.24.5.659
  61. Structural crack detection using deep learning-based fully convolutional networks vol.22, pp.16, 2013, https://doi.org/10.1177/1369433219836292
  62. A non-target structural displacement measurement method using advanced feature matching strategy vol.22, pp.16, 2019, https://doi.org/10.1177/1369433219856171
  63. Thickness Measurement of Water Film/Rivulets Based on Grayscale Index vol.11, pp.23, 2013, https://doi.org/10.3390/rs11232871
  64. Nonlinear finite element model updating with a decentralized approach vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.683
  65. Multi-sensor data fusion based assessment on shield tunnel safety vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.693
  66. Vision-based dense displacement and strain estimation of miter gates with the performance evaluation using physics-based graphics models vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.709
  67. Development and testing of a composite system for bridge health monitoring utilising computer vision and deep learning vol.24, pp.6, 2019, https://doi.org/10.12989/sss.2019.24.6.723
  68. Machine learning approaches for wind speed forecasting using long-term monitoring data: a comparative study vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.733
  69. Autonomous pothole detection using deep region-based convolutional neural network with cloud computing vol.24, pp.6, 2019, https://doi.org/10.12989/sss.2019.24.6.745
  70. Creep of stainless steel under heat flux cyclic loading (500-1000℃) with different mechanical preloads in a vacuum environment using 3D-DIC vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.759
  71. A vision-based system for long-distance remote monitoring of dynamic displacement: experimental verification on a supertall structure vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.769
  72. Test on the anchoring components of steel shear keys in precast shear walls vol.24, pp.6, 2019, https://doi.org/10.12989/sss.2019.24.6.783
  73. Two-dimensional deformation measurement in the centrifuge model test using particle image velocimetry vol.24, pp.6, 2013, https://doi.org/10.12989/sss.2019.24.6.793
  74. Estimation of distributed rotation angles of steel and concrete beams using fiber optic strain sensors vol.29, pp.1, 2013, https://doi.org/10.1088/1361-665x/ab5ade
  75. Free vibration of the complex cable system − An exact method using symbolic computation vol.139, pp.None, 2013, https://doi.org/10.1016/j.ymssp.2020.106636
  76. Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning vol.164, pp.None, 2020, https://doi.org/10.1016/j.measurement.2020.108048
  77. Vision-Based Vibration Monitoring of Structures and Infrastructures: An Overview of Recent Applications vol.6, pp.1, 2013, https://doi.org/10.3390/infrastructures6010004
  78. An Automatic Measurement Method of Test Beam Response Based on Spliced Images vol.2021, pp.None, 2013, https://doi.org/10.1155/2021/9915921
  79. Cost-Effective and Ultraportable Smartphone-Based Vision System for Structural Deflection Monitoring vol.2021, pp.None, 2013, https://doi.org/10.1155/2021/8843857
  80. Performance of Optical Structural Vibration Monitoring Systems in Experimental Modal Analysis vol.21, pp.4, 2013, https://doi.org/10.3390/s21041239
  81. A review of computer vision-based structural health monitoring at local and global levels vol.20, pp.2, 2013, https://doi.org/10.1177/1475921720935585
  82. Fast operational modal analysis of a single-tower cable-stayed bridge by a Bayesian method vol.174, pp.None, 2021, https://doi.org/10.1016/j.measurement.2021.109048
  83. Efficient development of vision-based dense three-dimensional displacement measurement algorithms using physics-based graphics models vol.20, pp.4, 2013, https://doi.org/10.1177/1475921720939522
  84. Surface crack detection based on image stitching and transfer learning with pretrained convolutional neural network vol.28, pp.8, 2021, https://doi.org/10.1002/stc.2766
  85. Structural Crack Detection from Benchmark Data Sets Using Pruned Fully Convolutional Networks vol.147, pp.11, 2013, https://doi.org/10.1061/(asce)st.1943-541x.0003140
  86. NOVEL APPROACH TO EXTRACT DENSE FULL-FIELD DYNAMIC PARAMETERS OF LARGE-SCALE BRIDGES USING SPATIAL SEQUENCE VIDEO vol.27, pp.8, 2013, https://doi.org/10.3846/jcem.2021.15797
  87. A marker-free method for structural dynamic displacement measurement based on optical flow vol.18, pp.1, 2013, https://doi.org/10.1080/15732479.2020.1835999