Browse > Article
http://dx.doi.org/10.12989/sss.2021.28.2.275

Real-time structural health monitoring system based on streaming data  

Zhang, Qilin (College of Civil Engineering, Tongji University)
Sun, Siyuan (College of Civil Engineering, Tongji University)
Yang, Bin (College of Civil Engineering, Tongji University)
Wuchner, Roland (Technical University of Munich)
Pan, Licheng (College of Civil Engineering, Tongji University)
Zhu, Haitao (College of Civil Engineering, Tongji University)
Publication Information
Smart Structures and Systems / v.28, no.2, 2021 , pp. 275-287 More about this Journal
Abstract
In this paper, a novel real-time structural health monitoring (SHM) system based on streaming data is proposed. In contrast to a traditional SHM system, the proposed system implements a series of optimizations for data transmission and processing to reduce the latency and better satisfy the real-time requirement. The concept of the watermark in the streaming system is adopted to address the problem of when to trigger the time window calculation under the real-time requirement. Moreover, a well-designed parallel mechanism is used to satisfy the multistage computation requirement in the parallel data stream. A case study in which the proposed system is applied to the Shanghai Tower is presented. The peak picking method is used as an example in the test environment to track the latency of each main operation under different parallelism schemes. The results show that computing in parallel effectively reduces the latency and provides a reference for integrating the random decrement technique (RDT), stochastic subspace identification (SSI), or other more complex but effective algorithms in parallel into the system in the future. The total latency under the test environment from data generation to data transmission to the web server is approximately only 200-400 ms, which indicates the excellent real-time performance of the system.
Keywords
data stream; latency; computing; real-time; structural health monitoring; parallel;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Akidau, T., Bradshaw, R., Chambers, C., Chernyak, S., FernandezMoctezuma, R.J., Lax, R., McVeety, S., Mills, D., Perry, F., Schmidt, E. and Whittle, S. (2015), "The dataflow model: a practical approach to balancing correctness, latency, and cost in massive-scale, unbounded, out-of-order data processing", Proceedings of the VLDB Endowment, 8, 1792-1803.   DOI
2 Hasani, Z., Kon-Popovska, M. and Velinov, G. (2014), "Lambda architecture for real time big data analytic", ICT Innovations, 133-143.
3 Kijewski-Correa, T., Kwon, D.K., Kareem, A., Bentz, A., Guo, Y., Bobby, S. and Abdelrazaq, A. (2013), "SmartSync: An integrated real-time structural health monitoring and structural identification system for tall buildings", J. Struct. Eng., 139, 1675-1687. https://doi.org/10.1061/(ASCE)ST.1943-541X.0000560   DOI
4 Kreps, J. (2014a), Questioning the Lambda Architecture; https://www.oreilly.com/radar/questioning-the-lambdaarchitecture.
5 Li, H., Zhang, Q.L., Yang, B., Lu, J. and Hu, J. (2015), "Development and application of construction monitoring system for Shanghai Tower", Smart Struct. Syst., Int. J., 15(4), 1019-1039. https://doi.org/10.12989/sss.2015.15.4.1019   DOI
6 Marz, N. (2011), How to beat the CAP theorem; http://nathanmarz.com/blog/how-to-beat-the-cap-theorem.html.
7 Sivasankar, D. and Sakthivel, P. (2017), "Enhancing Quality of Service in Real Time Communication services for Network on Chip", Int. J. Electron. Eng. Res., 9, 233-240.
8 Martin (1965), Programming real-time computer systems.
9 Xia, J., Poon, D. and Mass, D. (2010), "Case Study: Shanghai Tower", CTBUH J, 2010, 12-18.
10 ASF (2003), Apache Hadoop; http://hadoop.apache.org/
11 ASF (2016), Apache Beam; https://beam.apache.org/
12 Clough, R. and Penzien, J. (2003), Dynamics of structures.
13 Dean, J. and Ghemawat, S. (2004), "MapReduce: Simplified data processing on large clusters".
14 Fette, I. and Melnikov, A. (2011), "The websocket protocol".
15 Google (2013), Datafolw I Google Cloud; https://cloud.google.com/dataflow.
16 Ibrahim, S.R. (2012), "Random decrement technique for modal identification of structures", J. Spacecr. Rockets, 14, 696. https://doi.org/10.2514/3.57251   DOI
17 Kaya, Y. and Safak, E. (2015), "Real-time analysis and interpretation of continuous data from structural health monitoring (SHM) systems", Bull. Earthq. Eng., 13, 917-934. https://doi.org/10.1007/s10518-014-9642-9   DOI
18 Federal Standard 1037C (1997), Federal Standard 1037C: Glossary of Telecommunications Terms, National Telecommunication Information Administration, USA.
19 Tantalaki, N., Souravlas, S. and Roumeliotis, M. (2020), "A review on big data real-time stream processing and its scheduling techniques", Int. J. Parallel Emerg. Distrib. Syst., 35, 571-601. https://doi.org/10.1080/17445760.2019.1585848   DOI
20 Orcutt, J. and Vernon, F. (2014), "A Modern Operating System for Near-real-time Environmental Observatories", In: EGU General Assembly Conference Abstracts, p. 14949.
21 Kleppmann, M. (2015), "A Critique of the CAP Theorem".
22 Ko, J.M. and Ni, Y.Q. (2005), "Technology developments in structural health monitoring of large-scale bridges", Eng. Struct., 27, 1715-1725. https://doi.org/10.1016/j.engstruct.2005.02.021   DOI
23 Kreps, J. (2014b), I heart logs: Event data, stream processing, and data integration.
24 ASF (2011), Apache Kafka; https://kafka.apache.org/
25 Zhang, Q., Yang, B., Liu, T., Li, H. and Lv, J. (2015), "Structural health monitoring of Shanghai tower considering timedependent effects", Smart Struct. Syst., Int. J., 4(1), 39-44. https://doi.org/10.21022/IJHRB.2015.4.1.039   DOI
26 Li, H., Zhou, W.S., Ou, J.P. and Yang, Y.S. (2006), "A study on system integration technique of intelligent monitoring systems for soundness of long-span bridges", China Civil Eng. J., 39, 46-52.
27 Mandal, K. (2018), "Evolution of Streaming ETL Technologies".
28 Masri, S.F., Sheng, L.H., Caffrey, J.P., Nigbor, R.L., Wahbeh, M. and Abdel-Ghaffar, A.M. (2004), "Application of a web-enabled real-time structural health monitoring system for civil infrastructure systems", Smart Mater. Struct., 13, 1269-1283. https://doi.org/10.1088/0964-1726/13/6/001   DOI
29 Akidau, T., Balikov, A., Bekiroglu, K., Chernyak, S., Haberman, J., Lax, R., McVeety, S., Mills, D., Nordstrom, P. and Whittle, S. (2013), "MillWheel: fault-tolerant stream processing at internet scale", Proceedings of the VLDB Endowment, 6, 1033-1044. https://doi.org/10.14778/2536222.2536229   DOI
30 Akidau, T., Chernyak, S. and Lax, R. (2017), Streaming Systems.
31 ASF (2014), Apache Flink: Stateful Computations over Data Streams; https://flink.apache.org/
32 Candy, J. (2019), "Stochastic Subspace Identification", In: ModelBased Processing, pp. 309-389. https://doi.org/10.1002/9781119457695.ch7
33 Arnold, D., Lutz, S., Dach, R., Jaggi, A. and Steinborn, J. (2016), "Near real-time coordinate estimation from double-difference GNSS data", In: IAG 150 Years, pp. 691-697. https://doi.org/10.1007/1345_2015_173
34 Zhou, G.D., Yi, T.H. and Chen, B. (2016), "Innovative design of a health monitoring system and its implementation in a complicated long-span arch bridge", J. Aerosp. Eng., 30(3), B4016006. https://doi.org/10.1061/(ASCE)AS.1943-5525.0000603   DOI
35 Su, J.Z., Xia, Y., Chen, L., Zhao, X., Zhang, Q.L., Xu, Y.L., Ding, J.M., Xiong, H.B., Ma, R.J., Lv, X.L. and Chen, A.R. (2013), "Long-term structural performance monitoring system for the Shanghai Tower", J. Civil Struct. Health Monitor., 3, 49-61. https://doi.org/10.1007/s13349-012-0034-z   DOI
36 Yi, T.H., Li, H.N. and Gu, M. (2013), "Recent research and applications of GPS-based monitoring technology for high-rise structures", Struct. Control Health Monitor., 20, 649-670. https://doi.org/10.1002/stc.1501   DOI
37 Yi, T.H., Huang, H.B. and Li, H.N. (2017), "Development of sensor validation methodologies for structural health monitoring: A comprehensive review", Measurement, 109, 200-214. https://doi.org/10.1016/j.measurement.2017.05.064   DOI