• Smart Structures and Systems
• /
• 제30권1호
• /
• pp.75-88
• /
• 2022

Engineering structures in operation essentially belong to time-varying or nonlinear structures and the resultant response signals are usually non-stationary. For such time-varying structures, it is of great importance to extract time-dependent dynamic parameters from non-stationary response signals, which benefits structural health monitoring, safety assessment and vibration control. However, various traditional signal processing methods are unable to extract the embedded meaningful information. As a newly developed technique, variational mode decomposition (VMD) shows its superiority on signal decomposition, however, it still suffers two main problems. The foremost problem is that the number of modal components is required to be defined in advance. Another problem needs to be addressed is that VMD cannot effectively separate non-stationary signals composed of closely spaced or overlapped modes. As such, a new method named generalized adaptive variational modal decomposition (GAVMD) is proposed. In this new method, the number of component signals is adaptively estimated by an index of mean frequency, while the generalized demodulation algorithm is introduced to yield a generalized VMD that can decompose mode overlapped signals successfully. After that, synchrosqueezing wavelet transform (SWT) is applied to extract instantaneous frequencies (IFs) of the decomposed mono-component signals. To verify the validity and accuracy of the proposed method, three numerical examples and a steel cable with time-varying tension force are investigated. The results demonstrate that the proposed GAVMD method can decompose the multi-component signal with overlapped modes well and its combination with SWT enables a successful IF extraction of each individual component.

• Smart Structures and Systems
• /
• 제30권6호
• /
• pp.673-686
• /
• 2022

Deep learning algorithms for Structural Health Monitoring (SHM) have been extracting the interest of researchers and engineers. These algorithms commonly used loss functions and evaluation indices like the mean square error (MSE) which were not originally designed for SHM problems. An updated loss function which was specifically constructed for deep-learning-based structural damage detection problems has been proposed in this study. By tuning the coefficients of the loss function, the weights for damage localization and quantification can be adapted to the real situation and the deep learning network can avoid unnecessary iterations on damage localization and focus on the damage severity identification. To prove efficiency of the proposed method, structural damage detection using convolutional neural networks (CNNs) was conducted on a truss bridge model. Results showed that the validation curve with the updated loss function converged faster than the traditional MSE. Data augmentation was conducted to improve the anti-noise ability of the proposed method. For reducing the training time, the normalized modal strain energy change (NMSEC) was extracted, and the principal component analysis (PCA) was adopted for dimension reduction. The results showed that the training time was reduced by 90% and the damage identification accuracy could also have a slight increase. Furthermore, the effect of different modes and elements on the training dataset was also analyzed. The proposed method could greatly improve the performance for structural damage detection on both the training time and detection accuracy.

• Smart Structures and Systems
• /
• 제29권1호
• /
• pp.237-250
• /
• 2022

Structural health monitoring (SHM) plays an important role in ensuring the safety and functionality of critical civil infrastructure. In recent years, numerous researchers have conducted studies to develop computer vision and machine learning techniques for SHM purposes, offering the potential to reduce the laborious nature and improve the effectiveness of field inspections. However, high-quality vision data from various types of damaged structures is relatively difficult to obtain, because of the rare occurrence of damaged structures. The lack of data is particularly acute for fatigue crack in steel bridge girder. As a result, the lack of data for training purposes is one of the main issues that hinders wider application of these powerful techniques for SHM. To address this problem, the use of synthetic data is proposed in this article to augment real-world datasets used for training neural networks that can identify fatigue cracks in steel structures. First, random textures representing the surface of steel structures with fatigue cracks are created and mapped onto a 3D graphics model. Subsequently, this model is used to generate synthetic images for various lighting conditions and camera angles. A fully convolutional network is then trained for two cases: (1) using only real-word data, and (2) using both synthetic and real-word data. By employing synthetic data augmentation in the training process, the crack identification performance of the neural network for the test dataset is seen to improve from 35% to 40% and 49% to 62% for intersection over union (IoU) and precision, respectively, demonstrating the efficacy of the proposed approach.

• Smart Structures and Systems
• /
• 제29권1호
• /
• pp.17-28
• /
• 2022

The cable component of cable-stayed bridges is gradually impacted by weather conditions, vehicle loads, and material corrosion. The stayed cable is a critical load-carrying part that closely affects the operational stability of a cable-stayed bridge. Damaged cables might lead to the bridge collapse due to their tension capacity reduction. Thus, it is necessary to develop structural health monitoring (SHM) techniques that accurately identify damaged cables. In this work, a combinational identification method of three efficient techniques, including statistical analysis, clustering, and neural network models, is proposed to detect the damaged cable in a cable-stayed bridge. The measured dataset from the bridge was initially preprocessed to remove the outlier channels. Then, the theory and application of each technique for damage detection were introduced. In general, the statistical approach extracts the parameters representing the damage within time series, and the clustering approach identifies the outliers from the data signals as damaged members, while the deep learning approach uses the nonlinear data dependencies in SHM for the training model. The performance of these approaches in classifying the damaged cable was assessed, and the combinational identification method was obtained using the voting ensemble. Finally, the combination method was compared with an existing outlier detection algorithm, support vector machines (SVM). The results demonstrate that the proposed method is robust and provides higher accuracy for the damaged cable detection in the cable-stayed bridge.

• Smart Structures and Systems
• /
• 제31권4호
• /
• pp.351-363
• /
• 2023

Visual structural inspections are an inseparable part of post-earthquake damage assessments. With unmanned aerial vehicles (UAVs) establishing a new frontier in visual inspections, there are major computational challenges in processing the collected massive amounts of high-resolution visual data. We propose twin deep learning models that can provide accurate high-resolution structural components and damage segmentation masks efficiently. The traditional approach to cope with high memory computational demands is to either uniformly downsample the raw images at the price of losing fine local details or cropping smaller parts of the images leading to a loss of global contextual information. Therefore, our twin models comprising Trainable Resizing for high-resolution Segmentation Network (TRS-Net) and DmgFormer approaches the global and local semantics from different perspectives. TRS-Net is a compound, high-resolution segmentation architecture equipped with learnable downsampler and upsampler modules to minimize information loss for optimal performance and efficiency. DmgFormer utilizes a transformer backbone and a convolutional decoder head with skip connections on a grid of crops aiming for high precision learning without downsizing. An augmented inference technique is used to boost performance further and reduce the possible loss of context due to grid cropping. Comprehensive experiments have been performed on the 3D physics-based graphics models (PBGMs) synthetic environments in the QuakeCity dataset. The proposed framework is evaluated using several metrics on three segmentation tasks: component type, component damage state, and global damage (crack, rebar, spalling). The models were developed as part of the 2^nd International Competition for Structural Health Monitoring.

• International journal of advanced smart convergence
• /
• 제11권1호
• /
• pp.111-116
• /
• 2022

After COVID-19, the number of people with sleep disorders around the world is increasing. In particular, in the flow of the 4th industrial revolution, the differentiation of types and characteristics of the sleep industry is accelerating. Therefore, in this study, the characteristics of each type of sleep-related industry were reclassified from an industrial point of view, and based on this, an attempt was made to review the classification system that can help companies develop sleep products and improve related national systems. Based on the 10th standard industry classification, we compared input cost, value, and usability and analyzed common characteristics, treatments, and preventive effects based on this. A comprehensive taxonomy using matrix analysis was reviewed. As a result, in terms of cost (A), the most common sleeping products are general mattresses and general bedding. It is an IOT device (auxiliary device), and the value aspect (B, B/D) included sleep cafe, bedding rental and management service, and sleep consulting. In terms of utility (A/B), a total of 6 product groups including sleep aids (health functional foods) belong to this category, and in terms of treatment (A/C), a total of 3 product groups including sleep clinics (medical services) belong to this category. As for the product group (A/D) with both properties, it was found that non-insurance sleep treatment medical devices, sleep-related over-the-counter drugs, and some sleep monitoring applications belong to this category. Ultimately, it was found that the sleep industry classification enables the most active product development and composition according to the relative relationship between cost and utility, and treatment and utility. appeared to be necessary.

• Smart Structures and Systems
• /
• 제31권5호
• /
• pp.485-500
• /
• 2023

Machine learning-based structural health monitoring (ML-based SHM) methods are researched extensively in the recent decade due to the availability of advanced information and sensing technology. ML methods are well-known for their pattern recognition capability for complex problems. However, the main obstacle of ML-based SHM is that it often requires pre-collected historical data for model training. In most actual scenarios, damage presence can be detected using the unsupervised learning method through anomaly detection, but to further identify the damage types would require prior knowledge or historical events as references. This creates the cold-start problem, especially for new and unobserved structures. Modal-based methods identify damages based on the changes in the structural global properties but often require dense measurements for accurate results. Therefore, a two-stage hybrid modal-machine learning damage detection scheme is proposed. The first stage detects damage presence using Principal Component Analysis-Frequency Response Function (PCA-FRF) in an unsupervised manner, whereas the second stage further identifies the damage. To solve the cold-start problem, mode shape assessment using the first mode is initiated when no trained model is available yet in the second stage. The damage identified by the modal-based method would be stored for future training. This work highlights the performance of the scheme in alleviating the cold-start issue as it transitions through different phases, starting from zero damage sample available. Results showed that single and multiple damages can be identified at an acceptable accuracy level even when training samples are limited.

• Smart Structures and Systems
• /
• 제32권1호
• /
• pp.1-7
• /
• 2023

In modal analysis, the mode shape reflects the vibration characteristics of the structure, and thus it is widely performed for finite element model updating and structural health monitoring. Generally, the acceleration-based mode shape is suitable to express the characteristics of structures for the translational vibration; however, it is difficult to represent the rotational mode at boundary conditions. A tilt sensor and gyroscope capable of measuring rotational mode are used to analyze the overall behavior of the structure, but extracting its mode shape is the major challenge under the small vibration always. Herein, we conducted a feasibility study on a multi-mode shape estimating approach utilizing a single physical quantity signal. The basic concept of the proposed method is to receive multi-metric dynamic responses from two sensors and obtain mode shapes through bridge loading test with relatively large deformation. In addition, the linear transformation matrix for estimating two mode shapes is derived, and the mode shape based on the gyro sensor data is obtained by acceleration response using ambient vibration. Because the structure's behavior with respect to translational and rotational mode can be confirmed, the proposed method can obtain the total response of the structure considering boundary conditions. To verify the feasibility of the proposed method, we pre-measured dynamic data acquired from five accelerometers and five gyro sensors in a lab-scale test considering bridge structures, and obtained a linear transformation matrix for estimating the multi-mode shapes. In addition, the mode shapes for two physical quantities could be extracted by using only the acceleration data. Finally, the mode shapes estimated by the proposed method were compared with the mode shapes obtained from the two sensors. This study confirmed the applicability of the multi-mode shape estimation approach for accurate damage assessment using multi-dimensional mode shapes of bridge structures, and can be used to evaluate the behavior of structures under ambient vibration.

• Smart Structures and Systems
• /
• 제32권1호
• /
• pp.23-35
• /
• 2023

Steel bolted joint is an important part of steel structure, and its damage directly affects the bearing capacity and durability of steel structure. Currently, the existing research mainly focuses on the identification of corroded bolts and corroded bolts respectively, and there are few studies on multiple states. A detection framework of corroded and loosened bolts is proposed in this study, and the innovations can be summarized as follows: (i) Vision Transformer (ViT) is introduced to replace the third and fourth C3 module of you-only-look-once version 5s (YOLOv5s) algorithm, which increases the attention weights of feature channels and the feature extraction capability. (ii) Three states of the steel bolts are considered, including corroded bolt, bolt missing and clean bolt. (iii) Line segment detector (LSD) is introduced for bolt rotation angle calculation, which realizes bolt looseness detection. The improved YOLOv5s model was validated on the dataset, and the mean average precision (mAP) was increased from 0.902 to 0.952. In terms of a lab-scale joint, the performance of the LSD algorithm and the Hough transform was compared from different perspective angles. The error value of bolt loosening angle of the LSD algorithm is controlled within 1.09%, less than 8.91% of the Hough transform. Furthermore, the proposed framework was applied to fullscale joints of a steel bridge in China. Synthetic images of loosened bolts were successfully identified and the multiple states were well detected. Therefore, the proposed framework can be alternative of monitoring steel bolted joints for management department.

• 항공우주시스템공학회지
• /
• 제17권2호
• /
• pp.111-119
• /
• 2023

본 논문에서 제안하는 스토리지 박스의 내부 상황에 대한 실시간 식별 시스템은 오버헤드 빈의 내부 보관 상태, 무게 정보 및 무게 중심 계산 값을 시각화하는 시스템이다. 제안된 시스템은 로드 셀과 스위치 어레이를 사용하여 각 측정값을 동기화하고 시각적 센서를 통해 의미 있고 필요한 정보를 제공한다. 이 시스템은 C 언어 기반 임베디드 시스템으로 구축되며 1) 내부 가용공간 파악, 2) 무게중심 계산, 3) 실시간 시각 정보 제공이 주요 기능이다. 이러한 기능을 통해 스마트 오버헤드 빈을 개발하고, 향후 화물 적재 자동화 시스템 개발에 기여할 수 있는 실시간 화물 적재 모니터링 기술을 개발하였다.