• Journal of Korea Society of Industrial Information Systems
• /
• v.29 no.5
• /
• pp.21-32
• /
• 2024

This paper proposes a smart safety system that combines low-cost CW(Continuous Wave) radar and IMU sensors to enhance blind spots that pose safety risks to workers in industrial manufacturing environments. The system employs a 24 GHz radar and a 6-axis IMU sensor to detect worker movements and utilizes a machine learning model to recognize worker situations in vibrating manufacturing sites. The ensemble boosting tree-based model achieved over 92.8% worker detection accuracy, demonstrating its effectiveness in improving safety in industrial settings.

• Journal of the Society of Disaster Information
• /
• v.19 no.3
• /
• pp.498-509
• /
• 2023

Purpose: This paper proposes a method detecting the falling of a maintenance worker in the underground utility tunnel, by applying deep learning techniques using CCTV video, and evaluates the applicability of the proposed method to the worker monitoring of the utility tunnel. Method: Each rule was designed to detect the falling of a maintenance worker by using the inference results from pre-trained YOLOv5 and OpenPose models, respectively. The rules were then integrally applied to detect worker falls within the utility tunnel. Result: Although the worker presence and falling were detected by the proposed model, the inference results were dependent on both the distance between the worker and CCTV and the falling direction of the worker. Additionally, the falling detection system using YOLOv5 shows superior performance, due to its lower dependence on distance and fall direction, compared to the OpenPose-based. Consequently, results from the fall detection using the integrated dual deep learning model were dependent on the YOLOv5 detection performance. Conclusion: The proposed hybrid model shows detecting an abnormal worker in the utility tunnel but the improvement of the model was meaningless compared to the single model based YOLOv5 due to severe differences in detection performance between each deep learning model

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.5 no.7
• /
• pp.1280-1286
• /
• 2001

In this Study, we try to suggest a system that recognize worker's regular motion more effectively First, based on frame difference that separates still background from movable object to video that make a film of worker's motion. The next, with edge detection, estimating the center of motion could recognize continuous motion. By action cognition system that design in this research films worker's action using fixed CCTV to supplement problem of action awareness system that is applied in existent industry spot, various mountings to get action information minimized. Also, shorten session that need in awareness enforcing action awareness through image subtraction and edge detection between frame to reduce time necessary to draw worker's body part special quality, expense designed inexpensive action cognition system as being efficient.

• Journal of the Society of Disaster Information
• /
• v.18 no.2
• /
• pp.269-279
• /
• 2022

Purpose: The purpose of this study is to develop a deep learning-based personal protective equipment detection model for disaster prevention at construction sites, and to apply it to actual construction sites and to analyze the results. Method: In the method of conducting this study, the dataset on the real environment was constructed and the developed personal protective equipment(PPE) detection model was applied. The PPE detection model mainly consists of worker detection and PPE classification model.The worker detection model uses a deep learning-based algorithm to build a dataset obtained from the actual field to learn and detect workers, and the PPE classification model applies the PPE detection algorithm learned from the worker detection area extracted from the work detection model. For verification of the proposed model, experimental results were derived from data obtained from three construction sites. Results: The application of the PPE recognition model to construction site brings up the problems related to mis-recognition and non-recognition. Conclusions: The analysis outcomes were produced to apply the object recognition technology to a construction site, and the need for follow-up research was suggested through representative cases of worker recognition and non-recognition, and mis-recognition of personal protective equipment.

• Journal of the Korean Society of Manufacturing Process Engineers
• /
• v.20 no.12
• /
• pp.1-7
• /
• 2021

The deep learning image processing technique was used to prevent accidents in lathe work caused by worker negligence. During lathe operation, when the chuck is rotated, it is very dangerous if the operator's hand is near the chuck. However, if the chuck is stopped during operation, it is not dangerous for the operator's hand to be in close proximity to the chuck for workpiece measurement, chip removal or tool change. We used YOLO (You Only Look Once), a deep learning image processing program for object detection and classification. Lathe work images such as hand, chuck rotation and chuck stop are used for learning, object detection and classification. As a result of the experiment, object detection and class classification were performed with a success probability of over 80% at a confidence score 0.5. Thus, we conclude that the artificial intelligence deep learning image processing technique can be effective in preventing incidents resulting from worker negligence in future manufacturing systems.

• International conference on construction engineering and project management
• /
• 2024.07a
• /
• pp.367-374
• /
• 2024

The detection and tracking of construction workers in building sites generate valuable data on unsafe behavior, work productivity, and construction progress. Many computer vision-based tracking approaches have been investigated and their capabilities for tracking construction workers have been tested. However, the dynamic nature of real-world construction environments, where workers wear similar outfits and move around in often cluttered and occluded regions, has severely limited the accuracy of these methods. Herein, to enhance the performance of vision-based tracking, a new framework is proposed which seamlessly integrates three computer vision components: detection, tracking, and re-identification (DTR). In DTR, a tracking algorithm continuously tracks identified workers using a detector and tracker in combination. Then, a re-identification model extracts visual features and utilizes them as appearance descriptors in subsequent frames during tracking. Empirical results demonstrate that the proposed method has excellent multi-object-tracking accuracy with better accuracy than an existing approach. The DTR framework can efficiently and accurately monitor workers, ensuring safer and more productive dynamic work environments.

• The Journal of Korea Robotics Society
• /
• v.16 no.3
• /
• pp.270-275
• /
• 2021

Most of the initial forms of cooperative robots were intended to repeat simple tasks in a given space. So, they showed no significant difference from industrial robots. However, research for improving worker's productivity and supplementing human's limited working hours is expanding. Also, there have been active attempts to use it as a service robot by applying AI technology. In line with these social changes, we produced a mobile manipulator that can improve the worker's efficiency and completely replace one person. First, we combined cooperative robot with mobile robot. Second, we applied speech recognition technology and deep learning based object detection. Finally, we integrated all the systems by ROS (robot operating system). This system can communicate with workers by voice and drive autonomously and perform the Pick & Place task.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.5
• /
• pp.735-740
• /
• 2022

The construction is the industry with the highest fatalities, and the fatalities has not decreased despite various institutional improvements. Accordingly, real-time safety management by applying artificial intelligence (AI) to CCTV images is emerging. Although some research on worker detection by applying AI to images of construction sites is being conducted, there are limitations in performance expression due to problems such as complex background due to the nature of the construction industry. In this study, the YOLO model and the OpenPose model were fused to improve the performance of worker detection and posture estimation to improve the detection performance of workers in various complex conditions. This is expected to be highly useful in terms of unsafe behavior and health management of workers in the future.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.904-911
• /
• 2022

Occlusion is one of the most challenging problems for computer vision-based construction monitoring. Due to the intrinsic dynamics of construction scenes, vision-based technologies inevitably suffer from occlusions. Previous researchers have proposed the occlusion handling methods by leveraging the prior information from the sequential images. However, these methods cannot be employed for construction object detection in non-sequential images. As an alternative occlusion handling method, this study proposes a data augmentation-based framework that can enhance the detection performance under occlusions. The proposed approach is specially designed for rebar occlusions, the distinctive type of occlusions frequently happen during construction worker detection. In the proposed method, the artificial rebars are synthetically generated to emulate possible rebar occlusions in construction sites. In this regard, the proposed method enables the model to train a variety of occluded images, thereby improving the detection performance without requiring sequential information. The effectiveness of the proposed method is validated by showing that the proposed method outperforms the baseline model without augmentation. The outcomes demonstrate the great potential of the data augmentation techniques for occlusion handling that can be readily applied to typical object detectors without changing their model architecture.

• International conference on construction engineering and project management
• /
• 2024.07a
• /
• pp.775-782
• /
• 2024

This systematic review comprehensively analyzes the application of computer vision in construction productivity measurement and emphasizes the importance of worker accountability in construction sites. It identifies a significant gap in the connection level between input (resources) and output data (products or progress) of productivity monitoring, a factor not adequately addressed in prior research. The review highlights three fundamental groups: input, output, and connection groups. Object detection, tracking, pose, and activity recognition, as the input stage, are essential for identifying characteristics and worker movements. The output phase will mostly focus on progress monitoring, and understanding the interaction of workers with other entities will be discussed in the connection groups. This study offers four research future research directions for the worker accountability monitoring process, such as human-object interaction (HOI), generative AI, location-based management systems (LBMS), and robotic technologies. The successful accountability monitoring will secure the accuracy of productivity measurement and elevate the competitiveness of the construction industry.