Browse > Article
http://dx.doi.org/10.12652/Ksce.2021.41.4.0441

Solitary Work Detection of Heavy Equipment Using Computer Vision  

Jeong, Insoo (Seoul National University)
Kim, Jinwoo (Seoul National University)
Chi, Seokho (Seoul National University)
Roh, Myungil (Seoul National University)
Biggs, Herbert (Queensland University of Technology)
Publication Information
KSCE Journal of Civil and Environmental Engineering Research / v.41, no.4, 2021 , pp. 441-447 More about this Journal
Abstract
Construction sites are complex and dangerous because heavy equipment and workers perform various operations simultaneously within limited working areas. Solitary works of heavy equipment in complex job sites can cause fatal accidents, and thus they should interact with spotters and obtain information about surrounding environments during operations. Recently, many computer vision technologies have been developed to automatically monitor construction equipment and detect their interactions with other resources. However, previous methods did not take into account the interactions between equipment and spotters, which is crucial for identifying solitary works of heavy equipment. To address the drawback, this research develops a computer vision-based solitary work detection model that considers interactive operations between heavy equipment and spotters. To validate the proposed model, the research team performed experiments using image data collected from actual construction sites. The results showed that the model was able to detect workers and equipment with 83.4 % accuracy, classify workers and spotters with 84.2 % accuracy, and analyze the equipment-to-spotter interactions with 95.1 % accuracy. The findings of this study can be used to automate manual operation monitoring of heavy equipment and reduce the time and costs required for on-site safety management.
Keywords
Construction site; Heavy equipment; Spotter; Solitary work; Interaction; Computer vision;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Arabi, S., Haghighat, A. and Sharma, A. (2019). A deep learning based solution for construction equipment detection: from development to deployment. arXiv preprint arXiv:1904.09021.
2 Azar, E. R. and McCabe, B. (2012a). "Part based model and spatial-temporal reasoning to recognize hydraulic excavators in construction images and videos." Automation in Construction, Vol. 24, pp. 194-202.   DOI
3 Azar, E. R. and McCabe, B. (2012b). "Automated visual recognition of dump trucks in construction videos." Journal of Computing in Civil Engineering, Vol. 26, No. 6, pp. 769-781.   DOI
4 Chi, S. H. and Caldas, C. H. (2011). "Automated object identification using optical video cameras on construction sites." Computer-Aided Civil and Infrastructure Engineering, Vol. 26, No. 5, pp. 368-380.   DOI
5 Construction Safety Management Information System (COSMIS) (2015). Construction accident DB: 2011~2015 (in Korean), Available at: https://www.csi.go.kr/ (Accessed: November 11, 2020).
6 DarkLabel 1.3 (2018). Image labeling and annotation tool, Available at: https://darkpgmr.tistory.com/16 (Accessed: July 20, 2020).
7 Kim, H. J., Kim, K. N. and Kim, H. K. (2016). "Vision-based object-centric safety assessment using fuzzy inference: Monitoring struck-by accidents with moving objects." Journal of Computing in Civil Engineering, Vol. 30, No. 4, pp. 1-13.
8 Kim, J. W. and Chi, S. H. (2017). "Adaptive detector and tracker on construction sites using functional integration and online learning." Journal of Computing in Civil Engineering, Vol. 31, No. 5, pp. 1-13.
9 Korea Construction Technology Promotion Act (2016). Enforcement decree article 98 and 99, statutes of the Republic of Korea (in Korean).
10 Korea Occupational Safety & Health Agency (KOSHA) (2011). Risk assessment on construction industry by work type (in Korean).
11 Li, H., Chan, G., Wong, J. K. W. and Skitmore, M. (2016). "Real-time locating systems applications in construction." Automation in Construction, Vol. 63, pp. 37-47.   DOI
12 Memarzadeh, M., Golparvar-Fard, M. and Niebles, J. C. (2013). "Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors." Automation in Construction, Vol. 32, pp. 24-37.   DOI
13 Park, M. W. and Brilakis, I. (2012). "Construction worker detection in video frames for initializing vision trackers." Automation in Construction, Vol. 28, pp. 15-25.   DOI
14 Seoul Metropolitan Government Construction Specification (SMGCS) (2018). Safety and health management (in Korean).
15 Yu, Y., Guo, H., Ding, Q., Li, H. and Skitmore, M. (2017). "An experimental study of real-time identification of construction workers' unsafe behaviors." Automation in Construction, Vol. 82, pp. 193-206.   DOI
16 Chi, S. H., Caldas, C. H. and Kim, D. Y. (2009). "A methodology for object identification and tracking in construction based on spatial modeling and image matching techniques." Computer-Aided Civil and Infrastructure Engineering, Vol. 24, No. 3, pp. 199-211.   DOI
17 Fang, Q., Li, H., Luo, X., Ding, L., Luo, H., Rose, T. M. and An, W. (2018). "Detecting non-hardhat-use by a deep learning method from far-field surveillance videos." Automation in Construction, Vol. 85, pp. 1-9.   DOI
18 Zhu, Z., Ren, X. and Chen, Z. (2016). "Visual tracking of construction jobsite workforce and equipment with particle filtering." Journal of Computing in Civil Engineering, Vol. 30, No. 6, pp. 1-15.
19 Cai, J., Zhang, Y. and Cai, H. (2019). "Two-step long short-term memory method for identifying construction activities through positional and attentional cues." Automation in Construction, Vol. 106, pp. 102886.   DOI
20 Kim, J. W., Chi, S. H. and Seo, J. W. (2018). "Interaction analysis for vision-based activity identification of earthmoving excavators and dump trucks." Automation in Construction, Vol. 87, pp. 297-308.   DOI
21 Chi, S. H. and Caldas, C. H. (2012). "Image-based safety assessment: Automated spatial safety risk identification of earthmoving and surface mining activities." Journal of Construction Engineering and Management, Vol. 138, No. 3, pp. 341-351.   DOI
22 MATLAB (2019). A proprietary multi-paradigm programming language and numerical computing environment: developed by MathWorks, Available at: https://kr.mathworks.com/ (Accessed: November 11, 2020).