International conference on construction engineering and project management (국제학술발표논문집)

  • 2024.07a
  • /
  • Pages.285-292
  • /
  • 2024
  • /
  • 2508-9048(eISSN)
Korea Institute of Construction Engineering and Management (한국건설관리학회)
권호 표지
DOI QR코드

DOI QR Code

Advancing Construction Safety Through a Combination of Immersive Technologies and Physiological Monitoring - A Systematic Review.

  • Francis Xavier Duorinaah (Department of Big Data, Faculty of Engineering, Chungbuk National University) ;
  • Samuel Olatunbosun (Department of Architectural Engineering, Faculty of Engineering, Chungbuk National University) ;
  • Jeong-Hun Won (Department of Safety Engineering, Faculty of Engineering, Chungbuk National University) ;
  • MinKoo Kim (Department of Architectural Engineering, Faculty of Engineering, Chungbuk National University)
  • Published : 2024.07.29
Download PDF
⟨ Previous Next ⟩

Abstract

Physiological devices and immersive technologies are crucial innovations being implemented for construction safety. Physiological devices provide insights into the wellbeing of workers while immersive technologies have a potential to simulate or enhance construction environments. These two technologies present numerous benefits for construction safety and have been extensively implemented in various dimensions. In addition to the individual benefits of these two technologies, combining them presents more opportunities for construction safety research and numerous studies have been conducted using this approach. However, despite promising results achieved by studies which have used this technological combination, no review has been conducted to summarize the findings of these studies. This review therefore summarizes studies that have combined immersive technologies with physiological monitoring for construction safety. A systematic approach is employed, and 24 articles are reviewed. This review highlights four safety aspects which have been explored using a combination of immersive technologies and physiological monitoring. These aspects are (1) Safety training and evaluation (2) Hazard identification (3) Attention assessment and (4) Cognitive strain assessment. In addition, there are three main directions for future research. (1) Future studies should explore other types of immersive technologies such as immersive audio (2) Physiological reactions to hazard exposure should be studied and (3) More multi-physiological approaches should be adopted.

Keywords

References

  1. Russmann, M, 2015. Industry 4.0: The future of productivity and growth in manufacturing industries. Boston Consulting Group (BCG), pp.1-14 
  2. Babalola, A., Manu, P., Cheung, C., Yunusa-Kaltungo, A., Bartolo, P., 2023. A systematic review of the application of immersive technologies for safety and health management in the construction sector. Journal of Safety Research 85, 66-85. https://doi.org/10.1016/j.jsr.2023.01.007 
  3. Ahn, C.R., Lee, S., Sun, C., Jebelli, H., Yang, K., Choi, B., 2019. Wearable Sensing Technology Applications in Construction Safety and Health. J. Constr. Eng. Manage. 145, 03119007. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001708 
  4. Huang, S., Li, J., Zhang, P., Zhang, W., 2018. Detection of mental fatigue state with wearable ECG devices. International Journal of Medical Informatics 119, 39-46. 
  5. Choi, B., Jebelli, H., Lee, S., 2019. Feasibility analysis of electrodermal activity (EDA) acquired from wearable sensors to assess construction workers' perceived risk. Safety Science 115, 110-120. https://doi.org/10.1016/j.ssci.2019.01.022 
  6. Aryal, A., Ghahramani, A., Becerik-Gerber, B., 2017. Monitoring fatigue in construction workers using physiological. Autocon 82, 154-165. https://doi.org/10.1016/j.autcon.2017.03.003 
  7. Lee, H.-G., Chung, S., & Lee, W.-H. (2013). Presence in virtual golf simulators: The effects of presence on perceived enjoyment, perceived value, and behavioral intention. New Media & Society, 15(6), 930-946. 
  8. Abbas, A., Choi, M., Seo, J., Cha, S.H., Li, H., 2019. Effectiveness of Immersive Virtual Reality-based Communication for Construction Projects. https://doi.org/10.1007/s12205-019-0898-0 
  9. Al-Ansi, A.M., Jaboob, M., Garad, A., Al-Ansi, A., 2023. Analyzing augmented reality (AR) and virtual reality (VR) recent development in education. https://doi.org/10.1016/j.ssaho.2023.100532 
  10. Kim, N., Kim, J., Ahn, C.R., 2021. Predicting workers' inattentiveness to struck-by hazards by monitoring biosignals during a construction task: A virtual reality experiment. Advanced Engineering Informatics 49, 101359. https://doi.org/10.1016/j.aei.2021.101359 
  11. Jeon, J., Cai, H., 2021. Classification of construction hazard-related perceptions using: Wearable electroencephalogram and virtual reality. Automation in Construction 132, 103975. https://doi.org/10.1016/j.autcon.2021.103975 
  12. Jeon, J., Cai, H., 2022a. Multi-class classification of construction hazards via cognitive states assessment using wearable EEG. Advanced Engineering Informatics 53, 101646. https://doi.org/10.1016/j.aei.2022.101646 
  13. Choi, D., Seo, S., Park, H., Hong, T., Koo, C., 2023. Forecasting personal learning performance in virtual reality-based construction safety training using biometric responses. Automation in Construction 156, 105115. https://doi.org/10.1016/j.autcon.2023.105115 
  14. Noghabaei, M., Han, K., Albert, A., 2021. Feasibility Study to Identify Brain Activity and Eye-Tracking Features for Assessing Hazard Recognition Using Consumer-Grade Wearables in an Immersive Virtual Environment. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002130 
  15. Awolusi, I., Marks, E., Hallowell, M., 2018. Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices. Automation in Construction 85, 96-106. https://doi.org/10.1016/j.autcon.2017.10.010 
  16. Li, X., Yi, W., Chi, H.-L., Wang, X., Chan, A.P.C., 2018. A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Automation in Construction 86, 150-162. https://doi.org/10.1016/j.autcon.2017.11.003 
  17. Someya, S., Shide, K., Kanisawa, H., Tan, Z.Y., Otsu, K., 2023. Research on the Relationship between Awareness and Heart Rate Changes in the Experience of Safety Education Materials Using VR Technology. Presented at the 40th ISARC, Chennai, India. https://doi.org/10.22260/ISARC2023/0046 
  18. Song, K., Lee, G., Han, S., Lee, S., 2022. Evaluation of Construction Workers' Emotional States during Virtual Reality-Based Safety Training, in: Construction Research Congress 2022. American Society of Civil Engineers, Arlington, Virginia, pp. 660-669. https://doi.org/10.1061/9780784483985.067
  19. Comu, S., Kazar, G., Marwa, Z., 2021. Evaluating the attitudes of different trainee groups towards eye tracking enhanced safety training methods. Advanced Engineering Informatics 49, 101353. https://doi.org/10.1016/j.aei.2021.101353 
  20. Huang, D., Wang, X., Liu, J., Li, J., Tang, W., 2022. Virtual reality safety training using deep EEG-net and physiology data. Vis Comput 38, 1195-1207. https://doi.org/10.1007/s00371-021-02140-3 
  21. Sakib, N., Chaspari, T., Ahn, C.R., Behzadan, A.H., n.d. An Experimental Study of Wearable Technology and Immersive Virtual Reality for Drone Operator Training. 
  22. Lee, K., Hasanzadeh, S., Esmaeili, B., 2022. Spatial Exposure to Dynamic Safety Hazards in Construction Sites through 360-Degree Augmented Panoramas: Ecological Validity in Safety Research, in: Construction Research Congress 2022. pp. 715-725. https://doi.org/10.1061/9780784483985.073 
  23. Xu, S., Ni, Q., Du, Q., 2019. The Effectiveness of Virtual Reality in Safety Training: Measurement of Emotional Arousal with Electromyography. https://doi.org/10.22260/ISARC2019/0003 
  24. Jeon, J., Cai, H., 2023. Wearable EEG-based construction hazard identification in virtual and real environments: A comparative study. Safety Science 165, 106213. https://doi.org/10.1016/j.ssci.2023.106213 
  25. Jeon, J., Cai, H., 2022b. A Framework for EEG-Based Ubiquitous Hazard Identification and Proactive Safety Management, in: Construction Research Congress 2022. Presented at the Construction Research Congress 2022, ASCE, Arlington, Virginia, pp. 145-153. https://doi.org/10.1061/9780784483961.016 
  26. Hamasaki, S., Sugimoto, M., Yajima, R., Yamashita, A., Nagatani, K., Asama, H., 2020. Investigation of Changes in Eye-Blink Rate by VR Experiment for Incident Detection at Construction Sites. Presented at the 37th International Symposium on Automation and Robotics in Construction, Kitakyushu, Japan. 
  27. Albeaino, G., Brophy, P., Jeelani, I., Gheisari, M., Issa, R.R.A., 2023a. Psychophysiological Impacts of Working at Different Distances from Drones on Construction Sites. J. Comput. Civ. Eng. 37, 04023026. https://doi.org/10.1061/JCCEE5.CPENG-5225 
  28. Albeaino, G., Brophy, P., Jeelani, I., Gheisari, M., Issa, R.R.A., 2023b. Impact of Drone Presence on Construction Individuals Working at Heights. J. Constr. Eng. Manage. 149, 04023119. https://doi.org/10.1061/JCEMD4.COENG-13861 
  29. Kim, N., Yan, N., Gregoire, L., Anderson, B.A., Ahn, C.R., 2023. Road Construction Workers' Boredom Susceptibility, Habituation to Warning Alarms, and Accident Proneness: Virtual Reality Experiment. J. Constr. Eng. Manage. 149, 04022175. https://doi.org/10.1061/JCEMD4.COENG-12818 
  30. Kim, N., Asce, S.M., Anderson, B.A., n.d.2021b Reducing Risk Habituation to Struck-By Hazards in a Road Construction Environment Using Virtual Reality Behavioral Intervention. J. Constr. Eng. Manage. 
  31. Pooladvand, S., Hasanzadeh, S., 2023. Impacts of Stress on Workers' Risk-Taking Behaviors: Cognitive Tunneling and Impaired Selective Attention. J. Constr. Eng. Manage. 149, 04023060. https://doi.org/10.1061/JCEMD4.COENG-13339 
  32. Qin, Y., Bulbul, T., 2023a. Electroencephalogram-based mental workload prediction for using Augmented Reality head mounted display in construction assembly: A deep learning approach. Automation in Construction 152, 104892. https://doi.org/10.1016/j.autcon.2023.104892 
  33. Qin, Y., Bulbul, T., 2023b. An EEG-Based Mental Workload Evaluation for AR Head-Mounted Display Use in Construction Assembly Tasks. J. Constr. Eng. Manage. 149, 04023088. https://doi.org/10.1061/JCEMD4.COENG-13438 
  34. Tehrani, B.M., Wang, J., Truax, D., 2022. Assessment of mental fatigue using electroencephalography (EEG) and virtual reality (VR) for construction fall hazard prevention. ECAM 29, 3593-3616. https://doi.org/10.1108/ECAM-01-2021-0017 
  35. Habibnezhad, M., Puckett, J., Fardhosseini, M.S., Jebelli, H., Stentz, T., Pratama, L.A., 2019. Experiencing extreme height for the first time: The influence of height, self-judgment of fear and a moving structural beam on the heart rate and postural sway during the quiet stance. ISARC 2019 
  36. Olatunbosun, S. and Min-Koo Kim.,2022. Measuring Construction Workers' Cognitive Status Using Physiological Signals: A Systematic Review. The 22nd International Conference on Construction Applications and Virtual Reality, Nov. 16-18, South Korea