Browse > Article
http://dx.doi.org/10.9708/jksci.2022.27.06.023

Anomaly Event Detection Algorithm of Single-person Households Fusing Vision, Activity, and LiDAR Sensors  

Lee, Do-Hyeon (Dept of Software, Korea National University of Transportation)
Ahn, Jun-Ho (Dept of Software, Korea National University of Transportation)
Abstract
Due to the recent outbreak of COVID-19 and an aging population and an increase in single-person households, the amount of time that household members spend doing various activities at home has increased significantly. In this study, we propose an algorithm for detecting anomalies in members of single-person households, including the elderly, based on the results of human movement and fall detection using an image sensor algorithm through home CCTV, an activity sensor algorithm using an acceleration sensor built into a smartphone, and a 2D LiDAR sensor-based LiDAR sensor algorithm. However, each single sensor-based algorithm has a disadvantage in that it is difficult to detect anomalies in a specific situation due to the limitations of the sensor. Accordingly, rather than using only a single sensor-based algorithm, we developed a fusion method that combines each algorithm to detect anomalies in various situations. We evaluated the performance of algorithms through the data collected by each sensor, and show that even in situations where only one algorithm cannot be used to detect accurate anomaly event through certain scenarios we can complement each other to efficiently detect accurate anomaly event.
Keywords
Vision; Activity; 2D LiDAR; Sensor Fusion; Anomaly Event Detection;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 NBN News, "Gumi City Prevents Solitary Deaths of Single-person Households by Installing Smart Plugs," http://www.nbnnews.co.kr/news/articleView.html?idxno=667523
2 I. N. Figueiredo, C. Leal, L. Pinto, J. Bolito and A. Lemos, "Exploring smartphone sensors for fall detection," mUX: the journal of mobile user experience, Vol. 5, No. 1, pp. 1-17, 2016. DOI: https://doi.org/10.1186/s13678-016-0004-1   DOI
3 D. H. Kim and J. H. Ahn, "Intelligent Abnormal Situation Event Detections for Smart Home Users Using Lidar, Vision, and Audio Sensors," Journal of Internet Computing and Services, Vol. 22, No. 3, pp. 17-26, 2021. DOI: https://doi.org/10.7472/jksii.2021.22.3.17   DOI
4 K. De Miguel, A. Brunete, M. Hernando and E. Gambao, "Home camera-based fall detection system for the elderly," Sensors, Vol. 17, No. 12: 2864, 2017. DOI: https://doi.org/10.3390/s17122864   DOI
5 NARS, "Problems and Improvement Tasks of Funeral for the Unrelated Death," https://www.nars.go.kr/report/view.do?cmsCode=CM0018&brdSeq=36212
6 KCCI, "Perspectives of "A survey on changes in consumption behavior and implications in the COVID-19 era," http://www.korcham.net/nCham/Service/Economy/appl/KcciReportDetail.asp?SEQ_NO_C010=20120933952&CHAM_CD=B001
7 KOSTAT, "2020 Population and Housing Census," https://kostat.go.kr/portal/korea/kor_nw/1/2/2/index.board?bmode=read&aSeq=391020&pageNo=&rowNum=10&amSeq=&sTarget=&sTxt
8 MOIS, "Resident registration demographics," https://jumin.mois.go.kr/
9 KBS, "A dog that protected the death of an elderly person living alone in Brazil. Shade of "Lonely Death" in Korea," https://news.kbs.co.kr/news/view.do?ncd=5314741
10 X. Wang, and K. Jia, "Human fall detection algorithm based on YOLOv3," IEEE 5th International Conference on Image, Vision and Computing (ICIVC), pp. 50-54, 2020. DOI: https://doi.org/10.1109/ICIVC50857.2020.9177447   DOI
11 J. H. Jung, D. H. Lee, S. S. Kim and J. H. Ahn, "Deep Learning-Based User Emergency Event Detection Algorithms Fusing Vision, Audio, Activity and Dust Sensors," Journal of Internet Computing and Services, Vol. 21, No. 5, pp. 109-118, 2020. DOI: https://doi.org/10.7472/jksii.2020.21.5.109   DOI
12 A. Bochkovskiy, C. Y. Wang and H. Y. M. Liao, "Yolov4: Optimal speed and accuracy of object detection," arXiv preprint arXiv:2004.10934, 2020. DOI: https://doi.org/10.48550/arXiv.2004.10934
13 J. S. Lee, and H. H. Tseng, "Development of an enhanced threshold-based fall detection system using smartphones with built-in accelerometers," IEEE Sensors Journal, Vol. 19, No. 18, pp. 8293-8302, 2019. DOI: https://doi.org/10.1109/JSEN.2019.2918690   DOI
14 P. Van Thanh, D. T. Tran, D. C. Nguyen, N. Duc Anh, D. Nhu Dinh, S. El-Rabaie and K. Sandrasegaran, "Development of a real-time, simple and high-accuracy fall detection system for elderly using 3-DOF accelerometers," Arabian Journal for Science and Engineering, Vol. 44, No. 4, pp. 3329-3342, 2019. DOI: https://doi.org/10.1007/s13369-018-3496-4   DOI
15 H. Miawarni, T. A. Sardjono, E. Setijadi, D. Arraziqi, A. B. Gumelar and M. H. Purnomo, "Fall detection system for elderly based on 2d lidar: a preliminary study of fall incident and activities of daily living (ADL) detection," 2020 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM), pp. 1-5, 2020. DOI: https://doi.org/10.1109/CENIM51130.2020.9298000   DOI
16 F. Luo, S. Poslad and E. Bodanese, "Temporal convolutional networks for multiperson activity recognition using a 2-d lidar," IEEE Internet of Things Journal, Vol. 7, No. 8, pp. 7432-7442, 2020. DOI: https://doi.org/10.1109/JIOT.2020.2984544   DOI
17 Seoul 50 Plus Foundation, "A Study on the Solitary Death of Middle-aged People by Analysis of Single-person Household Cahracteristics", https://50plus.or.kr/org/detail.do?id=15001507
18 KCA, "A press release for analyzing trends in safety accidents for the elderly," https://www.kca.go.kr/smartconsumer/sub.do?menukey=7301&mode=view&no=1002931735&page=6