Browse > Article
http://dx.doi.org/10.7472/jksii.2019.20.1.77

Intelligent Abnormal Event Detection Algorithm for Single Households at Home via Daily Audio and Vision Patterns  

Jung, Juho (Computer Information Technology, Korea National University of Transportation)
Ahn, Junho (Computer Information Technology, Korea National University of Transportation)
Publication Information
Journal of Internet Computing and Services / v.20, no.1, 2019 , pp. 77-86 More about this Journal
Abstract
As the number of single-person households increases, it is not easy to ask for help alone if a single-person household is severely injured in the home. This paper detects abnormal event when members of a single household in the home are seriously injured. It proposes an vision detection algorithm that analyzes and recognizes patterns through videos that are collected based on home CCTV. And proposes audio detection algorithms that analyze and recognize patterns of sound that occur in households based on Smartphones. If only each algorithm is used, shortcomings exist and it is difficult to detect situations such as serious injuries in a wide area. So I propose a fusion method that effectively combines the two algorithms. The performance of the detection algorithm and the precise detection performance of the proposed fusion method were evaluated, respectively.
Keywords
Vision; Image Processing; Audio; Fusion; Pattern; Single Households; Daily behavior;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 The Korea Times, "Sensor to be installed to prevent lonely death", http://www.koreatimes.co.kr/www/biz/2018/01/602_243308.html, 2018.
2 MBC News, "If you don't move, I'll warn you. Internet of Things to Prevent Solitude", http://imnews.imbc.com/replay/2018/nwdesk/article/4586838_22663.html, 2018
3 Glen Debard, Marc Mertens, Toon Goedeme, Tinne Tuytelaars and Bart Vanrumst, "Three Ways to Improve the Performance of Real-Life Camera-Based Fall Detection Systems", Journal of Sensors (2017) https://doi.org/10.1155/2017/8241910   DOI
4 Miao Yu, Liyun Gong, Stefanos Kollias, "Computer vision based fall detection by a convolutional neural network", ACM (2017) https://doi.org/10.1145/3136755.3136802   DOI
5 Koldo de Miguel, Alberto Brunete, Miguel Hernando and Ernesto Gambao, "Home Camera-Based Fall Detection System for the Elderly", Multidisciplinary Digital Publishing Institute (MDPI), Sensors, 21. (2017) https://doi.org/10.3390/s17122864   DOI
6 Fouzi Harroua , Nabil Zerroukib , Ying Suna , Amrane Houacineb, "Vision-based fall detection system for improving safety of elderly people", IEEE Instrumentation and Measurement Society, 21, (2017) https://doi.org/10.1109/MIM.2017.8121952   DOI
7 Philip Geismann. Georg Schneider, "A Two-staged Approach to Vision-based Pedestrian Recognition Using Haar and HOG Features", IEEE,6 (2008) https://doi.org/10.1109/IVS.2008.4621148   DOI
8 Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z, Song Y, Guadarrama S, Murphy K, "Speed/accuracy trade-offs for modern convolutional object detectors", CVPR 2017, https://github.com/tensorflow/models/tree/master/research/object_detection
9 Inter Press Service News Agency, "The Rise of One-Person Households", http://www.Ipsnews.net/2017/02/the-rise-of-one-personhouseholds, 2018.
10 Ibrahim Furkan Ince, Mustafa Eren Yildirim, Yucel Batu Salman, Omer Faruk Ince, Geun-Hoo Lee and Jang-Sik Park, "Fast Video Fire Detection Using Luminous Smoke and Textured Flame Features," KSII Transactions on Internet and Information Systems, vol. 10, no. 12, pp. 6048-6069, 2016. DOI: https://doi.org/10.3837/tiis.2016.12.019   DOI
11 JuHo Jung, HwiJune Park, JunHo Ahn, "Unusual Event Detection Algorithm via Personalized Video and Voice Patterns for Preventing Solitary Death", Proceedings of the 37th KSII Spring Conference, v.19 n.1, pp.7-8, 2018
12 L. Vuegen B. Van Den Broeck P. Karsmakers J. F. Gemmeke B. Vanrumste H. Van hamme, "an mfcc-gmm approach for event detection and classification",IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events, pp.1-3 2013, https://www.semanticscholar.org/paper/An-Mfcc-gmm-Approach-for-Event-Detection-and-Vuegen-Broeck/bf4d54fc69e19aee82d87231c45bf5786e19bffd
13 Minkyu Lim, Donghyun Lee, Hosung Park, Yoseb Kang, Junseok Oh, Jeong-Sik Park, Gil-Jin Jang and Ji-Hwan Kim, "Convolutional Neural Network based Audio Event Classification," KSII Transactions on Internet and Information Systems, vol. 12, no. 6, pp. 2748-2760, 2018. DOI: https://doi.org/10.3837/tiis.2018.06.01   DOI
14 Junho Ahn, Richard Han, "myBlackBox: Blackbox Mobile Cloud Systems for Personalized Unusual Event Detection", Sensors, 2016, Volume 16, Issue 5, 753; doi: https://doi.org/10.3390/s16050753, 20 pages.   DOI