Browse > Article
http://dx.doi.org/10.3745/JIPS.04.0235

A Novel Framework Based on CNN-LSTM Neural Network for Prediction of Missing Values in Electricity Consumption Time-Series Datasets  

Hussain, Syed Nazir (Faculty of Engineering and Technology, Multimedia University)
Aziz, Azlan Abd (Faculty of Engineering and Technology, Multimedia University)
Hossen, Md. Jakir (Faculty of Engineering and Technology, Multimedia University)
Aziz, Nor Azlina Ab (Faculty of Engineering and Technology, Multimedia University)
Murthy, G. Ramana (Dept. of Electronic and Computer Engineering, Vignan's Foundation)
Mustakim, Fajaruddin Bin (Universiti Tun Hussein Onn Malaysia (UTHM))
Publication Information
Journal of Information Processing Systems / v.18, no.1, 2022 , pp. 115-129 More about this Journal
Abstract
Adopting Internet of Things (IoT)-based technologies in smart homes helps users analyze home appliances electricity consumption for better overall cost monitoring. The IoT application like smart home system (SHS) could suffer from large missing values gaps due to several factors such as security attacks, sensor faults, or connection errors. In this paper, a novel framework has been proposed to predict large gaps of missing values from the SHS home appliances electricity consumption time-series datasets. The framework follows a series of steps to detect, predict and reconstruct the input time-series datasets of missing values. A hybrid convolutional neural network-long short term memory (CNN-LSTM) neural network used to forecast large missing values gaps. A comparative experiment has been conducted to evaluate the performance of hybrid CNN-LSTM with its single variant CNN and LSTM in forecasting missing values. The experimental results indicate a performance superiority of the CNN-LSTM model over the single CNN and LSTM neural networks.
Keywords
CNN-LSTM Neural Network; Electricity Consumption Prediction; Large Gaps of Missing Values; Prediction of Missing Values in Time-Series Data; Smart Home System;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 D. Sovilj, E. Eirola, Y. Miche, K. M. Bjork, R. Nian, A. Akusok, and A. Lendasse, "Extreme learning machine for missing data using multiple imputations," Neurocomputing, vol. 174, pp. 220-231, 2016.   DOI
2 X. Xu, W. Chong, S. Li, A. Arabo, and J. Xiao, "MIAEC: missing data imputation based on the evidence chain," IEEE Access, vol. 6, pp. 12983-12992, 2018.   DOI
3 A. Chaudhry, W. Li, A. Basri, and F. Patenaude, "A method for improving imputation and prediction accuracy of highly seasonal univariate data with large periods of missingness," Wireless Communications and Mobile Computing, vol. 2019, article no. 4039758, 2019. https://doi.org/10.1155/2019/4039758   DOI
4 K. Zor, O. Celik, O. Timur, H. B. Yildirim, and A. Teke, "Simple approaches to missing data for energy forecasting applications," in Proceedings of the 16th International Conference on Clean Energy (ICCE), Gazimagusa, Turkey, 2018.
5 X. Shao, C. S. Kim, and P. Sontakke, "Accurate deep model for electricity consumption forecasting using multi-channel and multi-scale feature fusion CNN-LSTM," Energies, vol. 13, no. 8, article no. 1881, 2020. https://doi.org/10.3390/en13081881   DOI
6 Z. Ding, G. Mei, S. Cuomo, Y. Li, and N. Xu, "Comparison of estimating missing values in IoT time series data using different interpolation algorithms," International Journal of Parallel Programming, vol. 48, pp. 534-548, 2020.   DOI
7 T. A. Mohamed, N. El Gayar, and A. F. Atiya, "Forward and backward forecasting ensembles for the estimation of time series missing data," in ANNPR 2014: Artificial Neural Networks in Pattern Recognition. Cham, Switzerland: Springer, 2014, pp. 93-104.
8 X. Cao, S. Dong, Z. Wu, and Y. Jing, "A data-driven hybrid optimization model for short-term residential load forecasting," in Proceedings of 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing, Liverpool, UK, 2015, pp. 283-287.
9 S. Sridevi, S. Rajaram, C. Parthiban, S. SibiArasan, and C. Swadhikar, "Imputation for the analysis of missing values and prediction of time series data," in Proceedings of 2011 International Conference on Recent Trends in Information Technology (ICRTIT), Chennai, India, 2011, pp. 1158-1163.
10 N. Bokde, M. W. Beck, F. M. Alvarez, and K. Kulat, "A novel imputation methodology for time series based on pattern sequence forecasting," Pattern Recognition Letters, vol. 116, pp. 88-96, 2018.   DOI
11 T. Kim, W. Ko, and J. Kim, "Analysis and impact evaluation of missing data imputation in day-ahead PV generation forecasting," Applied Sciences, vol. 9, no. 1, article no. 204, 2019. https://doi.org/10.3390/app9010204   DOI
12 N. Al-Milli and W. Almobaideen, "Hybrid neural network to impute missing data for IoT applications," in Proceedings of 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT), Amman, Jordan, 2019, pp. 121-125.
13 T. Y. Kim and S. B. Cho, "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, vol. 182, pp. 72-81, 2019.   DOI
14 J. Du Preez and S. F. Witt, "Univariate versus multivariate time series forecasting: an application to international tourism demand," International Journal of Forecasting, vol. 19, no. 3, pp. 435-451, 2003.   DOI
15 M. A. Rahman and A. T. Asyhari, "The emergence of Internet of Things (IoT): connecting anything, anywhere," vol. 8, no. 2, article no. 40, 2019. https://doi.org/10.3390/computers8020040   DOI
16 K. Yan, X. Wang, Y. Du, N. Jin, H. Huang, and H. Zhou, "Multi-step short-term power consumption forecasting with a hybrid deep learning strategy," Energies, vol. 11, no. 11, article no. 3089, 2018. https://doi.org/10.3390/en11113089   DOI
17 M. Li, M. Soltanolkotabi, and S. Oymak, "Gradient descent with early stopping is provably robust to label noise for overparameterized neural networks," 2019 [Online]. Available: https://arxiv.org/abs/1903.11680.
18 C. Nichiforov, I. Stamatescu, I. Fagarasan, and G. Stamatescu, "Energy consumption forecasting using ARIMA and neural network models," in Proceedings of 2017 5th International Symposium on Electrical and Electronics Engineering (ISEEE), Galati, Romania, 2017, pp. 1-4.
19 M. Massaoudi, S. S. Refaat, I. Chihi, M. Trabelsi, H. Abu-Rub, and F. S. Oueslati, "Short-term electric load forecasting based on data-driven deep learning techniques," in Proceedings of the 46th Annual Conference of the IEEE Industrial Electronics Society (IECON), Singapore, 2020, pp. 2565-2570.
20 F. Kaytez, M. C. Taplamacioglu, E. Cam, and F. Hardalac, "Forecasting electricity consumption: a comparison of regression analysis, neural networks and least squares support vector machines," International Journal of Electrical Power & Energy Systems, vol. 67, pp. 431-438, 2015.   DOI
21 H. Kang, "The prevention and handling of the missing data," Korean Journal of Anesthesiology, vol. 64, no. 5, pp. 402-406, 2013.   DOI
22 P. E. Bunney, A. N. Zink, A. A. Holm, C. J. Billington, and C. M. Kotz, "Orexin activation counteracts decreases in nonexercise activity thermogenesis (NEAT) caused by high-fat diet," Physiology & Behavior, vol. 176, pp. 139-148, 2017.   DOI
23 T. Banerjee and A. Sheth, "IoT quality control for data and application needs," IEEE Intelligent Systems, vol. 32, no. 2, pp. 68-73, 2017.   DOI
24 E. P. Caillault, A. Lefebvre, and A. Bigand, "Dynamic time warping-based imputation for univariate time series data," Pattern Recognition Letters, vol. 139, pp. 139-147, 2020.   DOI
25 J. Poulos and R. Valle, "Missing data imputation for supervised learning," Applied Artificial Intelligence, vol. 32, no. 2, pp. 186-196, 2018.   DOI
26 I. Lana, I. I. Olabarrieta, M. Velez, and J. Del Ser, "On the imputation of missing data for road traffic forecasting: new insights and novel techniques," Transportation Research Part C: Emerging Technologies, vol. 90, pp. 18-33, 2018.   DOI
27 S. F. Wu, C. Y. Chang, and S. J. Lee, "Time series forecasting with missing values," in Proceedings of 2015 1st International Conference on Industrial Networks and Intelligent Systems (INISCom), Tokyo, Japan, 2015, pp. 151-156.
28 A. S. Dhevi, "Imputing missing values using inverse distance weighted interpolation for time series data," in Proceedings of 2014 6th International Conference on Advanced Computing (ICoAC), Chennai, India, 2014, pp. 255-259.
29 N. H. Motlagh, M. Mohammadrezaei, J. Hunt, and B. Zakeri, "Internet of Things (IoT) and the energy sector," Energies, vol. 13, no. 2, article no. 494, 2020. https://doi.org/10.3390/en13020494   DOI
30 C. Paul, A. Ganesh, and C. Sunitha, "An overview of IoT based smart homes," in Proceedings of 2018 2nd International Conference on Inventive Systems and Control (ICISC), Coimbatore, India, 2018, pp. 43-46.
31 A. N. Baraldi and C. K. Enders, "An introduction to modern missing data analyses," Journal of School Psychology, vol. 48, no. 1, pp. 5-37, 2010.   DOI