Browse > Article
http://dx.doi.org/10.3745/JIPS.04.0211

Industrial Process Monitoring and Fault Diagnosis Based on Temporal Attention Augmented Deep Network  

Mu, Ke (Dept. of Information and Control Engineering, Liaoning Shihua University)
Luo, Lin (Dept. of Information and Control Engineering, Liaoning Shihua University)
Wang, Qiao (Dept. of Information and Control Engineering, Liaoning Shihua University)
Mao, Fushun (Synthetic Detergent Factory of Fushun Petrochemical Company, China National Petroleum Corporation)
Publication Information
Journal of Information Processing Systems / v.17, no.2, 2021 , pp. 242-252 More about this Journal
Abstract
Following the intuition that the local information in time instances is hardly incorporated into the posterior sequence in long short-term memory (LSTM), this paper proposes an attention augmented mechanism for fault diagnosis of the complex chemical process data. Unlike conventional fault diagnosis and classification methods, an attention mechanism layer architecture is introduced to detect and focus on local temporal information. The augmented deep network results preserve each local instance's importance and contribution and allow the interpretable feature representation and classification simultaneously. The comprehensive comparative analyses demonstrate that the developed model has a high-quality fault classification rate of 95.49%, on average. The results are comparable to those obtained using various other techniques for the Tennessee Eastman benchmark process.
Keywords
Deep Learning; Online Fault Classification; Recurrent Neural Networks; Temporal Attention Mechanism;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Q. Jiang, X. Yan, and B. Huang, "Review and perspectives of data-driven distributed monitoring for industrial plant-wide processes," Industrial & Engineering Chemistry Research, vol. 58, no. 29, pp. 12899-12912, 2019.   DOI
2 L. Luo, L. Xie, U. Kruger, K. Alzebdeh, and H. Su, "A novel Bayesian robust model and its application for fault detection and automatic supervision of nonlinear process," Industrial & Engineering Chemistry Research, vol. 54, no. 18, pp. 5048-5061, 2015.   DOI
3 J. C. Kabugo, S. L. Jamsa-Jounela, R. Schiemann, and C. Binder, "Industry 4.0 based process data analytics platform: a waste-to-energy plant case study," International Journal of Electrical Power & Energy Systems, vol. 115, article no. 105508, 2020. https://doi.org/10.1016/j.ijepes.2019.105508   DOI
4 Q. Jiang and X. Yan, "Learning deep correlated representations for nonlinear process monitoring," IEEE Transactions on Industrial Informatics, vol. 15, no. 12, pp. 6200-6209, 2018.   DOI
5 Z. Zhang and J. Zhao, "A deep belief network based fault diagnosis model for complex chemical processes," Computers & Chemical Engineering, viol. 107, pp. 395-407, 2017.   DOI
6 Y. Wang, Z. Pan, X. Yuan, C. Yang, and W. Gui, "A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network," ISA Transactions, vol. 96, pp. 457-467, 2020.   DOI
7 S. Heo and J. H. Lee, "Fault detection and classification using artificial neural networks," IFACPapersOnLine, vol. 51, no. 18, 470-475, 2018.
8 R. Eslamloueyan, "Designing a hierarchical neural network based on fuzzy clustering for fault diagnosis of the Tennessee-Eastman process," Applied Soft Computing, vol. 11, no. 1, pp. 1407-1415, 2011.   DOI
9 F. A. P. Peres and F. S. Fogliatto, "Variable selection methods in multivariate statistical process control: a systematic literature review," Computers & Industrial Engineering, vol. 115, pp. 603-619, 2018.   DOI
10 H. Lahdhiri, M. Said, K. B. Abdellafou, O. Taouali, and M. F. Harkat, "Supervised process monitoring and fault diagnosis based on machine learning methods," The International Journal of Advanced Manufacturing Technology, vol. 102, no. 5, pp. 2321-2337, 2019.   DOI
11 S. J. Qin and L. H. Chiang, "Advances and opportunities in machine learning for process data analytics," Computers & Chemical Engineering, vol. 126, pp. 465-473, 2019.   DOI
12 X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks," in Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, Sardinia, Italy, 2010, pp. 249-256.
13 L. Luo, L. Xie, and H. Su, "Deep learning with tensor factorization layers for sequential fault diagnosis and industrial process monitoring," IEEE Access, vol. 8, pp. 105494-105506, 2020.   DOI
14 M. Aamir, Y. F. Pu, Z. Rahman, W. A. Abro, H. Naeem, F. Ullah, and A. M. Badr, "A hybrid proposed framework for object detection and classification," Journal of Information Processing Systems, vol. 14, no. 5, pp. 1176-1194, 2018.   DOI
15 A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, "Attention is all you need," Advances in Neural Information Processing Systems, vol. 30, pp. 5998-6008, 2017.
16 H. Zhao, S. Sun, and B. Jin, "Sequential fault diagnosis based on LSTM neural network," IEEE Access, vol. 6, pp. 12929-12939, 2018.   DOI
17 I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA: MIT Press, 2016.
18 F. Lv, C. Wen, Z. Bao, and M. Liu, "Fault diagnosis based on deep learning," in Proceedings of 2016 American Control Conference (ACC), Boston, MA, 2016, pp. 6851-6856.
19 A. Bathelt, N. L. Ricker, and M. Jelali, "Revision of the Tennessee Eastman process model," IFACPapersOnLine, vol. 48, no. 8, pp. 309-314, 2015.