Browse > Article
http://dx.doi.org/10.3837/tiis.2022.09.005

A Model for Machine Fault Diagnosis based on Mutual Exclusion Theory and Out-of-Distribution Detection  

Cui, Peng (School of Information Science and Engineer, Yanshan University)
Luo, Xuan (Industrial Technology Center, Hebei Petroleum University of Technology)
Liu, Jing (School of Information Science and Engineer, Yanshan University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.16, no.9, 2022 , pp. 2927-2941 More about this Journal
Abstract
The primary task of machine fault diagnosis is to judge whether the current state is normal or damaged, so it is a typical binary classification problem with mutual exclusion. Mutually exclusive events and out-of-domain detection have one thing in common: there are two types of data and no intersection. We proposed a fusion model method to improve the accuracy of machine fault diagnosis, which is based on the mutual exclusivity of events and the commonality of out-of-distribution detection, and finally generalized to all binary classification problems. It is reported that the performance of a convolutional neural network (CNN) will decrease as the recognition type increases, so the variational auto-encoder (VAE) is used as the primary model. Two VAE models are used to train the machine's normal and fault sound data. Two reconstruction probabilities will be obtained during the test. The smaller value is transformed into a correction value of another value according to the mutually exclusive characteristics. Finally, the classification result is obtained according to the fusion algorithm. Filtering normal data features from fault data features is proposed, which shields the interference and makes the fault features more prominent. We confirm that good performance improvements have been achieved in the machine fault detection data set, and the results are better than most mainstream models.
Keywords
out-of-distribution; convolutional neural network; mutually exclusive events; fusion networks; autoencoder;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Bradley, P., "The use of the area under the ROC curve in the evaluation of machine learning algorithms," Pattern Recognition, vol. 30, no. 7, pp. 1145-1159, 1997.   DOI
2 Logutov OG, Robinson AR., "Multi-model fusion and error parameter estimation," Q J Roy Meteorol Soc., 131, 3397-3408. 2005.   DOI
3 Liang, S., Li, Y., Srikant, R., "Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks," Machine Learning, arXiv:1706.02690, 2017.
4 Tang, S., Yuan, S., Zhu, Y., "Convolutional neural network in intelligent fault diagnosis toward rotatory machinery," IEEE Access, 8, 86510-86519, 2020.   DOI
5 Haidong, S., Ziyang, D., Junsheng, C., Hongkai, J., "Intelligent fault diagnosis among different rotating machines using novel stacked transfer auto-encoder optimized by PSO," ISA Trans., 105, 308-319, 2020.   DOI
6 Tajiki, M.M., Akbari, B., Shojafar, M. et al., "CECT: computationally efficient congestion-avoidance and traffic engineering in software-defined cloud data centers," Cluster Comput., 21, 1881-1897, 2018.   DOI
7 Tajiki M M, Shojafar M, Akbari B, et al., "Joint Failure Recovery, Fault Prevention, and Energy-efficient Resource Management for Real-time SFC in Fog-supported SDN," arXiv:1807.00324, 2018.
8 Hendrycks, D., Gimple, K., "A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks," arXiv:1610.02136, 2017.
9 Zhou, W., Chen, M., "Contrastive Out-of-Distribution Detection for Pretrained Transformers," arXiv:2104.08812, 2021.
10 Kingma, D. P., M. Welling, "Auto-Encoding Variational Bayes," arXiv:1312.6114, 2013.
11 Buda M., Maki A., Mazurowski, M.A., "A systematic study of the class imbalance problem in convolutional neural networks," Neural Netw, vol. 106, pp. 249-259, 2018.   DOI
12 A. Krizhevsky, I. Sutskever, G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Commun. ACM, vol. 60, no. 6, pp. 84-90, 2017.   DOI
13 Rifai, S., Vincent, P., Muller, X., Glorot, X., Bengio, Y., "Contractive auto-encoders: Explicit invariance during feature extraction," in Proc. of the 28th International Conference on Machine Learning (ICML 2011), pp. 833-840, 2011.
14 Zhang, J., Zhang, Y., Bai, L., Han, J., "Lossless-constraint denoising based auto-encoders," Signal Process., Image Commun., vol. 63, pp. 92-99, 2018.   DOI
15 Sheng C., Yang L., Xiang G., "MobileFaceNets: Efficient CNNs for Accurate Real-time Face Verification on Mobile Devices," in Proc. of CCBR 2018: Biometric Recognition, pp. 428-438, 2018.
16 T. Fawcett, "An introduction to roc analysis," Pattern Recogn. Lett., vol. 27, no. 8, pp. 861-874, 2006.   DOI
17 L. Wellhausen, R. Ranftl and M. Hutter, "Safe robot navigation via multi-modal anomaly detection," IEEE Robot, Automat. Lett., vol. 5, no. 2, pp. 1326-1333, Apr. 2020.   DOI
18 N. Fenton, M. Neil, D. Lagnado, W. Marsh, B. Yet, A. Constantinou, "How to model mutually exclusive events based on independent causal pathways in Bayesian network models," Knowledge-Based Syst, vol. 113, pp. 39-50, 2016.   DOI
19 Simonyan K, Zisserman A., "Very Deep Convolutional Networks for Large-Scale Image Recognition," arXiv:1409.1556, 2014.
20 K. He, X. Zhang, S. Ren and J. Sun, "Deep residual learning for image recognition," in Proc. of IEEE Conf. Comput. Vis. Pattern Recognit., pp. 770-778, 2016.
21 Cui, P., Wang, JJ., Li, XB., Li, CF., "Sub-Health Identification of Reciprocating Machinery Based on Sound Feature and OOD Detection," MACHINES, 2021, 9(8), 179, 2021.
22 He, K., Zhang, X., Ren, S., Sun, J., "Deep residual learning for image recognition," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, 2016.
23 Oord A., Dieleman S., Zen H., "WaveNet: A Generative Model for Raw Audio," arXiv:1609.03499, 2016.
24 Noda, K., Yamaguchi, Y., Nakadai, K., Okuno, H.G., Ogata, T., "Audio-visual speech recognition using deep learning," Appl. Intell., 42(4), pp. 722-737, 2015.   DOI