Browse > Article

Study on Anomaly Detection Method of Improper Foods using Import Food Big data  

Cho, Sanggoo (식품안전정보원)
Choi, Gyunghyun (한양대학교 기술경영대학원)
Publication Information
The Journal of Bigdata / v.3, no.2, 2018 , pp. 19-33 More about this Journal
Abstract
Owing to the increase of FTA, food trade, and versatile preferences of consumers, food import has increased at tremendous rate every year. While the inspection check of imported food accounts for about 20% of the total food import, the budget and manpower necessary for the government's import inspection control is reaching its limit. The sudden import food accidents can cause enormous social and economic losses. Therefore, predictive system to forecast the compliance of food import with its preemptive measures will greatly improve the efficiency and effectiveness of import safety control management. There has already been a huge data accumulated from the past. The processed foods account for 75% of the total food import in the import food sector. The analysis of big data and the application of analytical techniques are also used to extract meaningful information from a large amount of data. Unfortunately, not many studies have been done regarding analyzing the import food and its implication with understanding the big data of food import. In this context, this study applied a variety of classification algorithms in the field of machine learning and suggested a data preprocessing method through the generation of new derivative variables to improve the accuracy of the model. In addition, the present study compared the performance of the predictive classification algorithms with the general base classifier. The Gaussian Naïve Bayes prediction model among various base classifiers showed the best performance to detect and predict the nonconformity of imported food. In the future, it is expected that the application of the abnormality detection model using the Gaussian Naïve Bayes. The predictive model will reduce the burdens of the inspection of import food and increase the non-conformity rate, which will have a great effect on the efficiency of the food import safety control and the speed of import customs clearance.
Keywords
Import food; Gaussian Naive Bayes classifier; Predictive system;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Allen, Bradley P., "Case-Based Reasoning: Business Applications", Communications of the ACM, Vol.37, No.3(1994), 40-42.   DOI
2 Barandela, R., V. Garcia, E. Rangel, and J. S. Sanchez, "Strategies for Learning in Class Imbalance Problems", Pattern Recognition, Vol.36, No.3(2003), 849-865.   DOI
3 Beaver, William H., "Financial Ratios as Predictors of Failure", Journal of Accounting Research, Vol.4, No.3(1996), 71-111.
4 Cao, Fuyuan, Jiye Liang, Deyu Li, and Xingwang Zhao, "A Weighting K-Modes Algorithm for Subspace Clustering of Categorical Data", Neurocomputing. Vol.108(2013) 23-30.   DOI
5 Chang, D.S. and S.H. Lee, "A Study on the Us's Safety Control System for the Imported Food: Focused on the Processed Food", The Journal of International Commerce, Vol.31, No.4(2016), 325-50.
6 Derrac, Joaquín, Chris Cornelis, Salvador García, and Francisco Herrera, "Enhancing Evolutionary Instance Selection Algorithms by Means of Fuzzy Rough Set Based Feature Selection", Information Sciences. Vol.186, No.1(2012), 73-92.   DOI
7 Fawcett, Tom, "An Introduction to Roc Analysis", PATTERN RECOGNITION LETTERS, Vol.27, No.8(2006), 861-74.   DOI
8 Galar, M., A. Fernandez, E. Barrenechea, H. Bustince, and F. Herrera, "A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches", IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), Vol.42, No.4(2012), 463-84.   DOI
9 Ganganwar, Vaishali, "An Overview of Classification Algorithms for Imbalanced Datasets", International Journal of Emerging Technology and Advanced Engineering, Vol.2, No.4(2012), 42-47.
10 Garcia, V., A. I. Marques, and J. S. Sanchez, "On the Use of Data Filtering Techniques for Credit Risk Prediction with Instance-Based Models", Expert Systems With Applications, Vol.39, No.18(2012), 267-76.
11 Jin, Huang, and C. X. Ling, "Using Auc and Accuracy in Evaluating Learning Algorithms", IEEE Transactions on Knowledge and Data Engineering, Knowledge and Data Engineering, IEEE Transactions on, IEEE Trans. Knowl. Data Eng,Vol. 17, No.3(2005), 299-310.
12 Jo, Taeho, and Nathalie Japkowicz, "Class Imbalances Versus Small Disjuncts", SIGKDD Explor. Newsl, Vol. 6, No.1(2004), 40-49.   DOI
13 Kang, P.S., H.J. Lee and S.Z. Cho, " Svm Ensemble Techniques for Class Imbalance Problem", KOREA INFORMATION SCIENCE SOCIETY, Vol.31, No.2(2004), 706-708.
14 Kim, U.M. and T.H. Hong, "The Prediction of Customers based on Case Based Reasoning with Weighted Factors for imbalanced Data Sets", The Journal of Information Systems, Vo1.21, No.1(2014), 29-45.
15 Min, S.H., "Bankruptcy prediction using the improved bagging ensemble algorithm", Journal of Intelligence and Information Systems. Vol.20, No.4(2014), 121-139.   DOI
16 Koufakou, Anna, and Michael Georgiopoulos, "A Fast Outlier Detection Strategy for Distributed High-Dimensional Data Sets with Mixed Attributes", DATA MINING AND KNOWLEDGE DISCOVERY, Vol.20, No.2(2010) 259-89.   DOI
17 Lee, J.S. and J.G. Kwon, "A Hybrid Svm Classifier for Imbalanced Data Sets", Journal of Intelligence and Information Systems. Vol.19, No.2(2013), 125-40.   DOI
18 Mac Namee, B., P. Cunningham, S. Byrne, and O. I. Corrigan, "The Problem of Bias in Training Data in Regression Problems in Medical Decision Support", ARTIFICIAL INTELLIGENCE IN MEDICINE, Vol.24, No.1(2002), 51-70.   DOI
19 Ohlson, James A., "Financial Ratios and the Probabilistic Prediction of Bankruptcy", Journal of Accounting Research, Vol.18, No.1(1980), 109-31.   DOI
20 Otey, M. E., A. Ghoting, and S. Parthasarathy, "Fast Distributed Outlier Detection in Mixed-Attribute Data Sets", DATA MINING AND KNOWLEDGE DISCOVERY, Vol.12, No.2-3 (2006), 203-28.   DOI
21 Pai, Hao-Ting, Fan Wu, and Pei-Yun S. Hsueh, "A Relative Patterns Discovery for Enhancing Outlier Detection in Categorical Data", DECISION SUPPORT SYSTEMS, Vol.67(2014), 90-99.   DOI
22 Park, M. S., H. N. Kim, and G. J. Bahk, "The Analysis of Food Safety Incidents in South Korea, 1998-2016", Food Control, Vol.81(2017), 196-199.   DOI
23 Said, A. M., D. D. Dominic, and B. B. Samir, "Frequent Pattern-Based Outlier Detection Measurements: A Survey", International Conference on Research and Innovation in Information Systems (ICRIIS), 2011
24 Zhao, Xingwang, Jiye Liang, and Fuyuan Cao, "A Simple and Effective Outlier Detection Algorithm for Categorical Data", INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, Vol.5, No.3(2014), 469-77.   DOI
25 Thompson, Christopher Glen, Rae Seon Kim, Ariel M. Aloe, and Betsy Jane Becker, "Extracting the Variance in Flation Factor and Other Multicollinearity Diagnostics from Typical Regression Results", Basic & Applied Social Psychology, Vol.39, No.2(2017), 81-90.   DOI
26 Wu, X., V. Kumar, M. Steinbach, Q. J. Ross, J. Ghosh, Q. Yang, H. Motoda, G. J. McLachlan, A. Ng, B. Liu, P. S. Yu, Z. H. Zhou, D. J. Hand, and D. Steinberg, "Top 10 Algorithms in Data Mining", Knowledge and Information Systems, Vol.14, No.1(2008), 1-37.   DOI