A Study of Anomaly Detection for ICT Infrastructure using Conditional Multimodal Autoencoder (ICT 인프라 이상탐지를 위한 조건부 멀티모달 오토인코더에 관한 연구)
-
- Journal of Intelligence and Information Systems
- /
- v.27 no.3
- /
- pp.57-73
- /
- 2021
Maintenance and prevention of failure through anomaly detection of ICT infrastructure is becoming important. System monitoring data is multidimensional time series data. When we deal with multidimensional time series data, we have difficulty in considering both characteristics of multidimensional data and characteristics of time series data. When dealing with multidimensional data, correlation between variables should be considered. Existing methods such as probability and linear base, distance base, etc. are degraded due to limitations called the curse of dimensions. In addition, time series data is preprocessed by applying sliding window technique and time series decomposition for self-correlation analysis. These techniques are the cause of increasing the dimension of data, so it is necessary to supplement them. The anomaly detection field is an old research field, and statistical methods and regression analysis were used in the early days. Currently, there are active studies to apply machine learning and artificial neural network technology to this field. Statistically based methods are difficult to apply when data is non-homogeneous, and do not detect local outliers well. The regression analysis method compares the predictive value and the actual value after learning the regression formula based on the parametric statistics and it detects abnormality. Anomaly detection using regression analysis has the disadvantage that the performance is lowered when the model is not solid and the noise or outliers of the data are included. There is a restriction that learning data with noise or outliers should be used. The autoencoder using artificial neural networks is learned to output as similar as possible to input data. It has many advantages compared to existing probability and linear model, cluster analysis, and map learning. It can be applied to data that does not satisfy probability distribution or linear assumption. In addition, it is possible to learn non-mapping without label data for teaching. However, there is a limitation of local outlier identification of multidimensional data in anomaly detection, and there is a problem that the dimension of data is greatly increased due to the characteristics of time series data. In this study, we propose a CMAE (Conditional Multimodal Autoencoder) that enhances the performance of anomaly detection by considering local outliers and time series characteristics. First, we applied Multimodal Autoencoder (MAE) to improve the limitations of local outlier identification of multidimensional data. Multimodals are commonly used to learn different types of inputs, such as voice and image. The different modal shares the bottleneck effect of Autoencoder and it learns correlation. In addition, CAE (Conditional Autoencoder) was used to learn the characteristics of time series data effectively without increasing the dimension of data. In general, conditional input mainly uses category variables, but in this study, time was used as a condition to learn periodicity. The CMAE model proposed in this paper was verified by comparing with the Unimodal Autoencoder (UAE) and Multi-modal Autoencoder (MAE). The restoration performance of Autoencoder for 41 variables was confirmed in the proposed model and the comparison model. The restoration performance is different by variables, and the restoration is normally well operated because the loss value is small for Memory, Disk, and Network modals in all three Autoencoder models. The process modal did not show a significant difference in all three models, and the CPU modal showed excellent performance in CMAE. ROC curve was prepared for the evaluation of anomaly detection performance in the proposed model and the comparison model, and AUC, accuracy, precision, recall, and F1-score were compared. In all indicators, the performance was shown in the order of CMAE, MAE, and AE. Especially, the reproduction rate was 0.9828 for CMAE, which can be confirmed to detect almost most of the abnormalities. The accuracy of the model was also improved and 87.12%, and the F1-score was 0.8883, which is considered to be suitable for anomaly detection. In practical aspect, the proposed model has an additional advantage in addition to performance improvement. The use of techniques such as time series decomposition and sliding windows has the disadvantage of managing unnecessary procedures; and their dimensional increase can cause a decrease in the computational speed in inference.The proposed model has characteristics that are easy to apply to practical tasks such as inference speed and model management.
To provide better health care services to the rural population, the government has made the Community Health Practitioner(CHP) a regular government official from April 1, 1992. This study was carried out to study the impact of officialization of CHP on the activities and management system of Primary Health Post(PHP). Fifty PHPs were selected by two stage sampling, cluster and simple random, from 595 PHPs in Kyungnam and Kyungpook provinces. Data were collected by a personal interview with CHPs and review of records and reports kept in the PHPs. The study was done for the periods of January 1-March 31, 1992 (before officialization) and January 1-March 31, 1993 (after officialization). Ninety-six percent of the CHPs wanted to become a regular government official in the hope of better job security and higher salary. The proportion of CHPs who were proud of their iob was increased from 24% to 46% after officialization. Those CHPs who felt insecure for their job decreased from 30% to 10%. Monthly salary was increased by 34% from 802,600 Won to 1,076,000 Won and 90% of the CHPs were satisfied with their salary, also more CHPs responded that they have autonomy in their work planning, implementation of plan, management of the post, and evaluation of their activity. There were no appreciable changes in such CHPs' activities as assessment of local health resources, drawing map for the catchment area, utilization of community organization, grasping the current population structure in the catchment area, keeping the family health records, individual and group health education, and school health service. However, the number of home visits was increased from 13.6 times on the average per month per CHP to 27.5 times. More mothers and children were referred to other medical facilities for the immunization and family planning services. Average number of patients of hypertension, cancer, and diabetes in three months period was decreased from 12.7 to 11.6, from 1.5 to 1.2, and 4.3 to 3.4, respectively. Records for the patient care, drug management, and equipment were well kept but not for other records. The level of record keeping was not changed after officialization. The proportion of PHPs which had support from the health center was increased for drug supply from 14.0% to 30.0%, for consumable commodities from 22.0% to 52.0%, for maintenance of PHP from 54.0% to 68.0%, for supply of health education materials from 34.0% to 44.0%, and supply of equipment from 54.0% to 58.0%. Total monthly revenue of a PHP was increased by about 50,000 Won; increased by 22,000 Won in patient care and 34,700 Won in the government subsidy but decreased in the membership due and donation. However, there was no remarkable changes in the expenditure. The proportion of PHPs which had received official notes from the health center for the purpose of guidance and supervision of the CHPs was increased from 20% to 38% during three months period and the average number of telephone call for supervision from the health center per PHP was increased from 1.8 to 2.1 times(p<0.01). However, the proportion of PHPs that had supervisory visit and conference was reduced from 79% to 62%, and from 88% to 74%, respectively. The proportion of CHPs who maintained a cooperative relationship with Myun Health Workers was reduced from 42% to 36%, that with the director of health center from 46% to 24%, that with the chief of public health administration section from 56% to 36%, and that with the chairman of PHP management council from 62% to 38%. Most of the CHPs (92% before and 82% after officialization) stated that the PHP management council is not helpful for the PHP. CHPs who considered the PHP management council unnecessary increased from 4% to 16%(p<0.05). Suggestions made by the CHPs for the improvement of CHP program included emphasis on health education, assurance of autonomy for PHP management, increase of the kind of drugs that can be dispensed by CHPs, and appointment of an experienced CHP in the health center as the supervisor of CHPs. The results of this study revealed that the role and function of CHPs as reflected in their activities have not been changed after officialization. However, satisfaction in job security and salary was improved as well as the autonomy. Support of health center to the PHP was improved but more official notes were sent to the PHPs which required the CHPs more paper works. Number of telephone calls for supervision was increased but there was little administrative and technical guidance for the CHP activities.
With the advent of knowledge-based society, the revitalization of technological innovation type SMEs, termed "inno-biz" hereafter, has been globally recognized as a government policymakers' primary concern in strengthening national competitiveness, and much effort is being put into establishing polices of boosting the start-ups and innovation capability of SMEs. Especially, in that the inno-biz enables national economy to get vitalized by widening world markets with its superior technology, and thus, taking the initiative of extremely competitive world markets, its growth and development has greater significance. In the case of Korea, the government has been maintaining the policies since the late 1990s of stimulating the growth of SMEs as well as building various infrastructures to foster the start-ups of the SMEs such as venture businesses with high technology. In addition, since the enactment of "Innovation Promotion Law for SMEs" in 2001, the government has been accelerating the policies of prioritizing the growth and development of inno-biz. So, for the sound growth and development of Korean inno-biz, this paper intends to offer effective management strategies for SMEs and suggest proper policies for the government, by researching into the effect of technological innovation capability and technology commercialization capability as the primary business resources on business performance in Korean SMEs in the light of market information orientation. The research is carried out on Korean companies characterized as inno-biz. On the basis of OSLO manual and prior studies, the research categorizes their status. R&D capability, technology accumulation capability and technological innovation system are categorized into technological innovation capability; product development capability, manufacturing capability and marketing capability into technology commercialization capability; and increase in product competitiveness and merits for new technology and/or product development into business performance. Then the effect of each component on business performance is substantially analyzed. In addition, the mediation effect of technological innovation and technology commercialization capability on business performance is observed by the use of the market information orientation as a parameter. The following hypotheses are proposed. H1 : Technology innovation capability will positively influence business performance. H1-1 : R&D capability will positively influence product competitiveness. H1-2 : R&D capability will positively influence merits for new technology and/or product development into business performance. H1-3 : Technology accumulation capability will positively influence product competitiveness. H1-4 : Technology accumulation capability will positively influence merits for new technology and/or product development into business performance. H1-5 : Technological innovation system will positively influence product competitiveness. H1-6 : Technological innovation system will positively influence merits for new technology and/or product development into business performance. H2 : Technology commercializing capability will positively influence business performance. H2-1 : Product development capability will positively influence product competitiveness. H2-2 : Product development capability will positively influence merits for new technology and/or product development into business performance. H2-3 : Manufacturing capability will positively influence product competitiveness. H2-4 : Manufacturing capability will positively influence merits for new technology and/or product development into business performance. H2-5 : Marketing capability will positively influence product competitiveness. H2-6 : Marketing capability will positively influence merits for new technology and/or product development into business performance. H3 : Technology innovation capability will positively influence market information orientation. H3-1 : R&D capability will positively influence information generation. H3-2 : R&D capability will positively influence information diffusion. H3-3 : R&D capability will positively influence information response. H3-4 : Technology accumulation capability will positively influence information generation. H3-5 : Technology accumulation capability will positively influence information diffusion. H3-6 : Technology accumulation capability will positively influence information response. H3-7 : Technological innovation system will positively influence information generation. H3-8 : Technological innovation system will positively influence information diffusion. H3-9 : Technological innovation system will positively influence information response. H4 : Technology commercialization capability will positively influence market information orientation. H4-1 : Product development capability will positively influence information generation. H4-2 : Product development capability will positively influence information diffusion. H4-3 : Product development capability will positively influence information response. H4-4 : Manufacturing capability will positively influence information generation. H4-5 : Manufacturing capability will positively influence information diffusion. H4-6 : Manufacturing capability will positively influence information response. H4-7 : Marketing capability will positively influence information generation. H4-8 : Marketing capability will positively influence information diffusion. H4-9 : Marketing capability will positively influence information response. H5 : Market information orientation will positively influence business performance. H5-1 : Information generation will positively influence product competitiveness. H5-2 : Information generation will positively influence merits for new technology and/or product development into business performance. H5-3 : Information diffusion will positively influence product competitiveness. H5-4 : Information diffusion will positively influence merits for new technology and/or product development into business performance. H5-5 : Information response will positively influence product competitiveness. H5-6 : Information response will positively influence merits for new technology and/or product development into business performance. H6 : Market information orientation will mediate the relationship between technology innovation capability and business performance. H7 : Market information orientation will mediate the relationship between technology commercializing capability and business performance. The followings are the research results : First, as for the effect of technological innovation on business performance, the technology accumulation capability and technological innovating system have a positive effect on increase in product competitiveness and merits for new technology and/or product development, while R&D capability has little effect on business performance. Second, as for the effect of technology commercialization capability on business performance, the effect of manufacturing capability is relatively greater than that of merits for new technology and/or product development. Third, the mediation effect of market information orientation is identified to exist partially in information generation, information diffusion and information response. Judging from these results, the following analysis can be made : On Increase in product competitiveness, directly related to successful technology commercialization of technology, management capability including technological innovation system, manufacturing capability and marketing capability has a relatively strong effect. On merits for new technology and/or product development, on the other hand, capability in technological aspect including R&D capability, technology accumulation capability and product development capability has relatively strong effect. Besides, in the cast of market information orientation, the level of information diffusion within an organization plays and important role in new technology and/or product development. Also, for commercial success like increase in product competitiveness, the level of information response is primarily required. Accordingly, the following policies are suggested : First, as the effect of technological innovation capability and technology commercialization capability on business performance differs among SMEs; in order for SMEs to secure competitiveness, the government has to establish microscopic policies for SMEs which meet their needs and characteristics. Especially, the SMEs lacking in capital and labor are required to map out management strategies of focusing their resources primarily on their strengths. And the government needs to set up policies for SMEs, not from its macro-scaled standpoint, but from the selective and concentrative one that meets the needs and characteristics of respective SMEs. Second, systematic infrastructures are urgently required which lead technological success to commercial success. Namely, as technological merits at respective SME levels do not always guarantee commercial success, the government should make and effort to build systematic infrastructures including encouragement of M&A or technology trade, systematic support for protecting intellectual property, furtherance of business incubating and industrial clusters for strengthening academic-industrial network, and revitalization of technology financing, in order to make successful commercialization from technological success. Finally, the effort to innovate technology, R&D, for example, is essential to future national competitiveness, but its result is often prolonged. So the government needs continuous concern and funding for basic science, in order to maximize technological innovation capability. Indeed the government needs to examine continuously whether technological innovation capability or technological success leads satisfactorily to commercial success in market economic system. It is because, when the transition fails, it should be left to the government.