• Title/Summary/Keyword: Monitoring indicators

Search Result 332, Processing Time 0.025 seconds

A Study of Anomaly Detection for ICT Infrastructure using Conditional Multimodal Autoencoder (ICT 인프라 이상탐지를 위한 조건부 멀티모달 오토인코더에 관한 연구)

  • Shin, Byungjin;Lee, Jonghoon;Han, Sangjin;Park, Choong-Shik
    • Journal of Intelligence and Information Systems
    • /
    • v.27 no.3
    • /
    • pp.57-73
    • /
    • 2021
  • Maintenance and prevention of failure through anomaly detection of ICT infrastructure is becoming important. System monitoring data is multidimensional time series data. When we deal with multidimensional time series data, we have difficulty in considering both characteristics of multidimensional data and characteristics of time series data. When dealing with multidimensional data, correlation between variables should be considered. Existing methods such as probability and linear base, distance base, etc. are degraded due to limitations called the curse of dimensions. In addition, time series data is preprocessed by applying sliding window technique and time series decomposition for self-correlation analysis. These techniques are the cause of increasing the dimension of data, so it is necessary to supplement them. The anomaly detection field is an old research field, and statistical methods and regression analysis were used in the early days. Currently, there are active studies to apply machine learning and artificial neural network technology to this field. Statistically based methods are difficult to apply when data is non-homogeneous, and do not detect local outliers well. The regression analysis method compares the predictive value and the actual value after learning the regression formula based on the parametric statistics and it detects abnormality. Anomaly detection using regression analysis has the disadvantage that the performance is lowered when the model is not solid and the noise or outliers of the data are included. There is a restriction that learning data with noise or outliers should be used. The autoencoder using artificial neural networks is learned to output as similar as possible to input data. It has many advantages compared to existing probability and linear model, cluster analysis, and map learning. It can be applied to data that does not satisfy probability distribution or linear assumption. In addition, it is possible to learn non-mapping without label data for teaching. However, there is a limitation of local outlier identification of multidimensional data in anomaly detection, and there is a problem that the dimension of data is greatly increased due to the characteristics of time series data. In this study, we propose a CMAE (Conditional Multimodal Autoencoder) that enhances the performance of anomaly detection by considering local outliers and time series characteristics. First, we applied Multimodal Autoencoder (MAE) to improve the limitations of local outlier identification of multidimensional data. Multimodals are commonly used to learn different types of inputs, such as voice and image. The different modal shares the bottleneck effect of Autoencoder and it learns correlation. In addition, CAE (Conditional Autoencoder) was used to learn the characteristics of time series data effectively without increasing the dimension of data. In general, conditional input mainly uses category variables, but in this study, time was used as a condition to learn periodicity. The CMAE model proposed in this paper was verified by comparing with the Unimodal Autoencoder (UAE) and Multi-modal Autoencoder (MAE). The restoration performance of Autoencoder for 41 variables was confirmed in the proposed model and the comparison model. The restoration performance is different by variables, and the restoration is normally well operated because the loss value is small for Memory, Disk, and Network modals in all three Autoencoder models. The process modal did not show a significant difference in all three models, and the CPU modal showed excellent performance in CMAE. ROC curve was prepared for the evaluation of anomaly detection performance in the proposed model and the comparison model, and AUC, accuracy, precision, recall, and F1-score were compared. In all indicators, the performance was shown in the order of CMAE, MAE, and AE. Especially, the reproduction rate was 0.9828 for CMAE, which can be confirmed to detect almost most of the abnormalities. The accuracy of the model was also improved and 87.12%, and the F1-score was 0.8883, which is considered to be suitable for anomaly detection. In practical aspect, the proposed model has an additional advantage in addition to performance improvement. The use of techniques such as time series decomposition and sliding windows has the disadvantage of managing unnecessary procedures; and their dimensional increase can cause a decrease in the computational speed in inference.The proposed model has characteristics that are easy to apply to practical tasks such as inference speed and model management.

Development of dietary behavior items available in Korea National Health and Nutrition Examination Survey (국민건강영양조사에 활용 가능한 식생활 조사항목 개발 및 유용성 검증)

  • Lim, A-Hyun;Choi, Suk-Young;Shim, Jae-Eun;Hwang, Ji-Yun;Moon, Hyun-Kyung;Kim, Kirang
    • Journal of Nutrition and Health
    • /
    • v.48 no.5
    • /
    • pp.407-418
    • /
    • 2015
  • Purpose: Given that the indicators related to chronic diseases are important to evaluating goals of the national health policy, the aim of this study was to develop dietary behavior items available in the Korea National Health and Nutrition Examination Survey. Methods: The dietary behavior items were developed based on the literature reviews, need assessment of the field, expert focus-group interviews, and expert advisory meeting. Questions for each dietary behavior item were developed by reflecting on environmental, personal, and behavior factors of the ecological frame and then revised through expert focus-group interview and expert advisory meeting. The understanding and reliability of the developed questionnaire were assessed by cognitive interview and test-retest reliability. Results: The developed items were sodium and salt intake, added and simple sugar intake, enough time to consume a meal for all ages, caffeine drinks and fresh/healthy food intake for children and adolescents, and limited dietary intake, fresh/healthy food intake for seniors. In most questions except some questions on sodium and salt intake, subjects understood over 70% and consistency of responses based on the kappa values was acceptable. Conclusion: Developed dietary behavior items are expected to be useful for evidence-based nutrition policy, interventions and research targeting dietary patterns through investigating and monitoring dietary behavior patterns.

Comparison of Soil Physicochemical Properties According to the Sensitivity of Forest Soil to Acidification in the Republic of Korea (우리나라 산림토양의 산성화 민감도평가와 그에 따른 토양 이화학적 특성 비교분석)

  • Lee, Ah Lim;Koo, Namin
    • Journal of Korean Society of Forest Science
    • /
    • v.109 no.2
    • /
    • pp.157-168
    • /
    • 2020
  • The sensitivity of forest soil to acidification in the Republic of Korea (ROK) was evaluated based on pHH2O, cation exchange capacity (CEC), and base saturation (BS). Sensitivity to acidification was categorized into three grades: adequate level (AL, pH ≧ 4.2, CEC ≧ 15cmol/kg, BS ≧ 15%), caution level (CL, at least one indicator is below AL), and severe Level (SL, all three indicators are below AL). Soil samples were collected from the 65 stationary monitoring plots (40 × 40 ㎢), distributed throughout ROK. Only 19% of soil samples were classified as AL, while 66% and 15% were CL and SL, respectively. The median of pHH2O, CEC, BS, and Ca/Al indicator in AL soils was pH 4.64, 20.7cmol/kg, 29%, and 6.3, respectively. Moreover, BCex (K+, Mg2+, Ca2+) and available phosphorus (AP) concentration compared with a threshold value and molar ratio of BCex and AP to total nitrogen (TN) was high. This indicates that AL soils have a good nutrient condition. The molar Ca/Al ratio, an indicator for toxicity of exchangeable aluminum (Alex), was more than 1, indicating no negative impact of Alex on plant growth. On the contrary, the median of pHH2O, CEC, and BS in SL soils was pH 4.02, 13.2cmol/kg, and 10%, respectively. The Ca/Al index was less than 0.6, which indicates that negative impacts of Alex on plants were high. Furthermore, both the concentration of BCex in SL soils and the BCex/TN ratio were the lowest among the three acidity degrees. This shows that SLsoils can be degraded by soil acidification compared with less acidic soils.

A Study of Correlation Between China Iron Ore Import, Steel Export Activity and Dry Bulk Index : Focus on Capesize C5/C10/C14 and Supramax S2/S3 (중국의 철광석 수입량과 철강 수출량이 부정기선 운임지수에 미치는 영향)

  • Jeon, Bong-Gil;Oh, Jin-Ho;Park, Keun-Sik
    • Journal of Korea Port Economic Association
    • /
    • v.36 no.3
    • /
    • pp.115-136
    • /
    • 2020
  • This study aims to analyze the impact of China's iron ore imports and exports on the tramper freight rate of China. The import volume of iron ore in China, the export volume of steel products in China, and exogenous variables were used as independent variables. The dependent variables were BDI, BCI, C5, C10, C14, BSI, S2, and S3. Correlation analysis and regression analysis were conducted. The correlation analysis showed that China's iron ore imports were not related to the remaining BDI, BCI, BSI, C5, C10, S2, and S3, except for the C14 index. However, there was a positive correlation between the ship's space and international oil prices, and it was not related to China's Purchasing Managers Index (PMI). The export volume of steel products was negatively correlated with BDI, BCI, BSI, C5, C10, C14, S2, S3, and international oil prices, and was not related to iron ore imports, ship space, and China's PMI. In the verification of the hypothesis between China's iron ore imports and exogenous variables, China's PMI was rejected within the hypothesis. However, the hypothesis on international oil prices and ship space was adopted. In the verification of the hypothesis between China's steel export volume and exogenous variables, the hypothesis on BDI and the S3 index was adopted, and the hypothesis on BSI and S2 was rejected. In the analysis results of this study, the ship space and oil prices were adopted in all the hypothesis results. Domestic companies participating in the tramper shipping market will need to be prepared through continuous monitoring of related indicators.

A Knowledge-based Approach for the Estimation of Effective Sampling Station Frequencies in Benthic Ecological Assessments (지식기반적 방법을 활용한 저서생태계 평가의 유효 조사정점 개수 산정)

  • Yoo, Jae-Won;Kim, Chang-Soo;Jung, Hoe-In;Lee, Yong-Woo;Lee, Man-Woo;Lee, Chang-Gun;Jin, Sung-Ju;Maeng, Jun-Ho;Hong, Jae-Sang
    • The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY
    • /
    • v.16 no.3
    • /
    • pp.147-154
    • /
    • 2011
  • Decision making in Environmental Impact Assessment (EIA) and Consultation on the Coastal Area Utilization (CCAU) is footing on the survey reports, thus requires concrete and accurate information on the natural habitats. In spite of the importance of reporting the ecological quality and status of habitats, the accumulated knowledge and recent techniques in ecology such as the use of investigated cases and indicators/indices have not been utilized in evaluation processes. Even the EIA report does not contain sufficient information required in a decision making process for conservation and development. In addition, for CCAU, sampling efforts were so limited that only two or a few stations were set in most study cases. This hampers transferring key ecological information to both specialist review and decision making processes. Hence, setting the effective number of sampling stations can be said as a prior step for better assessment. We introduced a few statistical techniques to determine the number of sampling stations in macrobenthos surveys. However, the application of the techniques requires a preliminary study that cannot be performed under the current assessment frame. An analysis of the spatial configuration of sampling stations from 19 previous studies was carried out as an alternative approach, based on the assumption that those configurations reported in scientific journal contribute to successful understanding of the ecological phenomena. The distance between stations and number of sampling stations in a $4{\times}4$ km unit area were calculated, and the medians of each parameter were 2.3 km, and 3, respectively. For each study, approximated survey area (ASA, $km^2$) was obtained by using the number of sampling stations in a unit area (NSSU) and total number of sampling stations (TNSS). To predict either appropriate ASA or NSSU/TNSS, we found and suggested statistically significant functional relationship among ASA, survey purpose and NSSU. This empirical approach will contribute to increasing sampling effort in a field survey and communicating with reasonable data and information in EIA and CCAU.

Risk Analysis of Household Debt in Korea: Using Micro CB Data (개인CB 자료를 이용한 우리나라 가계의 부채상환위험 분석)

  • Hahm, Joon-Ho;Kim, Jung In;Lee, Young Sook
    • KDI Journal of Economic Policy
    • /
    • v.32 no.4
    • /
    • pp.1-34
    • /
    • 2010
  • We conduct a comprehensive risk analysis of household debt in Korea for the first time using the whole sample credit bureau (CB) data of 2.2 million individual debtors. After analysing debt service capacity profiles of debtor groups classified by the borrower characteristics such as income, age, occupation, credit scoring, and the type of creditor business companies, we investigate the impact of interest rate and income changes on debt service-to-income ratios (DTIs) and default rates of respective debtor groups. Empirical results indicate that debt service burdens are relatively high for low income wage earners, high income self-employed, low income capital and card loan holders, and high income mutual savings loan holders. We also find that debtors from multiple financial companies are particularly weak in their debt service capacity. The scenario analysis indicates that financial companies, with the current level of capital buffers, may be able to absorb negative consequences arising from the increase in DTIs and loan default rates if the interest rate and income changes remain modest. However, the negative consequences may fall disproportionately on non-bank financial companies such as capital, credit card, and mutual savings banks, whose debtors' DTIs are already high. We also find that the refinancing risk of household debt is relatively high in Korea as more than half of household mortgage debts are bullet loans. As the DTIs of mortgage loan holders are already high, under the current DTI regulation, mortgage loans may not be readily refinanced especially when the interest rate rises. Disruptions in mortgage loan refinancing may put downward pressure on housing prices, which may in turn magnify refinancing risk under the current loan-to-value (LTV) regulation. Overall our analysis suggests that, for more effective monitoring of household debt risk, it is necessary to combine existing surveillance schemes based on macro aggregate indicators with more comprehensive and detailed risk analyses based on micro individual data.

  • PDF

Study of Quality Control of Traditional Wine Using IT Sensing Technology (IT 센싱 기술을 이용한 전통주 발효의 품질관리 연구)

  • Song, Hyeji;Choi, Jihee;Park, Chan-Won;Shin, Dong-Beom;Kang, Sung-Soo;Oh, Sung Hoon;Hwang, Kwontack
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.44 no.6
    • /
    • pp.904-911
    • /
    • 2015
  • The objective of this study was to investigate the quality characteristics of traditional wine using an radio-frequency identification (RFID) system annexed to a fermenter. In this study, we proposed an RFID-based data transmission scheme for monitoring fermentation of traditional alcoholic beverages. The pH, total acidity, total sugar, soluble sugar, free sugar, alcohol content, and organic acids of were investigated and subjected to fermentation of traditional alcoholic beverages three times. The pH ranged from 7.98, 7.95, and 7.68 at day 0, decreased drastically to 3.31~2.96 at day 2, and then slowly increased to the end point, finally reaching 3.34 at day 20. Acidity tended to increase quickly with time, especially for all samples after day 2. The fermentation environment induced a sudden increase acidity in reactants and indicated a low pH. The total sugars during fermentation quickly decreased to the range of 20.3, 22.43, and 19.2% at day 2, and the slope of reduction steadily decreased to 5.1, 6.1, and 4.8% at day 10. On the other hand, the alcohol content showed the reverse trend as total sugars. The alcohol content also showed the same pattern as total acids, showing the highest alcohol content of 17.3% (v/v) on day 20. In this study on traditional wine fermentation using an RFID system, we showed that pH, soluble sugar, and alcohol content can be adopted as key indicators for quality control and standardization of traditional wine manufacturing.

A Study of a Correlation Between Groundwater Level and Precipitation Using Statistical Time Series Analysis by Land Cover Types in Urban Areas (시계열 분석법을 이용한 도시지역 토지피복형태에 따른 지하수위와 강수량의 상관관계 분석)

  • Heo, Junyong;Kim, Taeyong;Park, Hyemin;Ha, Taejung;Kang, Hyungbin;Yang, Minjune
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.6_2
    • /
    • pp.1819-1827
    • /
    • 2021
  • Land-use/cover change caused by rapid urbanization in South Korea is one of the concerns in flood risk management because groundwater recharge by precipitation hardly occurs due to an increase in impermeable surfaces in urban areas. This study investigated the hydrologic effects of land-use/cover on groundwater recharge in the Yeonje-gu district of Busan, South Korea. A statistical time series analysis was conducted with temporal variations of precipitation and groundwater level to estimate lag-time based on correlation coefficients calculated from auto-correlation function (ACF), cross-correlation function (CCF), and moving average (MA) at five sites. Landform and land-use/cover within 250 m radius of the monitoring wells(GW01, GW02, GW03, GW04, and GW05) at five sites were identified by land cover and digital map using Arc-GIS software. Long lag-times (CCF: 42-71 days and MA: 148-161 days) were calculated at the sites covered by mainly impermeable surfaces(GW01, GW03, and GW05) while short lag-times(CCF: 4 days and MA: 67 days) were calculated at GW04 consisting of mainly permeable surfaces. The results suggest that lag-time would be one of the good indicators to evaluate the effects of land-use/cover on estimating groundwater recharge. The results of this study also provide guidance on the application of statistical time series analysis to environmentally important issues on creating an urban green space for natural groundwater recharge from precipitation in the city and developing a management plan for hydrological disaster prevention.

Present Status of the Quality Assurance and Control (QA/QC) for Korean Macrozoobenthic Biological Data and Suggestions for its Improvement (해양저서동물의 정량적 자료에 대한 정도관리 현실과 개선안)

  • CHOI, JIN-WOO;KHIM, JONG SEONG;SONG, SUNG JOON;RYU, JONGSEONG;KWON, BONG-OH
    • The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY
    • /
    • v.26 no.3
    • /
    • pp.263-276
    • /
    • 2021
  • Marine benthic organisms have been used as the indicators for the environment assessment and recently considered as a very important component in the biodiversity and ecosystem restoration. In Korean waters, the quantitative data on marine benthos was used as one of major components for the marine pollution assessment for 50 years since 1970s. The species identification which is an important factor for the quantitative biological data was mainly performed by the marine benthic ecologists. This leads to the deterioration of the data quality on marine benthos from the misidentication of major taxonomic groups due to the lack of taxonomic expertise in Korea. This taxonomic problem has not been solved until now and remains in most data from national research projects on the marine ecosystems in Korean waters. Here we introduce the quality assurance and control (QA/QC) system for the marine biological data in UK, that is, NMBAQC (Northeast Atlantic Marine Biological Analytic and Quality Control) Scheme which has been performed by private companies to solve similar species identification problems in UK. This scheme asks for all marine laboratories which want to participate to any national monitoring programs in UK to keep their identification potency at high level by the internal quality assurance systems and provides a series of taxonomic workshops and literature to increase their capability. They also performs the external quality control for the marine laboratories by performing the Ring Test using standard specimens on various faunal groups. In the case of Korea, there are few taxonomic expertise in two existing national institutions and so they can't solve the taxonomic problems in marine benthic fauna data. We would like to provide a few necessary suggestions to solve the taxonomic problems in Korean marine biological data in short-terms and long-terms: (1) the identification of all dominant species in marine biological data should be confirmed by taxonomic expertise, (2) all the national research programs should include taxonomic experts, and (3) establishing a private company, like the Korea marine organism identification association (KMOIA), which can perform the QA/QC system on the marine organisms and support all Korean marine laboratories by providing taxonomic literature and species identification workshops to enhance their potency. The last suggestion needs more efforts and time for the establishment of that taxonomic company by gathering the detailed contents and related opinions from diverse stakeholders in Korea.

A Study on Improvement Plans for Local Safety Assessment in Korea (국내 지역안전도 평가의 개선방안 연구)

  • Kim, Yong-Moon
    • Journal of Korean Society of Disaster and Security
    • /
    • v.14 no.4
    • /
    • pp.69-80
    • /
    • 2021
  • This study tried to suggest improvement measures by discovering problems or matters requiring improvement among the annual regional safety evaluation systems. Briefly introducing the structure and contents of the study, which is the introduction, describes the regional safety evaluation method newly applied by the Ministry of Public Administration and Security in 2020. Utilization plans were also introduced according to the local safety level that was finally evaluated by the local government. In this paper, various views of previous researchers related to regional safety are summarized and described. In addition, problems were drawn in the composition of the index of local safety, the method of calculating the index, and the application of the current index. Next, the problems of specific regional safety evaluation indicators were analyzed and solutions were presented. First, "Number of semi-basement households" is replaced with "Number of households receiving basic livelihood" of 「Social Vulnerability Index」 in the field of disaster risk factors is replaced with "the number of households receiving basic livelihood". In addition, the "Vinyl House Area" is evaluated by replacing "the number of households living in a Vinyl House, the number of container households, and the number of households in Jjok-bang villages" with data. Second, in the management and evaluation of habitual drought disaster areas, local governments with a water supply rate of 95% or higher in Counties, Cities, and Districts are treated as "missing". This is because drought disasters rarely occur in the metropolitan area and local governments that have undergone urbanization. Third, the activities of safety sheriffs, safety monitor volunteers, and disaster safety silver monitoring groups along with the local autonomous prevention foundation are added to the evaluation of the evaluation index of 「Regional Autonomous Prevention Foundation Activation」 in the field of response to disaster prevention measures. However, since the name of the local autonomous disaster prevention organization may be different for each local government, if it is an autonomous disaster prevention organization organized and active for disaster prevention, it would be appropriate to evaluate the results by summing up all of its activities. Fourth, among the Scorecard evaluation items, which is a safe city evaluation tool used by the United Nations Office for Disaster Risk Reduction(UNDRR), the item "preservation of natural buffers to strengthen the protection functions provided by natural ecosystems" is borrowed, which is closely related to natural disasters. The Scorecard evaluation is an assessment index that focuses on improving the disaster resilience of local governments while carrying out the campaign "Creating cities resilient to climate crises and disasters" emphasized by UNDRR. Finally, the names of "regional safety level" and "local safety index" are similar, so the term of local safety level is changed to "natural disaster safety level" or "natural calamity safety level". This is because only the general public can distinguish the local safety level from the local safety index.