• Title/Summary/Keyword: Model Ensemble

Search Result 638, Processing Time 0.029 seconds

Optimum Climate Change Scenario Estimation via Hierarchical Bayesian Model : Using CORDEX Scenarios (계층적 베이지안 모델을 통한 최적 기후변화 시나리오 추정 : CORDEX 시나리오 사용)

  • Jung, Min-Kyu;Kim, Yong-Tak;Kim, Hyeon-Muk;Kwon, Hyun-Han
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2018.05a
    • /
    • pp.168-168
    • /
    • 2018
  • 최근 기후변화로 인하여 전 세계적으로 과거 강우사상에서 확인되지 않는 극치사상이 빈번하게 관측되고 있으며 이에 따른 피해도 증가하고 있다. 미래의 기상학적 변동성 및 기후변화 영향은 지구순환모형 (General Circulation Models, GCM)을 통해 구체화되며 가장 일반적인 기후변화 전망자료로서 활용된다. 그러나 산정된 기후변화 시나리오마다 서로 그 특성에 차이가 있으며 이러한 이유로 다양한 원인으로 인해 큰 변동성을 가지는 미래 극치강우를 하나의 시나리오로 분석하기에는 무리가 있다. 또한 다양한 시나리오를 통해 분석한 결과값이 상이하며 이러한 시나리오별 산정 결과의 차이는 사용자에게 혼란을 야기할 수 있어 이를 하나의 결과로 나타낼 필요성이 있으나 정량적인 대푯값을 얻기 위해 특정 시나리오를 선택하는 것은 신뢰성에 문제가 있다. 본 연구에서는 시나리오들을 정량적 지표에 의거하여 혼합된 하나의 시나리오로 표출하고자 하였다. CORDEX-RCMs 시나리오 중 HadGEM3-RA, RegCM, SNU_WRF 및 GRIMs를 입력 자료로 하여 다중모형앙상블(Multi-Model Ensemble, MME)을 통해 낙동강 유역의 극치강우에 대한 하나의 최적 기후변화 시나리오를 도출하고자 하였으며 계층적 베이지안 (Hierarchical Bayesian Model, HBM) 기법을 통하여 기후변화 시나리오에 내제된 불확실성에 대한 정량적인 해석을 수행하였다.

  • PDF

Application of machine learning for merging multiple satellite precipitation products

  • Van, Giang Nguyen;Jung, Sungho;Lee, Giha
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2021.06a
    • /
    • pp.134-134
    • /
    • 2021
  • Precipitation is a crucial component of water cycle and play a key role in hydrological processes. Traditionally, gauge-based precipitation is the main method to achieve high accuracy of rainfall estimation, but its distribution is sparsely in mountainous areas. Recently, satellite-based precipitation products (SPPs) provide grid-based precipitation with spatio-temporal variability, but SPPs contain a lot of uncertainty in estimated precipitation, and the spatial resolution quite coarse. To overcome these limitations, this study aims to generate new grid-based daily precipitation using Automatic weather system (AWS) in Korea and multiple SPPs(i.e. CHIRPSv2, CMORPH, GSMaP, TRMMv7) during the period of 2003-2017. And this study used a machine learning based Random Forest (RF) model for generating new merging precipitation. In addition, several statistical linear merging methods are used to compare with the results of the RF model. In order to investigate the efficiency of RF, observed data from 64 observed Automated Synoptic Observation System (ASOS) were collected to evaluate the accuracy of the products through Kling-Gupta efficiency (KGE), probability of detection (POD), false alarm rate (FAR), and critical success index (CSI). As a result, the new precipitation generated through the random forest model showed higher accuracy than each satellite rainfall product and spatio-temporal variability was better reflected than other statistical merging methods. Therefore, a random forest-based ensemble satellite precipitation product can be efficiently used for hydrological simulations in ungauged basins such as the Mekong River.

  • PDF

Particular Matter Concentration Prediction Models Based on EEMD (EEMD 기반의 미세먼지 농도 예측 모델)

  • Jung, Yong-jin;Lee, Jong-sung;Oh, Chang-heon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.345-347
    • /
    • 2021
  • Various studies are being conducted to improve the accuracy of fine dust, but there is a problem that deep learning models are not well learned due to various characteristics according to the concentration of fine dust. This paper proposes an EEMD-based fine dust concentration prediction model to decompose the characteristics of fine dust concentration and reflect the characteristics. After decomposing the fine dust concentration through EEMD, the final fine dust concentration value is derived by ensemble of the prediction results according to the characteristics derived from each. As a result of the model's performance evaluation, 91.7% of the fine dust concentration prediction accuracy was confirmed.

  • PDF

Prediction of compressive strength of sustainable concrete using machine learning tools

  • Lokesh Choudhary;Vaishali Sahu;Archanaa Dongre;Aman Garg
    • Computers and Concrete
    • /
    • v.33 no.2
    • /
    • pp.137-145
    • /
    • 2024
  • The technique of experimentally determining concrete's compressive strength for a given mix design is time-consuming and difficult. The goal of the current work is to propose a best working predictive model based on different machine learning algorithms such as Gradient Boosting Machine (GBM), Stacked Ensemble (SE), Distributed Random Forest (DRF), Extremely Randomized Trees (XRT), Generalized Linear Model (GLM), and Deep Learning (DL) that can forecast the compressive strength of ternary geopolymer concrete mix without carrying out any experimental procedure. A geopolymer mix uses supplementary cementitious materials obtained as industrial by-products instead of cement. The input variables used for assessing the best machine learning algorithm not only include individual ingredient quantities, but molarity of the alkali activator and age of testing as well. Myriad statistical parameters used to measure the effectiveness of the models in forecasting the compressive strength of ternary geopolymer concrete mix, it has been found that GBM performs better than all other algorithms. A sensitivity analysis carried out towards the end of the study suggests that GBM model predicts results close to the experimental conditions with an accuracy between 95.6 % to 98.2 % for testing and training datasets.

Vacant House Prediction and Important Features Exploration through Artificial Intelligence: In Case of Gunsan (인공지능 기반 빈집 추정 및 주요 특성 분석)

  • Lim, Gyoo Gun;Noh, Jong Hwa;Lee, Hyun Tae;Ahn, Jae Ik
    • Journal of Information Technology Services
    • /
    • v.21 no.3
    • /
    • pp.63-72
    • /
    • 2022
  • The extinction crisis of local cities, caused by a population density increase phenomenon in capital regions, directly causes the increase of vacant houses in local cities. According to population and housing census, Gunsan-si has continuously shown increasing trend of vacant houses during 2015 to 2019. In particular, since Gunsan-si is the city which suffers from doughnut effect and industrial decline, problems regrading to vacant house seems to exacerbate. This study aims to provide a foundation of a system which can predict and deal with the building that has high risk of becoming vacant house through implementing a data driven vacant house prediction machine learning model. Methodologically, this study analyzes three types of machine learning model by differing the data components. First model is trained based on building register, individual declared land value, house price and socioeconomic data and second model is trained with the same data as first model but with additional POI(Point of Interest) data. Finally, third model is trained with same data as the second model but with excluding water usage and electricity usage data. As a result, second model shows the best performance based on F1-score. Random Forest, Gradient Boosting Machine, XGBoost and LightGBM which are tree ensemble series, show the best performance as a whole. Additionally, the complexity of the model can be reduced through eliminating independent variables that have correlation coefficient between the variables and vacant house status lower than the 0.1 based on absolute value. Finally, this study suggests XGBoost and LightGBM based machine learning model, which can handle missing values, as final vacant house prediction model.

Explainable AI Application for Machine Predictive Maintenance (설명 가능한 AI를 적용한 기계 예지 정비 방법)

  • Cheon, Kang Min;Yang, Jaekyung
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.44 no.4
    • /
    • pp.227-233
    • /
    • 2021
  • Predictive maintenance has been one of important applications of data science technology that creates a predictive model by collecting numerous data related to management targeted equipment. It does not predict equipment failure with just one or two signs, but quantifies and models numerous symptoms and historical data of actual failure. Statistical methods were used a lot in the past as this predictive maintenance method, but recently, many machine learning-based methods have been proposed. Such proposed machine learning-based methods are preferable in that they show more accurate prediction performance. However, with the exception of some learning models such as decision tree-based models, it is very difficult to explicitly know the structure of learning models (Black-Box Model) and to explain to what extent certain attributes (features or variables) of the learning model affected the prediction results. To overcome this problem, a recently proposed study is an explainable artificial intelligence (AI). It is a methodology that makes it easy for users to understand and trust the results of machine learning-based learning models. In this paper, we propose an explainable AI method to further enhance the explanatory power of the existing learning model by targeting the previously proposedpredictive model [5] that learned data from a core facility (Hyper Compressor) of a domestic chemical plant that produces polyethylene. The ensemble prediction model, which is a black box model, wasconverted to a white box model using the Explainable AI. The proposed methodology explains the direction of control for the major features in the failure prediction results through the Explainable AI. Through this methodology, it is possible to flexibly replace the timing of maintenance of the machine and supply and demand of parts, and to improve the efficiency of the facility operation through proper pre-control.

Performance of CMIP5 Models for the Relationship between Variabilities of the North Pacific Storm Track and East Asian Winter Monsoon (북태평양 스톰트랙 활동과 동아시아 겨울 몬순의 상관성에 관한 CMIP5 모델의 모의 성능)

  • Yoon, Jae-Seung;Chung, Il-Ung;Shin, Sang-Hye
    • Atmosphere
    • /
    • v.25 no.2
    • /
    • pp.295-308
    • /
    • 2015
  • Based on the CMIP5 historical simulation datasets, we assessed the performance of state-of-the-art climate models in respect to the relationship between interannual variabilities of the North Pacific synoptic eddy (NPSE) and East Asian winter monsoon (EAWM). Observation (ERA-Interim) shows a high negative correlation (-0.73) between the interannual variabilities of East Asian winter monsoon (EAWM) intensity and North Pacific synoptic eddy (NPSE) activity during the period of 1979~2005. Namely, a stronger (weaker) EAWM is related to a weaker (stronger) synoptic eddy activities over the North Pacific. This strong reverse relationship can be well explained by latitudinal distributions of the surface temperature anomalies over East Asian continent, which leads the variation of local baroclinicity and significantly weakens the baroclinic wave activities over the northern latitudes of $40^{\circ}N$. This feature is supported by the distribution of the meridional heat flux (${\overline{{\nu}^{\prime}{\theta}^{\prime}}}$) anomalies, which have negative (positive) values along the latitudes $40{\sim}50^{\circ}N$ for strong(weak) EAWM years. In this study, the historical simulations by 11 CMIP5 climate models (BCC-CSM1.1, CanESM2, GFDL-ESM2G, GFDL-ESM2M, HadGEM2-AO, HadGEM2-CC, IPSL-CM5A-LR, MPI-ESM-LR, MPI-ESM-MR, MRI-CGCM3, and NorESM1-M) are analyzed for DJF of 1979~2005. Correlation coefficient between the two phenomena is -0.59, which is comparable to that of observation. Model-to-model variation in this relationship is relatively large as the range of correlation coefficient is between -0.76 (HadGEM2-CC and HadGEM2-AO) and -0.33 (MRI-CGCM3). But, these reverse relationships are shown in all models without any exception. We found that the multi-model ensemble is qualitatively similar to the observation in reasoning (that is, latitudinal distribution of surface temperature anomalies, variation of local baroclinicity and meridional heat flux by synoptic eddies) of the reverse relationship. However, the uncertainty for weak EAWM is much larger than strong EAWM. In conclusion, we suggest that CMIP5 models as an ensemble have a good performance in the simulation of EAWM, NPSE, and their relationship.

Prospect of extreme precipitation in North Korea using an ensemble empirical mode decomposition method (앙상블 경험적 모드분해법을 활용한 북한지역 극한강수량 전망)

  • Jung, Jinhong;Park, Dong-Hyeok;Ahn, Jaehyun
    • Journal of Korea Water Resources Association
    • /
    • v.52 no.10
    • /
    • pp.671-680
    • /
    • 2019
  • Many researches illustrated that the magnitude and frequency of hydrological event would increase in the future due to changes of hydrological cycle components according to climate change. However, few studies performed quantitative analysis and evaluation of future rainfall in North Korea, where the damage caused by extreme precipitation is expected to occur as in South Korea. Therefore, this study predicted the extreme precipitation change of North Korea in the future (2020-2060) compared to the current (1981-2017) using stationary and nonstationary frequency analysis. This study conducted nonstationary frequency analysis considering the external factors (mean precipitation of JFM (Jan.-Mar.), AMJ (Apr.-Jun.), JAS (Jul.-Sept.), OND (Oct.-Dec.)) of the HadGEM2-AO model simulated according to the Representative Concentration Pathway (RCP) climate change scenarios. In order to select external factors that have a similar tendency with extreme rainfall events in North Korea, the maximum annual rainfall data was obtained by using the ensemble empirical mode decomposition (EEMD) method. Correlation analysis was performed between the extracted residue and the external factors. Considering selected external factors, nonstationary GEV model was constructed. In RCP4.5, four of the eight stations tended to decrease in future extreme precipitation compared to the present climate while three stations increased. On the other hand, in RCP8.5, two stations decreased while five stations increased.

A Study on Classification of Variant Malware Family Based on ResNet-Variational AutoEncoder (ResNet-Variational AutoEncoder기반 변종 악성코드 패밀리 분류 연구)

  • Lee, Young-jeon;Han, Myung-Mook
    • Journal of Internet Computing and Services
    • /
    • v.22 no.2
    • /
    • pp.1-9
    • /
    • 2021
  • Traditionally, most malicious codes have been analyzed using feature information extracted by domain experts. However, this feature-based analysis method depends on the analyst's capabilities and has limitations in detecting variant malicious codes that have modified existing malicious codes. In this study, we propose a ResNet-Variational AutoEncder-based variant malware classification method that can classify a family of variant malware without domain expert intervention. The Variational AutoEncoder network has the characteristics of creating new data within a normal distribution and understanding the characteristics of the data well in the learning process of training data provided as input values. In this study, important features of malicious code could be extracted by extracting latent variables in the learning process of Variational AutoEncoder. In addition, transfer learning was performed to better learn the characteristics of the training data and increase the efficiency of learning. The learning parameters of the ResNet-152 model pre-trained with the ImageNet Dataset were transferred to the learning parameters of the Encoder Network. The ResNet-Variational AutoEncoder that performed transfer learning showed higher performance than the existing Variational AutoEncoder and provided learning efficiency. Meanwhile, an ensemble model, Stacking Classifier, was used as a method for classifying variant malicious codes. As a result of learning the Stacking Classifier based on the characteristic data of the variant malware extracted by the Encoder Network of the ResNet-VAE model, an accuracy of 98.66% and an F1-Score of 98.68 were obtained.

Assessing the Climatic Suitability for the Drywood Termite, Cryptotermes domesticus Haviland (Blattodea: Kalotermitidae), in South Korea (마른나무흰개미(가칭)의 국내 기후적합성 평가)

  • Min-Jung Kim;Jun-Gi Lee;Youngwoo Nam ;Yonghwan Park
    • Korean journal of applied entomology
    • /
    • v.62 no.3
    • /
    • pp.215-220
    • /
    • 2023
  • A recent discovery of drywood termites (Cryptotermes domesticus) in a residential facility in Seoul has raised significant concern. This exotic insect species, which can damage timber and wooden buildings, necessitates an immediate investigation of potential infestation. In this study, we assessed the climatic suitability for this termite species using a species distribution modeling approach. Global distribution data and bioclimatic variables were compiled from published sources, and predictive models for climatic suitability were developed using four modeling algorithms. An ensemble prediction was made based on the mean occurrence probability derived from the individual models. The final model suggested that this species could potentially establish itself in tropical coastal regions. While the climatic suitability in South Korea was generally found to be low, a careful investigation is still warranted due to the potential risk of colonization and establishment of this species.