• Title/Summary/Keyword: Model Ensemble

Search Result 638, Processing Time 0.027 seconds

Implementation of AIoT Edge Cluster System via Distributed Deep Learning Pipeline

  • Jeon, Sung-Ho;Lee, Cheol-Gyu;Lee, Jae-Deok;Kim, Bo-Seok;Kim, Joo-Man
    • International journal of advanced smart convergence
    • /
    • v.10 no.4
    • /
    • pp.278-288
    • /
    • 2021
  • Recently, IoT systems are cloud-based, so that continuous and large amounts of data collected from sensor nodes are processed in the data server through the cloud. However, in the centralized configuration of large-scale cloud computing, computational processing must be performed at a physical location where data collection and processing take place, and the need for edge computers to reduce the network load of the cloud system is gradually expanding. In this paper, a cluster system consisting of 6 inexpensive Raspberry Pi boards was constructed to perform fast data processing. And we propose "Kubernetes cluster system(KCS)" for processing large data collection and analysis by model distribution and data pipeline method. To compare the performance of this study, an ensemble model of deep learning was built, and the accuracy, processing performance, and processing time through the proposed KCS system and model distribution were compared and analyzed. As a result, the ensemble model was excellent in accuracy, but the KCS implemented as a data pipeline proved to be superior in processing speed..

Predicting Potential Epidemics of Rice Leaf Blast Disease Using Climate Scenarios from the Best Global Climate Model Selected for Individual Agro-Climatic Zones in Korea (국내 농업기후지대 별 최적기후모형 선정을 통한 미래 벼 도열병 발생 위험도 예측)

  • Lee, Seongkyu;Kim, Kwang-Hyung
    • Journal of Climate Change Research
    • /
    • v.9 no.2
    • /
    • pp.133-142
    • /
    • 2018
  • Climate change will affect not only the crop productivity but also the pattern of rice disease epidemics in Korea. Impact assessments for the climate change are conducted using various climate change scenarios from many global climate models (GCM), such as a scenario from a best GCM or scenarios from multiple GCMs, or a combination of both. Here, we evaluated the feasibility of using a climate change scenario from the best GCM for the impact assessment on the potential epidemics of a rice leaf blast disease in Korea, in comparison to a multi?model ensemble (MME) scenario from multiple GCMs. For this, this study involves analyses of disease simulation using an epidemiological model, EPIRICE?LB, which was validated for Korean rice paddy fields. We then assessed likely changes in disease epidemics using the best GCM selected for individual agro?climatic zones and MME scenarios constructed by running 11 GCMs. As a result, the simulated incidence of leaf blast epidemics gradually decreased over the future periods both from the best GCM and MME. The results from this study emphasized that the best GCM selection approach resulted in comparable performance to the MME approach for the climate change impact assessment on rice leaf blast epidemic in Korea.

SUNSPOT AREA PREDICTION BASED ON COMPLEMENTARY ENSEMBLE EMPIRICAL MODE DECOMPOSITION AND EXTREME LEARNING MACHINE

  • Peng, Lingling
    • Journal of The Korean Astronomical Society
    • /
    • v.53 no.6
    • /
    • pp.139-147
    • /
    • 2020
  • The sunspot area is a critical physical quantity for assessing the solar activity level; forecasts of the sunspot area are of great importance for studies of the solar activity and space weather. We developed an innovative hybrid model prediction method by integrating the complementary ensemble empirical mode decomposition (CEEMD) and extreme learning machine (ELM). The time series is first decomposed into intrinsic mode functions (IMFs) with different frequencies by CEEMD; these IMFs can be divided into three groups, a high-frequency group, a low-frequency group, and a trend group. The ELM forecasting models are established to forecast the three groups separately. The final forecast results are obtained by summing up the forecast values of each group. The proposed hybrid model is applied to the smoothed monthly mean sunspot area archived at NASA's Marshall Space Flight Center (MSFC). We find a mean absolute percentage error (MAPE) and a root mean square error (RMSE) of 1.80% and 9.75, respectively, which indicates that: (1) for the CEEMD-ELM model, the predicted sunspot area is in good agreement with the observed one; (2) the proposed model outperforms previous approaches in terms of prediction accuracy and operational efficiency.

Drought index forecast using ensemble learning (앙상블 기법을 이용한 가뭄지수 예측)

  • Jeong, Jihyeon;Cha, Sanghun;Kim, Myojeong;Kim, Gwangseob;Lim, Yoon-Jin;Lee, Kyeong Eun
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.5
    • /
    • pp.1125-1132
    • /
    • 2017
  • In a situation where the severity and frequency of drought events getting stronger and higher, many studies related to drought forecast have been conducted to improve the drought forecast accuracy. However it is difficult to predict drought events using a single model because of nonlinear and complicated characteristics of temporal behavior of drought events. In this study, in order to overcome the shortcomings of the single model approach, we first build various single models capable to explain the relationship between the meteorological drought index, Standardized Precipitation Index (SPI), and other independent variables such as world climate indices. Then, we developed a combined models using Stochastic Gradient Descent method among Ensemble Learnings.

Ensemble Model using Multiple Profiles for Analytical Classification of Threat Intelligence (보안 인텔리전트 유형 분류를 위한 다중 프로파일링 앙상블 모델)

  • Kim, Young Soo
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.3
    • /
    • pp.231-237
    • /
    • 2017
  • Threat intelligences collected from cyber incident sharing system and security events collected from Security Information & Event Management system are analyzed and coped with expanding malicious code rapidly with the advent of big data. Analytical classification of the threat intelligence in cyber incidents requires various features of cyber observable. Therefore it is necessary to improve classification accuracy of the similarity by using multi-profile which is classified as the same features of cyber observables. We propose a multi-profile ensemble model performed similarity analysis on cyber incident of threat intelligence based on both attack types and cyber observables that can enhance the accuracy of the classification. We see a potential improvement of the cyber incident analysis system, which enhance the accuracy of the classification. Implementation of our suggested technique in a computer network offers the ability to classify and detect similar cyber incident of those not detected by other mechanisms.

Deep Learning-Based Brain Tumor Classification in MRI images using Ensemble of Deep Features

  • Kang, Jaeyong;Gwak, Jeonghwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.7
    • /
    • pp.37-44
    • /
    • 2021
  • Automatic classification of brain MRI images play an important role in early diagnosis of brain tumors. In this work, we present a deep learning-based brain tumor classification model in MRI images using ensemble of deep features. In our proposed framework, three different deep features from brain MR image are extracted using three different pre-trained models. After that, the extracted deep features are fed to the classification module. In the classification module, the three different deep features are first fed into the fully-connected layers individually to reduce the dimension of the features. After that, the output features from the fully-connected layers are concatenated and fed into the fully-connected layer to predict the final output. To evaluate our proposed model, we use openly accessible brain MRI dataset from web. Experimental results show that our proposed model outperforms other machine learning-based models.

Projecting the spatial-temporal trends of extreme climatology in South Korea based on optimal multi-model ensemble members

  • Mirza Junaid Ahmad;Kyung-sook Choi
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.314-314
    • /
    • 2023
  • Extreme climate events can have a large impact on human life by hampering social, environmental, and economic development. Global circulation models (GCMs) are the widely used numerical models to understand the anticipated future climate change. However, different GCMs can project different future climates due to structural differences, varying initial boundary conditions and assumptions about the physical phenomena. The multi-model ensemble (MME) approach can improve the uncertainties associated with the different GCM outcomes. In this study, a comprehensive rating metric was used to select the best-performing GCMs out of 11 CMIP5 and 13 CMIP6 GCMs, according to their skills in terms of four temporal and five spatial performance indices, in replicating the 21 extreme climate indices during the baseline (1975-2017) in South Korea. The MME data were derived by averaging the simulations from all selected GCMs and three top-ranked GCMs. The random forest (RF) algorithm was also used to derive the MME data from the three top-ranked GCMs. The RF-derived MME data of the three top-ranked GCMs showed the highest performance in simulating the baseline extreme climate which was subsequently used to project the future extreme climate indices under both the representative concentration pathway (RCP) and the socioeconomic concentration pathway scenarios (SSP). The extreme cold and warming indices had declining and increasing trends, respectively, and most extreme precipitation indices had increasing trends over the period 2031-2100. Compared to all scenarios, RCP8.5 showed drastic changes in future extreme climate indices. The coasts in the east, south and west had stronger warming than the rest of the country, while mountain areas in the north experienced more extreme cold. While extreme cold climatology gradually declined from north to south, extreme warming climatology continuously grew from coastal to inland and northern mountainous regions. The results showed that the socially, environmentally and agriculturally important regions of South Korea were at increased risk of facing the detrimental impacts of extreme climatology.

  • PDF

A Study on the Prediction Models of Used Car Prices Using Ensemble Model And SHAP Value: Focus on Feature of the Vehicle Type (앙상블 모델과 SHAP Value를 활용한 국내 중고차 가격 예측 모델에 관한 연구: 차종 특성을 중심으로)

  • Seungjun Yim;Joungho Lee;Choonho Ryu
    • Journal of Service Research and Studies
    • /
    • v.14 no.1
    • /
    • pp.27-43
    • /
    • 2024
  • The market share of online platform services in the used car market continues to expand. And The used car online platform service provides service users with specifications of vehicles, accident history, inspection details, detailed options, and prices of used cars. SUV vehicle type's share in the domestic automobile market will be more than 50% in 2023, Sales of Hybrid vehicle type are doubled compared to last year. And these vehicle types are also gaining popularity in the used car market. Prior research has proposed a used car price prediction model by executing a Machine Learning model for all vehicles or vehicles by brand. On the other hand, the popularity of SUV and Hybrid vehicles in the domestic market continues to rise, but It was difficult to find a study that proposed a used car price prediction model for these vehicle type. This study selects a used car price prediction model by vehicle type using vehicle specifications and options for Sedans, SUV, and Hybrid vehicles produced by domestic brands. Accordingly, after selecting feature through the Lasso regression model, which is a feature selection, the ensemble model was sequentially executed with the same sampling, and the best model by vehicle type was selected. As a result, the best model for all models was selected as the CBR model, and the contribution and direction of the features were confirmed by visualizing Tree SHAP Value for the best model for each model. The implications of this study are expected to propose a used car price prediction model by vehicle type to sales officials using online platform services, confirm the attribution and direction of features, and help solve problems caused by asymmetry fo information between them.

Korean Flood Vulnerability Assessment on Climate Change (기후변화에 따른 국내 홍수 취약성 평가)

  • Lee, Moon-Hwan;Jung, Il-Won;Bae, Deg-Hyo
    • Journal of Korea Water Resources Association
    • /
    • v.44 no.8
    • /
    • pp.653-666
    • /
    • 2011
  • The purposes of this study are to suggest flood vulnerability assessment method on climate change with evaluation of this method over the 5 river basins and to present the uncertainty range of assessment using multi-model ensemble scenarios. In this study, the data related to past historical flood events were collected and flood vulnerability index was calculated. The vulnerability assessment were also performed under current climate system. For future climate change scenario, the 39 climate scenarios are obtained from 3 different emission scenarios and 13 GCMs provided by IPCC DDC and 312 hydrology scenarios from 3 hydrological models and 2~3 potential evapotranspiration computation methods for the climate scenarios. Finally, the spatial and temporal changes of flood vulnerability and the range of uncertainty were performed for future S1 (2010~2039), S2 (2040~2069), S3 (2070~2099) period compared to reference S0 (1971~2000) period. The results of this study shows that vulnerable region's were Han and Sumjin, Youngsan river basins under current climate system. Considering the climate scenarios, variability in Nakdong, Gum and Han river basins are large, but Sumjin river basin had little variability due to low basic-stream ability to adaptation.

A Study on Temperature Analysis for Smart Electrical Power Devices (스마트 전력 기기의 온도 분석에 관한 연구)

  • Vasanth, Ragu;Lee, Myeongbae;Kim, Younghyun;Park, Myunghye;Lee, Seungbae;Park, Jwangwoo;Cho, Yongyun;Shin, Changsun
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.6 no.8
    • /
    • pp.353-358
    • /
    • 2017
  • An electrical power utility, like an electrical power pole, includes various kinds of sensors for smart services. Temperature data is considered one of the important factors that can influence the smart operations of this utility. This study suggests a method for temperature data analysis for deciding the status of the smart electrical power utilities by using Kalman Filter and Ensemble Model. The suggested approach separates the temperature data according to the different positions of the temperature sensors of a utility, then uses Kalman Filter and Ensemble Model to analyse the characteristics of the temperature variation. With detailed processes, method explains the variation between an external temperature factor like weather temperature data and the sensed temperature data, and then, analysis the temperature data from each position of electrical power utilities. In this process, the suggested method uses Kalman Filter to remove error data and the ensemble model to find out mean value of every hour of electrical data. The result and discussion of temperature analysis were described clearly with the analysed results of electrical data. Finally, we were able to check the working condition of the power devices and the range of the temperature data foe each devices, which may help to indicate any causalities with respect to the devices in the utility pole.