• 제목/요약/키워드: Ensemble-based algorithm

검색결과 140건 처리시간 0.031초

Comparison of tree-based ensemble models for regression

  • Park, Sangho;Kim, Chanmin
    • Communications for Statistical Applications and Methods
    • /
    • 제29권5호
    • /
    • pp.561-589
    • /
    • 2022
  • When multiple classifications and regression trees are combined, tree-based ensemble models, such as random forest (RF) and Bayesian additive regression trees (BART), are produced. We compare the model structures and performances of various ensemble models for regression settings in this study. RF learns bootstrapped samples and selects a splitting variable from predictors gathered at each node. The BART model is specified as the sum of trees and is calculated using the Bayesian backfitting algorithm. Throughout the extensive simulation studies, the strengths and drawbacks of the two methods in the presence of missing data, high-dimensional data, or highly correlated data are investigated. In the presence of missing data, BART performs well in general, whereas RF provides adequate coverage. The BART outperforms in high dimensional, highly correlated data. However, in all of the scenarios considered, the RF has a shorter computation time. The performance of the two methods is also compared using two real data sets that represent the aforementioned situations, and the same conclusion is reached.

Kalman Filter-Based Ensemble Timescale with 3- Hydrogen Masers

  • Lee, Ho Seong;Kwon, Taeg Yong;Lee, Young Kyu;Yang, Sung-hoon;Yu, Dai-Hyuk
    • Journal of Positioning, Navigation, and Timing
    • /
    • 제9권3호
    • /
    • pp.261-272
    • /
    • 2020
  • A Kalman filter algorithm is used for the generation of an ensemble timescale with three hydrogen masers maintained in KRISS. Allan deviation curves of three pairs of clocks were obtained by a three-cornered hat method and were used as reference curves for determination of parameters of the Kalman filter-based timescale. The ensemble timescale equation of a 3-clock system was established, and the clocks' phases estimated by the Kalman filter were used as the prediction time of each clock in the equation. The weight of each clock was determined inversely proportional to the Allan variance calculated with the clocks' phases. The Allan deviation of the weighted mean was 1.2×10-16 at the averaging time of 57,600 s. However when we made fine adjustments of the clocks' weight, the minimum Allan deviation of 2×10-17 was obtained. To find out the reason of the great improvement in the frequency stability, additional researches are in progress theoretically and experimentally.

The ensemble approach in comparison with the diverse feature selection techniques for estimating NPPs parameters using the different learning algorithms of the feed-forward neural network

  • Moshkbar-Bakhshayesh, Khalil
    • Nuclear Engineering and Technology
    • /
    • 제53권12호
    • /
    • pp.3944-3951
    • /
    • 2021
  • Several reasons such as no free lunch theorem indicate that there is not a universal Feature selection (FS) technique that outperforms other ones. Moreover, some approaches such as using synthetic dataset, in presence of large number of FS techniques, are very tedious and time consuming task. In this study to tackle the issue of dependency of estimation accuracy on the selected FS technique, a methodology based on the heterogeneous ensemble is proposed. The performance of the major learning algorithms of neural network (i.e. the FFNN-BR, the FFNN-LM) in combination with the diverse FS techniques (i.e. the NCA, the F-test, the Kendall's tau, the Pearson, the Spearman, and the Relief) and different combination techniques of the heterogeneous ensemble (i.e. the Min, the Median, the Arithmetic mean, and the Geometric mean) are considered. The target parameters/transients of Bushehr nuclear power plant (BNPP) are examined as the case study. The results show that the Min combination technique gives the more accurate estimation. Therefore, if the number of FS techniques is m and the number of learning algorithms is n, by the heterogeneous ensemble, the search space for acceptable estimation of the target parameters may be reduced from n × m to n × 1. The proposed methodology gives a simple and practical approach for more reliable and more accurate estimation of the target parameters compared to the methods such as the use of synthetic dataset or trial and error methods.

딥앙상블 물리 정보 신경망을 이용한 기포 크기 분포 추정 (Estimation of bubble size distribution using deep ensemble physics-informed neural network)

  • 고선영;김근환;이재혁;구홍주;문광호;추영민
    • 한국음향학회지
    • /
    • 제42권4호
    • /
    • pp.305-312
    • /
    • 2023
  • 기포 크기 분포를 음파 감쇄 손실을 이용하여 역산하기 위해 Physics-Informed Neural Network(PINN)을 사용하였다. 역산에 사용되는 선형시스템을 풀기 위해 이미지 처리 분야에서 선형시스템 문제를 해결한 Adaptive Learned Iterative Shrinkage Thresholding Algorithm(Ada-LISTA)를 PINN의 신경망 구조로 이용하였다. 더 나아가, PINN의 손실함수에 선형시스템 기반의 정규항을 포함함으로써 PINN의 해가 기포 물리 법칙을 만족하여 더 높은 일반화 성능을 가지도록 하였다. 그리고 기포 추정값의 불확실성을 계산하기 위해 딥앙상블 기법을 이용하였다. 서로 다른 초기값을 갖는 20개의 Ada-LISTA는 같은 훈련데이터를 이용하여 학습되었다. 이 후 테스트시 훈련데이터와 다른 경향의 감쇄 손실을 입력으로 사용하여 기포 크기 분포를 추정하였고, 추정값과 이에 대한 불확실성을 20개 추정값의 평균과 분산으로 각각 구하였다. 그 결과 딥앙상블이 적용된 Ada-LISTA는 기존 볼록 최적화 기법인 CVX보다 기포 크기 분포를 역산하는데 더 우수한 성능을 보였다.

Uncertainty investigation and mitigation in flood forecasting

  • Nguyen, Hoang-Minh;Bae, Deg-Hyo
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2018년도 학술발표회
    • /
    • pp.155-155
    • /
    • 2018
  • Uncertainty in flood forecasting using a coupled meteorological and hydrological model is arisen from various sources, especially the uncertainty comes from the inaccuracy of Quantitative Precipitation Forecasts (QPFs). In order to improve the capability of flood forecast, the uncertainty estimation and mitigation are required to perform. This study is conducted to investigate and reduce such uncertainty. First, ensemble QPFs are generated by using Monte - Carlo simulation, then each ensemble member is forced as input for a hydrological model to obtain ensemble streamflow prediction. Likelihood measures are evaluated to identify feasible member. These members are retained to define upper and lower limits of the uncertainty interval and assess the uncertainty. To mitigate the uncertainty for very short lead time, a blending method, which merges the ensemble QPFs with radar-based rainfall prediction considering both qualitative and quantitative skills, is proposed. Finally, blending bias ratios, which are estimated from previous time step, are used to update the members over total lead time. The proposed method is verified for the two flood events in 2013 and 2016 in the Yeonguol and Soyang watersheds that are located in the Han River basin, South Korea. The uncertainty in flood forecasting using a coupled Local Data Assimilation and Prediction System (LDAPS) and Sejong University Rainfall - Runoff (SURR) model is investigated and then mitigated by blending the generated ensemble LDAPS members with radar-based rainfall prediction that uses McGill algorithm for precipitation nowcasting by Lagrangian extrapolation (MAPLE). The results show that the uncertainty of flood forecasting using the coupled model increases when the lead time is longer. The mitigation method indicates its effectiveness for mitigating the uncertainty with the increases of the percentage of feasible member (POFM) and the ratio of the number of observations that fall into the uncertainty interval (p-factor).

  • PDF

Noise Correction of Remote Sensing Imageries: Application to KOMPSAT/OSMI Data

  • Kang, Y.Q.;Ahn, Y.H.
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.694-696
    • /
    • 2003
  • The KOMPSAT/OSMI remote sending data of 800 km swath are collected by whisk broom method employing 96 charge coupled devices (CCDs). The stripping noise in the OSMI imageries, which arise mainly due to the non-uniform sensitivities of 96 CCDs, are the major hindrance for oceanographic applications of the OSMI data. The OSMI images are corrected by 'Ensemble Smoothness' method which is based on an assumption that the series of the averages and variances of digital numbers in each line should vary smoothly. The data of each line are corrected by linear regression model of which coefficients are obtained by Ensemble Smoothness method. Our algorithm can be applied not only to OSMI data but also for other remote sensing date collected by whisk broom or push broom.

  • PDF

Multi-classifier Fusion Based Facial Expression Recognition Approach

  • Jia, Xibin;Zhang, Yanhua;Powers, David;Ali, Humayra Binte
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제8권1호
    • /
    • pp.196-212
    • /
    • 2014
  • Facial expression recognition is an important part in emotional interaction between human and machine. This paper proposes a facial expression recognition approach based on multi-classifier fusion with stacking algorithm. The kappa-error diagram is employed in base-level classifiers selection, which gains insights about which individual classifier has the better recognition performance and how diverse among them to help improve the recognition accuracy rate by fusing the complementary functions. In order to avoid the influence of the chance factor caused by guessing in algorithm evaluation and get more reliable awareness of algorithm performance, kappa and informedness besides accuracy are utilized as measure criteria in the comparison experiments. To verify the effectiveness of our approach, two public databases are used in the experiments. The experiment results show that compared with individual classifier and two other typical ensemble methods, our proposed stacked ensemble system does recognize facial expression more accurately with less standard deviation. It overcomes the individual classifier's bias and achieves more reliable recognition results.

앙상블 학습 알고리즘과 인공지능 표정 인식 기술을 활용한 사용자 감정 맞춤 힐링 서비스 (Using Ensemble Learning Algorithm and AI Facial Expression Recognition, Healing Service Tailored to User's Emotion)

  • 양성연;홍다혜;문재현
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2022년도 추계학술발표대회
    • /
    • pp.818-820
    • /
    • 2022
  • The keyword 'healing' is essential to the competitive society and culture of Koreans. In addition, as the time at home increases due to COVID-19, the demand for indoor healing services has increased. Therefore, this thesis analyzes the user's facial expression so that people can receive various 'customized' healing services indoors, and based on this, provides lighting, ASMR, video recommendation service, and facial expression recording service.The user's expression was analyzed by applying the ensemble algorithm to the expression prediction results of various CNN models after extracting only the face through object detection from the image taken by the user.

향상된 PAIRWISE COUPLING 알고리즘에 의한 자료의 분류 (On the Classfication by an Improved Pairwise Coupling Algorithm)

  • 최대우;윤중식
    • 응용통계연구
    • /
    • 제13권2호
    • /
    • pp.415-425
    • /
    • 2000
  • 붓스트랩 표본추출과 pairwise coupling의 알고리즘을 결합한 새로운 분류 알고리즘을 제안하고, 이를 선형판별분석과 2차 판별분석에 적용하였다. 그리고 새로운 분류 알고리즘의 정확도를 비교하기위해 널리 사용되는 waveform 자료 등을 분석한 후, 그 결과를 기존 분류 방법과 비교하였다.

  • PDF

IMT-2000 핸드셋용 평면형 Bowtie 안테나 해석 (Analysis on the Planar Bowtie Antenna for IMT-2000 Handset)

  • 이희숙;김남
    • 한국전자파학회논문지
    • /
    • 제11권5호
    • /
    • pp.681-688
    • /
    • 2000
  • 본 논문에서는 IMT-2000을 목표로 한 핸드셋에 상요할 수 있는 안테나로, 작고 가벼운 평면형 bowtie 안테나를 설계하고 해석하였다. MoM에 기반을 둔 Ensemble 시뮬레이션을 통해 공지주파수를 결정하는 설계 파라미터를 찾고, IMT-2000의 사용주파수에 맞추어 공진이 일어나도록 날개각의 설계 파라미터를 21$^{\circ}$로 고정한 안테나구조에서 Ensemble 심류레이션과 FDTD 수치해석을 이용하여 해석한다. FDTD 방법으로 해석을 하면, FDTD의 정확한 해에도 불구하고, 이 안테나는 상당한 오차를 가지게 되는데, 이유는 bowtie의 경사면 해석에서 계단형 근사 오차로 인한 것이다. 이러한 오차를 줄이기 위해 안테나의 경사면이 있는 각 셀 안에서 도체면/자유공간이 나뉘는 영역을 네 부분으로 구분해 자유공간이 차지하는 면적과 길이의 값을 적용하여 그 셀에서 계산되는 H-field의 값을 수정하는 새로운 알고리즘을 적용하여 보다 정확한 해를 얻는다. 즉, 기본 FDTD에서 반사손실의 협대역 특성이 수정 FDTD 알고리즘으로, 인해, 목적에 맞는 주파수 대역까지 확장될 수 있다.

  • PDF