• 제목/요약/키워드: recursive training method

검색결과 23건 처리시간 0.024초

혼돈 시계열의 예측을 위한 Radial Basis 함수 회로망 설계 (Radial basis function network design for chaotic time series prediction)

  • 신창용;김택수;최윤호;박상희
    • 대한전기학회논문지
    • /
    • 제45권4호
    • /
    • pp.602-611
    • /
    • 1996
  • In this paper, radial basis function networks with two hidden layers, which employ the K-means clustering method and the hierarchical training, are proposed for improving the short-term predictability of chaotic time series. Furthermore the recursive training method of radial basis function network using the recursive modified Gram-Schmidt algorithm is proposed for the purpose. In addition, the radial basis function networks trained by the proposed training methods are compared with the X.D. He A Lapedes's model and the radial basis function network by nonrecursive training method. Through this comparison, an improved radial basis function network for predicting chaotic time series is presented. (author). 17 refs., 8 figs., 3 tabs.

  • PDF

고밀도 스킵 연결을 통한 재귀 잔차 구조를 이용한 단일 이미지 초해상도 기법 (Single Image Super-resolution using Recursive Residual Architecture Via Dense Skip Connections)

  • 진건;정제창
    • 방송공학회논문지
    • /
    • 제24권4호
    • /
    • pp.633-642
    • /
    • 2019
  • 최근, 단일 이미지 초해상도 복원 기법(super-resolution)에서 컨볼루션 신경망 모델은 매우 성공적이다. 잔여 학습 기법은 컨볼루션 신경망 훈련의 안전성과 성능을 향상시킬 수 있다. 본 논문은 저해상도 입력 이미지에서 고해상도 목표 이미지로 비선형 매핑 학습을 위해 고밀도 스킵 연결(dense skip-connection)을 통한 재귀 잔차 구조를 이용한 단일 이미지 초해상도 복원 기법을 제안한다. 제안하는 단일 이미지 초해상도 복원 기법은 고밀도 스킵 연결 방식을 통해 재귀 잔차 학습 방법을 채택해서 깊은 신경망에서 학습이 어려운 문제를 완화하고 더 쉽게 최적화하기 위해 신경망 안에 불필요한 레이어를 제거한다. 제안하는 방법은 매우 깊은 신경망의 사라지는 변화도(vanishing gradient) 문제를 완화할 뿐만 아니고 낮은 복잡성으로 뛰어난 성능을 얻음으로써 단일 이미지 초해상도 복원 기법의 성능을 향상시킨다. 실험 결과를 통해 제안하는 알고리듬이 기존의 알고리듬 보다 결과가 더 우수함을 보인다.

카오스 특성을 갖는 뇌파신호의 예측을 위한 신경회로망 설계에 관한 연구 (A Study on Design of Neural Network for the Prediction of EEG with Chaotic Characteristics)

  • 신창용;김택수;박상희
    • 대한의용생체공학회:학술대회논문집
    • /
    • 대한의용생체공학회 1995년도 춘계학술대회
    • /
    • pp.265-269
    • /
    • 1995
  • In this study, we present a training method of radial basis function networks based on recursive modified Gram-Schmidt algorithm for single step prediction of chaotic time series. With single step predictions of Mackey-Glass time series and alpha-rhythm EEG which has chaotic characteristics, the radial basis function network trained by this method is compared with one trained by a classical non-recursive method and the radial basis function model proposed by X.D. He and A. Lapedes. The results show the effectiveness of the training method.

  • PDF

Prediction Models of P-Glycoprotein Substrates Using Simple 2D and 3D Descriptors by a Recursive Partitioning Approach

  • Joung, Jong-Young;Kim, Hyoung-Joon;Kim, Hwan-Mook;Ahn, Soon-Kil;Nam, Ky-Youb;No, Kyoung-Tai
    • Bulletin of the Korean Chemical Society
    • /
    • 제33권4호
    • /
    • pp.1123-1127
    • /
    • 2012
  • P-gp (P-glycoprotein) is a member of the ATP binding cassette (ABC) family of transporters. It transports many kinds of anticancer drugs out of the cell. It plays a major role as a cause of multidrug resistance (MDR). MDR function may be a cause of the failure of chemotherapy in cancer and influence pharmacokinetic properties of many drugs. Hence classification of candidate drugs as substrates or nonsubstrate of the P-gp is important in drug development. Therefore to identify whether a compound is a P-gp substrate or not, in silico method is promising. Recursive Partitioning (RP) method was explored for prediction of P-gp substrate. A set of 261 compounds, including 146 substrates and 115 nonsubstrates of P-gp, was used to training and validation. Using molecular descriptors that we can interpret their own meaning, we have established two models for prediction of P-gp substrates. In the first model, we chose only 6 descriptors which have simple physical meaning. In the training set, the overall predictability of our model is 78.95%. In case of test set, overall predictability is 69.23%. Second model with 2D and 3D descriptors shows a little better predictability (overall predictability of training set is 79.29%, test set is 79.37%), the second model with 2D and 3D descriptors shows better discriminating power than first model with only 2D descriptors. This approach will be used to reduce the number of compounds required to be run in the P-gp efflux assay.

Single Image Super Resolution Reconstruction Based on Recursive Residual Convolutional Neural Network

  • Cao, Shuyi;Wee, Seungwoo;Jeong, Jechang
    • 한국방송∙미디어공학회:학술대회논문집
    • /
    • 한국방송∙미디어공학회 2019년도 하계학술대회
    • /
    • pp.98-101
    • /
    • 2019
  • At present, deep convolutional neural networks have made a very important contribution in single-image super-resolution. Through the learning of the neural networks, the features of input images are transformed and combined to establish a nonlinear mapping of low-resolution images to high-resolution images. Some previous methods are difficult to train and take up a lot of memory. In this paper, we proposed a simple and compact deep recursive residual network learning the features for single image super resolution. Global residual learning and local residual learning are used to reduce the problems of training deep neural networks. And the recursive structure controls the number of parameters to save memory. Experimental results show that the proposed method improved image qualities that occur in previous methods.

  • PDF

Performance Evaluation of a Feature-Importance-based Feature Selection Method for Time Series Prediction

  • Hyun, Ahn
    • Journal of information and communication convergence engineering
    • /
    • 제21권1호
    • /
    • pp.82-89
    • /
    • 2023
  • Various machine-learning models may yield high predictive power for massive time series for time series prediction. However, these models are prone to instability in terms of computational cost because of the high dimensionality of the feature space and nonoptimized hyperparameter settings. Considering the potential risk that model training with a high-dimensional feature set can be time-consuming, we evaluate a feature-importance-based feature selection method to derive a tradeoff between predictive power and computational cost for time series prediction. We used two machine learning techniques for performance evaluation to generate prediction models from a retail sales dataset. First, we ranked the features using impurity- and Local Interpretable Model-agnostic Explanations (LIME) -based feature importance measures in the prediction models. Then, the recursive feature elimination method was applied to eliminate unimportant features sequentially. Consequently, we obtained a subset of features that could lead to reduced model training time while preserving acceptable model performance.

2D 칼라 얼굴 영상에서 반복적인 PCA 재구성을 이용한 자동적인 잡음 제거 (Automatic Denoising in 2D Color Face Images Using Recursive PCA Reconstruction)

  • 박현;문영식
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2005년도 추계종합학술대회
    • /
    • pp.1157-1160
    • /
    • 2005
  • The denoising and reconstruction of color images are increasingly studied in the field of computer vision and image processing. Especially, the denoising and reconstruction of color face images are more difficult than those of natural images because of the structural characteristics of human faces as well as the subtleties of color interactions. In this paper, we propose a denoising method based on PCA reconstruction for removing complex color noises on human faces, which is not easy to remove by using vectorial color filters. The proposed method is composed of the following five steps; training of canonical eigenface space using PCA, automatic extracting of face features using active appearance model, relighing of reconstructed color image using bilateral filter, extraction of noise regions using the variance of training data, and reconstruction using partial information of input images (except the noise regions) and blending of the reconstructed image with the original image. Experimental results show that the proposed denosing method efficiently removes complex color noises on input face images.

  • PDF

RPO 기반 강화학습 알고리즘을 이용한 로봇제어 (Robot Control via RPO-based Reinforcement Learning Algorithm)

  • 김종호;강대성;박주영
    • 한국지능시스템학회논문지
    • /
    • 제15권4호
    • /
    • pp.505-510
    • /
    • 2005
  • 제어 입력 선택 문제에 있어서 확률적 전략을 활용하는 RPO(randomized policy optimizer) 기법은 최근에 개발된 강화학습 기법으로써, 많은 적용 사례를 통해서 그 가능성이 입증되고 있다 본 논문에서는, 수정된 RPO 알고리즘을 제안하는데, 이 수정된 알고리즘의 크리틱 네트워크 부분은 RLS(recursive least square) 기법을 통하여 갱신된다. 수정된 RPO 기법의 효율성을 확인하기 위해 Kimura에 의해서 연구된 로봇에 적용하여 매우 우수한 성능을 관찰하였다. 또한, 매트랩 애니메이션 프로그램의 개발을 통해서, 로봇의 이동이 시간에 따라 가속되는 학습 알고리즘의 효과를 시각적으로 확인 할 수 있었다.

Prediction of Acute Toxicity to Fathead Minnow by Local Model Based QSAR and Global QSAR Approaches

  • In, Young-Yong;Lee, Sung-Kwang;Kim, Pil-Je;No, Kyoung-Tai
    • Bulletin of the Korean Chemical Society
    • /
    • 제33권2호
    • /
    • pp.613-619
    • /
    • 2012
  • We applied several machine learning methods for developing QSAR models for prediction of acute toxicity to fathead minnow. The multiple linear regression (MLR) and artificial neural network (ANN) method were applied to predict 96 h $LC_{50}$ (median lethal concentration) of 555 chemical compounds. Molecular descriptors based on 2D chemical structure were calculated by PreADMET program. The recursive partitioning (RP) model was used for grouping of mode of actions as reactive or narcosis, followed by MLR method of chemicals within the same mode of action. The MLR, ANN, and two RP-MLR models possessed correlation coefficients ($R^2$) as 0.553, 0.618, 0.632, and 0.605 on test set, respectively. The consensus model of ANN and two RP-MLR models was used as the best model on training set and showed good predictivity ($R^2$=0.663) on the test set.

유도전동기의 속도 센서리스 제어를 위한 신경회로망 알고리즘의 추정 특성 비교 (Comparison of Different Schemes for Speed Sensorless Control of Induction Motor Drives by Neural Network)

  • 이경훈;국윤상;김윤호;최원범
    • 전력전자학회:학술대회논문집
    • /
    • 전력전자학회 1999년도 전력전자학술대회 논문집
    • /
    • pp.526-530
    • /
    • 1999
  • This paper presents a newly developed speed sensorless drive using Neural Network algorithm. Neural Network algorithm can be divided into three categories. In the first one, a Back Propagation-based NN algorithm is well-known to gradient descent method. In the second scheme, a Extended Kalman Filter-based NN algorithm has just the time varying learning rate. In the last scheme, a Recursive Least Square-based NN algorithm is faster and more stable than the classical back-propagation algorithm for training multilayer perceptrons. The number of iterations required to converge and the mean-squared error between the desired and actual outputs is compared with respect to each method. The theoretical analysis and experimental results are discussed.

  • PDF