• 제목/요약/키워드: Adaptive learning interval

검색결과 11건 처리시간 0.025초

Evolvable Neural Networks for Time Series Prediction with Adaptive Learning Interval

  • Seo, Sang-Wook;Lee, Dong-Wook;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제8권1호
    • /
    • pp.31-36
    • /
    • 2008
  • This paper presents adaptive learning data of evolvable neural networks (ENNs) for time series prediction of nonlinear dynamic systems. ENNs are a special class of neural networks that adopt the concept of biological evolution as a mechanism of adaptation or learning. ENNs can adapt to an environment as well as changes in the enviromuent. ENNs used in this paper are L-system and DNA coding based ENNs. The ENNs adopt the evolution of simultaneous network architecture and weights using indirect encoding. In general just previous data are used for training the predictor that predicts future data. However the characteristics of data and appropriate size of learning data are usually unknown. Therefore we propose adaptive change of learning data size to predict the future data effectively. In order to verify the effectiveness of our scheme, we apply it to chaotic time series predictions of Mackey-Glass data.

Evolvable Neural Networks for Time Series Prediction with Adaptive Learning Interval

  • Lee, Dong-Wook;Kong, Seong-G;Sim, Kwee-Bo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2005년도 ICCAS
    • /
    • pp.920-924
    • /
    • 2005
  • This paper presents adaptive learning data of evolvable neural networks (ENNs) for time series prediction of nonlinear dynamic systems. ENNs are a special class of neural networks that adopt the concept of biological evolution as a mechanism of adaptation or learning. ENNs can adapt to an environment as well as changes in the environment. ENNs used in this paper are L-system and DNA coding based ENNs. The ENNs adopt the evolution of simultaneous network architecture and weights using indirect encoding. In general just previous data are used for training the predictor that predicts future data. However the characteristics of data and appropriate size of learning data are usually unknown. Therefore we propose adaptive change of learning data size to predict the future data effectively. In order to verify the effectiveness of our scheme, we apply it to chaotic time series predictions of Mackey-Glass data.

  • PDF

DOA 기반 학습률 조절을 이용한 다채널 음성개선 알고리즘 (Multi-Channel Speech Enhancement Algorithm Using DOA-based Learning Rate Control)

  • 김수환;이영재;김영일;정상배
    • 말소리와 음성과학
    • /
    • 제3권3호
    • /
    • pp.91-98
    • /
    • 2011
  • In this paper, a multi-channel speech enhancement method using the linearly constrained minimum variance (LCMV) algorithm and a variable learning rate control is proposed. To control the learning rate for adaptive filters of the LCMV algorithm, the direction of arrival (DOA) is measured for each short-time input signal and the likelihood function of the target speech presence is estimated to control the filter learning rate. Using the likelihood measure, the learning rate is increased during the pure noise interval and decreased during the target speech interval. To optimize the parameter of the mapping function between the likelihood value and the corresponding learning rate, an exhaustive search is performed using the Bark's scale distortion (BSD) as the performance index. Experimental results show that the proposed algorithm outperforms the conventional LCMV with fixed learning rate in the BSD by around 1.5 dB.

  • PDF

A new structural reliability analysis method based on PC-Kriging and adaptive sampling region

  • Yu, Zhenliang;Sun, Zhili;Guo, Fanyi;Cao, Runan;Wang, Jian
    • Structural Engineering and Mechanics
    • /
    • 제82권3호
    • /
    • pp.271-282
    • /
    • 2022
  • The active learning surrogate model based on adaptive sampling strategy is increasingly popular in reliability analysis. However, most of the existing sampling strategies adopt the trial and error method to determine the size of the Monte Carlo (MC) candidate sample pool which satisfies the requirement of variation coefficient of failure probability. It will lead to a reduction in the calculation efficiency of reliability analysis. To avoid this defect, a new method for determining the optimal size of the MC candidate sample pool is proposed, and a new structural reliability analysis method combining polynomial chaos-based Kriging model (PC-Kriging) with adaptive sampling region is also proposed (PCK-ASR). Firstly, based on the lower limit of the confidence interval, a new method for estimating the optimal size of the MC candidate sample pool is proposed. Secondly, based on the upper limit of the confidence interval, an adaptive sampling region strategy similar to the radial centralized sampling method is developed. Then, the k-means++ clustering technique and the learning function LIF are used to complete the adaptive design of experiments (DoE). Finally, the effectiveness and accuracy of the PCK-ASR method are verified by three numerical examples and one practical engineering example.

행동-보상 학습 기법을 이용한 적응형 VMI 모형 (An Adaptive Vendor Managed Inventory Model Using Action-Reward Learning Method)

  • 김창욱;백준걸;최진성;권익현
    • 한국경영과학회지
    • /
    • 제31권3호
    • /
    • pp.27-40
    • /
    • 2006
  • Today's customer demands in supply chains tend to change quickly, variously even in a short time Interval. The uncertainties of customer demands make it difficult for supply chains to achieve efficient inventory replenishment, resulting in loosing sales opportunity or keeping excessive chain wide inventories. Un this paper, we propose an adaptive vendor managed inventory (VMI) model for a two-echelon supply chain with non-stationary customer demands using the action-reward learning method. The Purpose of this model is to decrease the inventory cost adaptively. The control Parameter, a compensation factor, is designed to adaptively change as customer demand pattern changes. A simulation-based experiment was performed to compare the performance of the adaptive VMI model.

시계열패턴의 학습과 예측을 위한 적응 시간지연 회귀 신경회로망 (An adaptive time-delay recurrent neural network for temporal learning and prediction)

  • 김성식
    • 한국통신학회논문지
    • /
    • 제21권2호
    • /
    • pp.534-540
    • /
    • 1996
  • This paper presents an Adaptive Time-Delay Recurrent Neural Network (ATRN) for learning and recognition of temporal correlations of temporal patterns. The ATRN employs adaptive time-delays and recurrent connections, which are inspired from neurobiology. In the ATRN, the adaptive time-delays make the ATRN choose the optimal values of time-delays for the temporal location of the important information in the input parrerns, and the recurrent connections enable the network to encode and integrate temporal information of sequences which have arbitrary interval time and arbitrary length of temporal context. The ATRN described in this paper, ATNN proposed by Lin, and TDNN introduced by Waibel were simulated and applied to the chaotic time series preditcion of Mackey-Glass delay-differential equation. The simulation results show that the normalized mean square error (NMSE) of ATRN is 0.0026, while the NMSE values of ATNN and TDNN are 0.014, 0.0117, respectively, and in temporal learning, employing recurrent links in the network is more effective than putting multiple time-delays into the neurons. The best performance is attained bythe ATRN. This ATRN will be sell applicable for temporally continuous domains, such as speech recognition, moving object recognition, motor control, and time-series prediction.

  • PDF

Robust Recurrent Wavelet Interval Type-2 Fuzzy-Neural-Network Control for DSP-Based PMSM Servo Drive Systems

  • El-Sousy, Fayez F.M.
    • Journal of Power Electronics
    • /
    • 제13권1호
    • /
    • pp.139-160
    • /
    • 2013
  • In this paper, an intelligent robust control system (IRCS) for precision tracking control of permanent-magnet synchronous motor (PMSM) servo drives is proposed. The IRCS comprises a recurrent wavelet-based interval type-2 fuzzy-neural-network controller (RWIT2FNNC), an RWIT2FNN estimator (RWIT2FNNE) and a compensated controller. The RWIT2FNNC combines the merits of a self-constructing interval type-2 fuzzy logic system, a recurrent neural network and a wavelet neural network. Moreover, it performs the structure and parameter-learning concurrently. The RWIT2FNNC is used as the main tracking controller to mimic the ideal control law (ICL) while the RWIT2FNNE is developed to approximate an unknown dynamic function including the lumped parameter uncertainty. Furthermore, the compensated controller is designed to achieve $L_2$ tracking performance with a desired attenuation level and to deal with uncertainties including approximation errors, optimal parameter vectors and higher order terms in the Taylor series. Moreover, the adaptive learning algorithms for the compensated controller and the RWIT2FNNE are derived by using the Lyapunov stability theorem to train the parameters of the RWIT2FNNE online. A computer simulation and an experimental system are developed to validate the effectiveness of the proposed IRCS. All of the control algorithms are implemented on a TMS320C31 DSP-based control computer. The simulation and experimental results confirm that the IRCS grants robust performance and precise response regardless of load disturbances and PMSM parameters uncertainties.

오차분포 유클리드 거리 기반 학습법의 커널 사이즈 적응 (Adaptive Kernel Estimation for Learning Algorithms based on Euclidean Distance between Error Distributions)

  • 김남용
    • 한국산학기술학회논문지
    • /
    • 제22권5호
    • /
    • pp.561-566
    • /
    • 2021
  • 오차분포 추정을 위한 커널 사이즈는 오차확률밀도 사이의 유클리드 거리를 최소화 알고리즘의 가중치 갱신에 적합한 커널 사이즈가 될 수 없다. 이 논문에서는 MED 알고리즘의 수렴 성능 향상을 위해 적응적으로 커널 사이즈를 갱신하는 방법을 제안하였다. 제안한 방식은 MED 학습 알고리즘의 가중치 갱신을 위해 커널 사이즈에 대한 오차분산의 평균변화율을 도입하여 MED의 오차에 대한 평균전력이 감소하는 방향으로 커널 사이즈를 조절하도록 하였다. 제안된 적응 커널 추정법을 무선통신 채널의 왜곡 보상에 적용하여 학습 성능을 실험하고 그 효능을 밝혔다. 오차분산에 비례한 작은 값을 가지는 기존의 오차분포 추정 위한 최적 커널 사이즈와 달리, 제안한 방법에 의한 커널 사이즈는 MED 가중치 수렴을 위한 적절한 커널 사이즈로 수렴함을 보였다. 실험 결과로부터 제안한 방법이 MED 알고리즘의 커널 사이즈 설정에 따른 민감성을 크게 해결한 방법이라고 볼 수 있다.

Evolvable Neural Networks Based on Developmental Models for Mobile Robot Navigation

  • Lee, Dong-Wook;Seo, Sang-Wook;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제7권3호
    • /
    • pp.176-181
    • /
    • 2007
  • This paper presents evolvable neural networks based on a developmental model for navigation control of autonomous mobile robots in dynamic operating environments. Bio-inspired mechanisms have been applied to autonomous design of artificial neural networks for solving practical problems. The proposed neural network architecture is grown from an initial developmental model by a set of production rules of the L-system that are represented by the DNA coding. The L-system is based on parallel rewriting mechanism motivated by the growth models of plants. DNA coding gives an effective method of expressing general production rules. Experiments show that the evolvable neural network designed by the production rules of the L-system develops into a controller for mobile robot navigation to avoid collisions with the obstacles.

Emotion Recognition Method for Driver Services

  • Kim, Ho-Duck;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제7권4호
    • /
    • pp.256-261
    • /
    • 2007
  • Electroencephalographic(EEG) is used to record activities of human brain in the area of psychology for many years. As technology developed, neural basis of functional areas of emotion processing is revealed gradually. So we measure fundamental areas of human brain that controls emotion of human by using EEG. Hands gestures such as shaking and head gesture such as nodding are often used as human body languages for communication with each other, and their recognition is important that it is a useful communication medium between human and computers. Research methods about gesture recognition are used of computer vision. Many researchers study Emotion Recognition method which uses one of EEG signals and Gestures in the existing research. In this paper, we use together EEG signals and Gestures for Emotion Recognition of human. And we select the driver emotion as a specific target. The experimental result shows that using of both EEG signals and gestures gets high recognition rates better than using EEG signals or gestures. Both EEG signals and gestures use Interactive Feature Selection(IFS) for the feature selection whose method is based on the reinforcement learning.