• 제목/요약/키워드: Adaptive learning rate

검색결과 125건 처리시간 0.023초

Active Random Noise Control using Adaptive Learning Rate Neural Networks

  • Sasaki, Minoru;Kuribayashi, Takumi;Ito, Satoshi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2005년도 ICCAS
    • /
    • pp.941-946
    • /
    • 2005
  • In this paper an active random noise control using adaptive learning rate neural networks is presented. The adaptive learning rate strategy increases the learning rate by a small constant if the current partial derivative of the objective function with respect to the weight and the exponential average of the previous derivatives have the same sign, otherwise the learning rate is decreased by a proportion of its value. The use of an adaptive learning rate attempts to keep the learning step size as large as possible without leading to oscillation. It is expected that a cost function minimize rapidly and training time is decreased. Numerical simulations and experiments of active random noise control with the transfer function of the error path will be performed, to validate the convergence properties of the adaptive learning rate Neural Networks. Control results show that adaptive learning rate Neural Networks control structure can outperform linear controllers and conventional neural network controller for the active random noise control.

  • PDF

적응 뉴럴 컴퓨팅 방법을 이용한 동적 시스템의 특성 모델링 (Characteristics Modeling of Dynamic Systems Using Adaptive Neural Computation)

  • 김병호
    • 제어로봇시스템학회논문지
    • /
    • 제13권4호
    • /
    • pp.309-314
    • /
    • 2007
  • This paper presents an adaptive neural computation algorithm for multi-layered neural networks which are applied to identify the characteristic function of dynamic systems. The main feature of the proposed algorithm is that the initial learning rate for the employed neural network is assigned systematically, and also the assigned learning rate can be adjusted empirically for effective neural leaning. By employing the approach, enhanced modeling of dynamic systems is possible. The effectiveness of this approach is veri tied by simulations.

A novel visual tracking system with adaptive incremental extreme learning machine

  • Wang, Zhihui;Yoon, Sook;Park, Dong Sun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제11권1호
    • /
    • pp.451-465
    • /
    • 2017
  • This paper presents a novel discriminative visual tracking algorithm with an adaptive incremental extreme learning machine. The parameters for an adaptive incremental extreme learning machine are initialized at the first frame with a target that is manually assigned. At each frame, the training samples are collected and random Haar-like features are extracted. The proposed tracker updates the overall output weights for each frame, and the updated tracker is used to estimate the new location of the target in the next frame. The adaptive learning rate for the update of the overall output weights is estimated by using the confidence of the predicted target location at the current frame. Our experimental results indicate that the proposed tracker can manage various difficulties and can achieve better performance than other state-of-the-art trackers.

DOA 기반 학습률 조절을 이용한 다채널 음성개선 알고리즘 (Multi-Channel Speech Enhancement Algorithm Using DOA-based Learning Rate Control)

  • 김수환;이영재;김영일;정상배
    • 말소리와 음성과학
    • /
    • 제3권3호
    • /
    • pp.91-98
    • /
    • 2011
  • In this paper, a multi-channel speech enhancement method using the linearly constrained minimum variance (LCMV) algorithm and a variable learning rate control is proposed. To control the learning rate for adaptive filters of the LCMV algorithm, the direction of arrival (DOA) is measured for each short-time input signal and the likelihood function of the target speech presence is estimated to control the filter learning rate. Using the likelihood measure, the learning rate is increased during the pure noise interval and decreased during the target speech interval. To optimize the parameter of the mapping function between the likelihood value and the corresponding learning rate, an exhaustive search is performed using the Bark's scale distortion (BSD) as the performance index. Experimental results show that the proposed algorithm outperforms the conventional LCMV with fixed learning rate in the BSD by around 1.5 dB.

  • PDF

적응 학습률을 이용한 신경회로망의 학습성능개선 및 로봇 제어 (Improvement of learning performance and control of a robot manipulator using neural network with adaptive learning rate)

  • 이보희;이택승;김진걸
    • 제어로봇시스템학회논문지
    • /
    • 제3권4호
    • /
    • pp.363-372
    • /
    • 1997
  • In this paper, the design and the implementation of the adaptive learning rate neural network controller for an articulate robot, which is being developed (or) has been developed in our Automatic Control Laboratory, are mainly discussed. The controller reduces software computational load via distributed processing method using multiple CPU's, and simplifies hardware structures by the time-division control with TMS32OC31 DSP chip. Proposed neural network controller with adaptive learning rate structure using expert's heuristics can improve learning speed. The proposed controller verifies its superiority by comparing response characteristics of conventional controller with those of the proposed controller that are obtained from the experiments for the 5 axis vertical articulated robot. We, also, present the generalization property of proposed controller for unlearned trajectory and the change of load through experimental data.

  • PDF

An Adaptive Learning Rate with Limited Error Signals for Training of Multilayer Perceptrons

  • Oh, Sang-Hoon;Lee, Soo-Young
    • ETRI Journal
    • /
    • 제22권3호
    • /
    • pp.10-18
    • /
    • 2000
  • Although an n-th order cross-entropy (nCE) error function resolves the incorrect saturation problem of conventional error backpropagation (EBP) algorithm, performance of multilayer perceptrons (MLPs) trained using the nCE function depends heavily on the order of nCE. In this paper, we propose an adaptive learning rate to markedly reduce the sensitivity of MLP performance to the order of nCE. Additionally, we propose to limit error signal values at out-put nodes for stable learning with the adaptive learning rate. Through simulations of handwritten digit recognition and isolated-word recognition tasks, it was verified that the proposed method successfully reduced the performance dependency of MLPs on the nCE order while maintaining advantages of the nCE function.

  • PDF

오류 역전파 알고리즘의 n차 크로스-엔트로피 오차신호에 대한 민감성 제거를 위한 가변 학습률 및 제한된 오차신호 (Adaptive Learning Rate and Limited Error Signal to Reduce the Sensitivity of Error Back-Propagation Algorithm on the n-th Order Cross-Entropy Error)

  • 오상훈;이수영
    • 전자공학회논문지C
    • /
    • 제35C권6호
    • /
    • pp.67-75
    • /
    • 1998
  • 다층퍼셉트론의 학습에서 나타나는 출력노드의 부적절한 포화를 해결하기 위해서 n차 크로스-엔트로피 오차함수가 제안되었으나, 이 오차함수를 이용한 학습성능은 오차함수의 차수에 민감하여 적절한 차수를 결정해야 하는 문제점이 있다. 이 논문에서는, 학습의 진행에 따라 학습률을 가변시키는 새로운 방법을 제시하여 다층퍼셉트론의 학습성능이 n차 크로스-엔트로피 오차함수의 차수에 덜 민감하도록 한다. 또한, 가변학습률이 매우 커지는 경우에 학습이 불안정해지는 것을 방지하기 위해서 오차신호의 크기를 제한하는 방법을 제시한다. 마지막으로, 필기체 숫자 인식 문제와 갑상선 진단 문제의 시뮬레이션으로 제안한 방법의 효용성을 검증한다.

  • PDF

ATM 망에서 뉴럴 네트워크를 이용한 적응 폭주제어 (The Adaptive Congestion Control Using Neural Network in ATM network)

  • 이용일;김영권
    • 전기전자학회논문지
    • /
    • 제2권1호
    • /
    • pp.134-138
    • /
    • 1998
  • 트래픽의 통계적 변동과 고도의 시변 특성 때문에, 최소의 반응시간을 가지고 고도의 동적인 기술과 적응 그리고 학습능력을 요구하는 네트워크의 자원으로 관리하도록 한다. 뉴럴 네트워크는 ATM 셀 도착율과 큐 길이를 정규화시키며, 그것은 적응 학습 알고리즘을 가지고, ATM 네트워크에서 발생되는 특주를 방지하기 위한 방법을 연구한다.

  • PDF

Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate

  • No, Gun-hyo;Hong, Yong-hee;Park, Jin-ho;Jhee, Ho-jin
    • 한국컴퓨터정보학회논문지
    • /
    • 제23권7호
    • /
    • pp.81-90
    • /
    • 2018
  • In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.

적응형 온라인 학습환경에서 학습자 특성 및 AI튜터 추천문항 학습활동의 학업성취도 예측력 탐색 (An Inquiry into Prediction of Learner's Academic Performance through Learner Characteristics and Recommended Items with AI Tutors in Adaptive Learning)

  • 최민선;정재삼
    • 한국IT서비스학회지
    • /
    • 제20권4호
    • /
    • pp.129-140
    • /
    • 2021
  • Recently, interest in AI tutors is rising as a way to bridge the educational gap in school settings. However, research confirming the effectiveness of AI tutors is lacking. The purpose of this study is to explore how effective learner characteristics and recommended item learning activities are in predicting learner's academic performance in an adaptive online learning environment. This study proposed the hypothesis that learner characteristics (prior knowledge, midterm evaluation) and recommended item learning activities (learning time, correct answer check, incorrect answer correction, satisfaction, correct answer rate) predict academic achievement. In order to verify the hypothesis, the data of 362 learners were analyzed by collecting data from the learning management system (LMS) from the perspective of learning analytics. For data analysis, regression analysis was performed using the regsubset function provided by the leaps package of the R program. The results of analyses showed that prior knowledge, midterm evaluation, correct answer confirmation, incorrect answer correction, and satisfaction had a positive effect on academic performance, but learning time had a negative effect on academic performance. On the other hand, the percentage of correct answers did not have a significant effect on academic performance. The results of this study suggest that recommended item learning activities, which mean behavioral indicators of interaction with AI tutors, are important in the learning process stage to increase academic performance in an adaptive online learning environment.