• Title/Summary/Keyword: MSE 수렴

Search Result 96, Processing Time 0.021 seconds

Improvement of multi layer perceptron performance using combination of adaptive moments and improved harmony search for prediction of Daecheong Dam inflow (대청댐 유입량 예측을 위한 Adaptive Moments와 Improved Harmony Search의 결합을 이용한 다층퍼셉트론 성능향상)

  • Lee, Won Jin;Lee, Eui Hoon
    • Journal of Korea Water Resources Association
    • /
    • v.56 no.1
    • /
    • pp.63-74
    • /
    • 2023
  • High-reliability prediction of dam inflow is necessary for efficient dam operation. Recently, studies were conducted to predict the inflow of dams using Multi Layer Perceptron (MLP). Existing studies used the Gradient Descent (GD)-based optimizer as the optimizer among MLP operators to find the optimal correlation between data. However, the GD-based optimizers have disadvantages in that the prediction performance is deteriorated due to the possibility of convergence to the local optimal value and the absence of storage space. This study improved the shortcomings of the GD-based optimizer by developing Adaptive moments combined with Improved Harmony Search (AdamIHS), which combines Adaptive moments among GD-based optimizers and Improved Harmony Search (IHS). In order to evaluate the learning and prediction performance of MLP using AdamIHS, Daecheong Dam inflow was learned and predicted and compared with the learning and prediction performance of MLP using GD-based optimizer. Comparing the learning results, the Mean Squared Error (MSE) of MLP, which is 5 hidden layers using AdamIHS, was the lowest at 11,577. Comparing the prediction results, the average MSE of MLP, which is one hidden layer using AdamIHS, was the lowest at 413,262. Using AdamIHS developed in this study, it will be possible to show improved prediction performance in various fields.

Development of new artificial neural network optimizer to improve water quality index prediction performance (수질 지수 예측성능 향상을 위한 새로운 인공신경망 옵티마이저의 개발)

  • Ryu, Yong Min;Kim, Young Nam;Lee, Dae Won;Lee, Eui Hoon
    • Journal of Korea Water Resources Association
    • /
    • v.57 no.2
    • /
    • pp.73-85
    • /
    • 2024
  • Predicting water quality of rivers and reservoirs is necessary for the management of water resources. Artificial Neural Networks (ANNs) have been used in many studies to predict water quality with high accuracy. Previous studies have used Gradient Descent (GD)-based optimizers as an optimizer, an operator of ANN that searches parameters. However, GD-based optimizers have the disadvantages of the possibility of local optimal convergence and absence of a solution storage and comparison structure. This study developed improved optimizers to overcome the disadvantages of GD-based optimizers. Proposed optimizers are optimizers that combine adaptive moments (Adam) and Nesterov-accelerated adaptive moments (Nadam), which have low learning errors among GD-based optimizers, with Harmony Search (HS) or Novel Self-adaptive Harmony Search (NSHS). To evaluate the performance of Long Short-Term Memory (LSTM) using improved optimizers, the water quality data from the Dasan water quality monitoring station were used for training and prediction. Comparing the learning results, Mean Squared Error (MSE) of LSTM using Nadam combined with NSHS (NadamNSHS) was the lowest at 0.002921. In addition, the prediction rankings according to MSE and R2 for the four water quality indices for each optimizer were compared. Comparing the average of ranking for each optimizer, it was confirmed that LSTM using NadamNSHS was the highest at 2.25.

Precoding for a Non-regenerative MIMO Relay in a Spectrum Sharing Cognitive Radio Network (스펙트럼 공유 인지라디오 네트워크에서의 비재생적 다중안테나 중계 시스템을 위한 프리코딩)

  • Lee, Panhyung;Lee, Jae Hong
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2013.06a
    • /
    • pp.29-31
    • /
    • 2013
  • 본 논문에서는 기존라디오(primary) 네트워크와 스펙트럼을 공유하는(spectrum sharing) 인지라디오(cognitive radio) 네트워크에서 비재생적(non-regenerative) 다중안테나 중계 (relay) 시스템을 위한 소스(source) 및 중계기 프리코딩(precoding) 기법을 제안한다. 제안된 기법은 소스와 중계기 프리코딩 행렬의 최적해를 구하기 위해 QCQP(Quadratically Constrained Quadratic Programming) 문제를 통해 구한다. 제안된 기법은 기존라디오 수신기에서의 간섭세기 제한을 만족하면서 낮은 MSE(Mean squared error)와 높은 MI(Mutual Information)를 달성함을 모의실험결과를 통해 보인다. 또한 아주 빠른 속도로 최적해로 수렴함을 보이고 있다.

  • PDF

A Study on the Echo Cancellation using the Decision Feedback (결정궤환방식을 이용한 반향제거에 관한 연구)

  • 강석흠;이명수;강창언
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.13 no.3
    • /
    • pp.193-203
    • /
    • 1988
  • In this paper, an echo canceller(EC) using decision feedback at the ISDN U-interface is presented and its performance based on the stochastic iteration algorithm is analyzed, and compared with the other conventional EC. The steady state mean-squared error(MSE) by the analytical resutls on the decision feedback-EC turns out to be smaller than that of the other linear EC. The performance of the ECs with the same convergence factor are almost the same regardless of different channel characteristics.

  • PDF

Characteristic Analysis of Normalized D-QR-RLS Algorithm(I) (정규화된 D-QR-RLS 알고리즘의 특성 분석(I))

  • Ahn, Bong-Man;Hwang, Jee-Won;Cho, Ju-Phil
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.32 no.8C
    • /
    • pp.782-787
    • /
    • 2007
  • This paper presents the D(Diagonal)-QR-RLS algorithm which normalizes the fast algorithm minimizes the MSE by using Givens rotated inputs and analyzes its characteristic. This proposed one has computational complexity of O(N) and the merit that it obtains the coefficients of TDL filter directly. Although this proposed normalized algorithm has the similar form to NLMS algorithm, we can see that D-QR-RLS has superior convergence characteristic to NLMS by computer simulation.

Proposal Of Optimum Equalizer Hardware Architecture for Cable Modem and Analysis of Various LMS Algorithms (케이블모뎀용 등화기에 적용되는 다양한 LMS알고리즘에 관한 성능평가 및 최적의 등화기 하드웨어구조 제안)

  • Cho, Yeon-Gon;Yu, Hyeong-Seok;Kim, Byung-Wook;Cho, Jun-Dong;Kim, Jea-Woo;Lee, Jae-Kon;Park, Hyun-Chul
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.2C
    • /
    • pp.150-159
    • /
    • 2002
  • This paper presents the convergence time, SER(Symbol Error Rate), MSE(Mean Square Error), hardware complexity and step-size(${\mu}$) about various LMS(Least Mean Square) algorithms in FS-DFE(Fractionally Spaced-Decision Feedback Equalize) for Cable Modem based on MCNS(Multimedia Cable Network System) DOCSIS(Data Over Cable Service Interface Specification) v1.0/v1.1 standards. We designed and simulated using ${SPW}^{TM}$ and synthesized using STD90 library through ${SYNOPSYS}^{TM}$. And also, we adopted the time-multiplexed multiplication and tap shared architecture in order to achieve the low hardware complexity. Simulation results show that DS-LMS algorithms[1][3] is the optimum solution about performace and hardware size. in high order QAM applications. Finally, we achieved area saving about 58% using DS-LMS algorithm compare with conventional equalizer architecture.

Performance Analysis of Maximum Zero-Error Probability Algorithm for Blind Equalization in Impulsive Noise Channels (충격성 잡음 채널의 블라인드 등화를 위한 최대 영-확률 알고리듬에 대한 성능 분석)

  • Kim, Nam-Yong
    • Journal of Internet Computing and Services
    • /
    • v.11 no.5
    • /
    • pp.1-8
    • /
    • 2010
  • This paper presentsthe performance study of blind equalizer algorithms for impulsive-noise environments based on Gaussian kernel and constant modulus error(CME). Constant modulus algorithm(CMA) based on CME and mean squared error(MSE) criterion fails in impulsive noise environment. Correntropy blind method recently introduced for impulsive-noise resistance has shown in PAM system not very satisfying results. It is revealed in theoretical and simulation analysis that the maximization of zero-error probability based on CME(MZEP-CME) originally proposed for Gaussian noise environments produces superior performance in impulsive noise channels as well. Gaussian kernel of MZEP-CME has a strong effect of becoming insensitive to the large differences between the power of impulse-infected outputs and the constant modulus value.

A Study on DCT Hierarchical LMS DFE Algorithm to Improve the Performance of ATSC Digital TV Broadcasting (ATSC 디지털 TV 방송수신 성능개선을 위한 DCT 계층적 LMS DFE 알고리즘 연구)

  • 김재욱;서종수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.28 no.7A
    • /
    • pp.529-536
    • /
    • 2003
  • In this Paper, a new DCT HLMS DFE(Discrete Cosine Transform Hierarchical Least Mean Square Decision Feedback Equalizer) algorithm is proposed to improve the convergence speed and MSE(Mean Square Error) performance of a receive channel equalizer in ATSC(Advanced Television System Committee) 8VSB(Vestigial Side Band) digital terrestrial TV system. The proposed algorithm reduces the eigenvalue range of input data autocorrelation by transforming LMS (Least Mean Square) DFE into the subfilter of hierarchical structure. Moreover, the use of DCT and power estimation algorithm makes it possible to reduce the eigenvalue deviation of input data which results from distortion and delay of the receive signal in the miulti-path environment. Simulation results show that proposed DCT HLMS DFE has SNR improvement of approximately 3.8dB, 5dB and 2dB as compared to LMS DFE when the equalized symbol error rate is 0.2 in ATTC defined digital terrestrial TV broadcasting channels A, B and F, respectively.

A Performance Evaluation of mDSE-MMA Adaptive Equalization Algorithm in QAM Signal (QAM 신호에서 mDSE-MMA 적응 등화 알고리즘의 성능 평가)

  • Lim, Seung-Gag
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.2
    • /
    • pp.103-108
    • /
    • 2020
  • This paper related with the performance evaluation of mDSE-MMA adaptive equalization algorithm which is possible to reduce the distortion that occurs in nonlinear communication channel like as additive noise, intersymbol interference and fading when transmitting the QAM signal. The DSE-MMA algorithm is possible to reduce the computational load compared to the presently MMA algorithm, it has the degraded equalization performance by this. In order to improve the performance degradation of DSE-MMA, the mDSE-MMA controls the step size according to the existence of arbitrary radius circle of equalizer output is centered at transmitted symbol point. The performance of proposed mDSE-MMA algorithm were compared to present DSE-MMA using the same channel and noise environment by computer simulation. For this, the recoverd signal constellation which is the output of equalizer, residual isi and MD, MSE learning curve which is represents the convergence performance and SER were applied as performance index. As a result of simulation, the mDSE-MMA has more superior to the DSE-MMA in every performance index.

Performance analysis of an MC-CDMA system by using an adaptive beamforming technique (적응 빔 형성 기법을 사용한 MC-CDMA 시스템의 성능분석)

  • 김찬규;조용수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.24 no.10A
    • /
    • pp.1471-1479
    • /
    • 1999
  • This paper presents an adaptive beamforming algorithm for an MC-CDMA system with an adaptive array antenna. By employing an antenna array at the receiver of an MC-CDMA system, the performance of an MC-CDMA system, which is known to be effective for high data rate transmission due to its robustness to multipath fading and its simplicity for using a simple one-tap equalizer, is shown to be significantly improved. The proposed algorithm for adaptive beanforming in an MC-CDMA system is derived by (1) calculating the error signals between the pilot symbols of desired user and the received pilot signals in frequency domain, (2) transforming the frequency-domain error signals into time-domain error signals, (3) updating the filter coefficients of the adaptive beamformer in the direction of minimizing the MSE. Convergence behavior and performance improvement of the proposed approach are demonstrated through computer simulation by applying it to the conventional MC-CDMA system.

  • PDF