• Title/Summary/Keyword: stochastic gradient (SG)

Search Result 7, Processing Time 0.017 seconds

Learning Behaviors of Stochastic Gradient Radial Basis Function Network Algorithms for Odor Sensing Systems

  • Kim, Nam-Yong;Byun, Hyung-Gi;Kwon, Ki-Hyeon
    • ETRI Journal
    • /
    • v.28 no.1
    • /
    • pp.59-66
    • /
    • 2006
  • Learning behaviors of a radial basis function network (RBFN) using a singular value decomposition (SVD) and stochastic gradient (SG) algorithm, together named RBF-SVD-SG, for odor sensing systems are analyzed, and a fast training method is proposed. RBF input data is from a conducting polymer sensor array. It is revealed in this paper that the SG algorithm for the fine-tuning of centers and widths still shows ill-behaving learning results when a sufficiently small convergence coefficient is not used. Since the tuning of centers in RBFN plays a dominant role in the performance of RBFN odor sensing systems, our analysis is focused on the center-gradient variance of the RBFN-SVD-SG algorithm. We found analytically that the steadystate weight fluctuation and large values of a convergence coefficient can lead to an increase in variance of the center-gradient estimate. Based on this analysis, we propose to use the least mean square algorithm instead of SVD in adjusting the weight for stable steady-state weight behavior. Experimental results of the proposed algorithm have shown faster learning speed and better classification performance.

  • PDF

An Adaptive Radial Basis Function Network algorithm for nonlinear channel equalization

  • Kim Nam yong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.3C
    • /
    • pp.141-146
    • /
    • 2005
  • The authors investigate the convergence speed problem of nonlinear adaptive equalization. Convergence constraints and time constant of radial basis function network using stochastic gradient (RBF-SG) algorithm is analyzed and a method of making time constant independent of hidden-node output power by using sample-by-sample node output power estimation is derived. The method for estimating the node power is to use a single-pole low-pass filter. It is shown by simulation that the proposed algorithm gives faster convergence and lower minimum MSE than the RBF-SG algorithm.

Step-Size Control for Width Adaptation in Radial Basis Function Networks for Nonlinear Channel Equalization

  • Kim, Nam-Yong
    • Journal of Communications and Networks
    • /
    • v.12 no.6
    • /
    • pp.600-604
    • /
    • 2010
  • A method of width adaptation in the radial basis function network (RBFN) using stochastic gradient (SG) algorithm is introduced. Using Taylor's expansion of error signal and differentiating the error with respect to the step-size, the optimal time-varying step-size of the width in RBFN is derived. The proposed approach to adjusting widths in RBFN achieves superior learning speed and the steady-state mean square error (MSE) performance in nonlinear channel environment. The proposed method has shown enhanced steady-state MSE performance by more than 3 dB in both nonlinear channel environments. The results confirm that controlling over step-size of the width in RBFN by the proposed algorithm can be an effective approach to enhancement of convergence speed and the steady-state value of MSE.

An Identification Technique Based on Adaptive Radial Basis Function Network for an Electronic Odor Sensing System

  • Byun, Hyung-Gi
    • Journal of Sensor Science and Technology
    • /
    • v.20 no.3
    • /
    • pp.151-155
    • /
    • 2011
  • A variety of pattern recognition algorithms including neural networks may be applicable to the identification of odors. In this paper, an identification technique for an electronic odor sensing system applicable to wound state monitoring is presented. The performance of the radial basis function(RBF) network is highly dependent on the choice of centers and widths in basis function. For the fine tuning of centers and widths, those parameters are initialized by an ill-conditioned genetic fuzzy c-means algorithm, and the distribution of input patterns in the very first stage, the stochastic gradient(SG), is adapted. The adaptive RBF network with singular value decomposition(SVD), which provides additional adaptation capabilities to the RBF network, is used to process data from array-based gas sensors for early detection of wound infection in burn patients. The primary results indicate that infected patients can be distinguished from uninfected patients.

Blind Adaptive Receiver based on Constant Modulus for Downlink MC-CDMA Systems (하향링크 MC-CDMA 시스템을 위한 CM 기반의 블라인드 적응 수신기)

  • Seo, Bangwon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.19 no.5
    • /
    • pp.47-54
    • /
    • 2019
  • In this paper, we consider a constant modulus (CM) based blind adaptive receiver design for downlink multi-carrier code-division multiple access (MC-CDMA) systems employing simple space-time block coding (STBC). In the paper, filter weight vectors used for the detection of the transmitted symbols are partitioned into its subvectors and then, special relations among the optimal subvectors minimizing the CM metric are derived. Using the special relations, we present a modified CM metric and propose a new blind adaptive stochastic-gradient CM algorithm (SG-CMA) by minimizing the modified CM metric. The proposed blind adaptive SG-CMA has faster convergence rate than the conventional SG-CMA because the filter weight vectors of the proposed scheme are updated in the region of satisfying the derived special relations. Computer simulation results are given to verify the superiority of the proposed SG-CMA.

Implementation of Elbow Method to improve the Gases Classification Performance based on the RBFN-NSG Algorithm

  • Jeon, Jin-Young;Choi, Jang-Sik;Byun, Hyung-Gi
    • Journal of Sensor Science and Technology
    • /
    • v.25 no.6
    • /
    • pp.431-434
    • /
    • 2016
  • Currently, the radial basis function network (RBFN) and various other neural networks are employed to classify gases using chemical sensors arrays, and their performance is steadily improving. In particular, the identification performance of the RBFN algorithm is being improved by optimizing parameters such as the center, width, and weight, and improved algorithms such as the radial basis function network-stochastic gradient (RBFN-SG) and radial basis function network-normalized stochastic gradient (RBFN-NSG) have been announced. In this study, we optimized the number of centers, which is one of the parameters of the RBFN-NSG algorithm, and observed the change in the identification performance. For the experiment, repeated measurement data of 8 samples were used, and the elbow method was applied to determine the optimal number of centers for each sample of input data. The experiment was carried out in two cases(the only one center per sample and the optimal number of centers obtained by elbow method), and the experimental results were compared using the mean square error (MSE). From the results of the experiments, we observed that the case having an optimal number of centers, obtained using the elbow method, showed a better identification performance than that without any optimization.

Post-processing Technique for Improving the Odor-identification Performance based on E-Nose System

  • Byun, Hyung-Gi
    • Journal of Sensor Science and Technology
    • /
    • v.24 no.6
    • /
    • pp.368-372
    • /
    • 2015
  • In this paper, we proposed a post-processing technique for improving classification performance of electronic nose (E-Nose) system which may be occurred drift signals from sensor array. An adaptive radial basis function network using stochastic gradient (SG) and singular value decomposition (SVD) is applied to process signals from sensor array. Due to drift from sensor's aging and poisoning problems, the final classification results may be showed bias and fluctuations. The predicted classification results with drift are quantized to determine which identification level each class is on. To mitigate sharp fluctuations moving-averaging (MA) technique is applied to quantized identification results. Finally, quantization and some edge correction process are used to decide levels of the fluctuation-smoothed identification results. The proposed technique has been indicated that E-Nose system was shown correct odor identification results even if drift occurred in sensor array. It has been confirmed throughout the experimental works. The enhancements have produced a very robust odor identification capability which can compensate for decision errors induced from drift effects with sensor array in electronic nose system.