• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.31B no.8
• /
• pp.211-218
• /
• 1994

In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

• Journal of Positioning, Navigation, and Timing
• /
• v.8 no.4
• /
• pp.193-200
• /
• 2019

The auto-encoder network which is a good candidate to handle the modeling of the signal strength attenuation is designed for denoising and compensating the distortion of the received data. It provides a non-linear mapping function by iteratively learning the encoder and the decoder. The encoder is the non-linear mapping function, and the decoder demands accurate data reconstruction from the representation generated by the encoder. In addition, the adaptive network width which supports the automatic generation of new hidden nodes and pruning of inconsequential nodes is also implemented in the proposed algorithm for increasing the efficiency of the algorithm. Simulation results show that the proposed method can improve the neural network training surface to achieve the highest possible accuracy of the signal modeling compared with the conventional modeling method.

• Journal of information and communication convergence engineering
• /
• v.16 no.1
• /
• pp.1-5
• /
• 2018

In radio-over-fiber (RoF) systems, nonlinear compensation is very important to meet the error vector magnitude (EVM) requirement of the mobile network standards. In this study, a nonlinear compensation technique based on an artificial neural network (ANN) is proposed for RoF systems. This technique is based on a backpropagation neural network (BPNN) with one hidden layer and three neuron units in this study. The BPNN obtains the inverse response of the system to compensate for nonlinearities. The EVM of the signal is measured by changing the number of neurons and the hidden layers in a RoF system modeled by a measured data. Based on our simulation results, it is concluded that one hidden layer and three neuron units are adequate for the RoF system. Our results showed that the EVMs were improved from 4.027% to 2.605% by using the proposed ANN compensator.

• Bulletin of the Korean Chemical Society
• /
• v.26 no.3
• /
• pp.399-408
• /
• 2005

We have utilized neural network (NN) studies to predict impact sensitivities of various types of explosive molecules. Two hundreds and thirty four explosive molecules have been taken from a single database, and thirty nine molecular descriptors were computed for each explosive molecule. Optimization of NN architecture has been carried out by examining seven different sets of molecular descriptors and varying the number of hidden neurons. For the optimized NN architecture, we have utilized 17 molecular descriptors which were composed of compositional and topological descriptors in an input layer, and 2 hidden neurons in a hidden layer.

• Communications for Statistical Applications and Methods
• /
• v.9 no.1
• /
• pp.155-166
• /
• 2002

Neural networks have been studied as a popular tool for classification and they are very flexible. Also, they are used for many applications of pattern classification and pattern recognition. This paper focuses on Bayesian approach to feed-forward neural networks with single hidden layer of units with logistic activation. In this model, we are interested in deciding the number of nodes of neural network model with p input units, one hidden layer with m hidden nodes and one output unit in Bayesian setup for fixed m. Here, we use the latent variable into the prior of the coefficient regression, and we introduce the 'sequential step' which is based on the idea of the data augmentation by Tanner and Wong(1787). The MCMC method(Gibbs sampler and Metropolish algorithm) can be used to overcome the complicated Bayesian computation. Finally, a proposed method is applied to a simulated data.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.10 no.2
• /
• pp.132-140
• /
• 2002

A momentum backpropagation neural network is prepared to carry out real-time dynamics simulations of a passenger car. A full-car model of fifteen degrees of freedom was constructed for vehicle dynamics analysis. Human body dynamics analysis was performed for a male driver(50 percentile Korean adult) restrained by a three point seatbelt system. The trained data using the neural network were obtained using a dynamic solver, ADAMS . The neural network were formed based on the dynamics of the simulator. The optimized hidden layer was obtained by selecting the optimal number of hidden layers. The driving scenario including bump passing and lane changing has been used for the estimation of the proposed neural network. A comparison between the trained data and neural network outputs is found to be satisfactory to show the applicability of the suggested approach.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.5 no.4
• /
• pp.766-776
• /
• 2001

In the constructing of the multi layer neural network, the network topology is often chosen arbitrarily for different applications, and the optimum topology of the network is determined by the long processing of the trial and error. In this paper, we propose the automatic topology construction using the fuzzy rule that optimizes the neurons of hidden layer, and prune the weights connecting the hidden layer and the output layer during the training process. The simulation of pattern recognition, and the experiment of the mapping of the inverted pendulum showed the effectiveness of the proposed method.

• Environmental Engineering Research
• /
• v.25 no.4
• /
• pp.515-521
• /
• 2020

Nowadays, due to various pollution sources, it is essential for environmental scientists to monitor water quality. Phytoplanktons form the end of the food chain in water bodies and are one of the most important biological indicators in water pollution studies. Chlorophyll-A, a green pigment, is found in all phytoplankton. Chlorophyll-A concentration indicates phytoplankton biomass directly. Therefore, Chlorophyll-A is an indirect indicator of pollutants, including phosphorus and nitrogen, and their refinement and control are important. The present study, Moderate Resolution Imaging Spectroradiometer (MODIS) satellite images were used to estimate the chlorophyll-A concentration in southern coastal waters in the Caspian Sea. For this purpose, Multi-layer perceptron neural networks (NNs) were applied which contained three and four feed-forward layers. The best three-layer NN has 15 neurons in its hidden layer and the best four-layer one has 5 in each. The three- and four- layer networks both resulted in similar root mean square errors (RMSE), 0.1($\frac{{\mu}g}{l}$), however, the four-layer NNs proved superior in terms of R² and also required less training data. Accordingly, a four-layer feed-forward NN with 5 neurons in each hidden layer, is the best network structure for estimating Chlorophyll-A concentration in the southern coastal waters of the Caspian Sea.

• The Journal of Information Technology
• /
• v.5 no.2
• /
• pp.55-67
• /
• 2002

This paper presents an adaptive back propagation algorithm that update the learning parameter by the generated error, adaptively and varies the number of hidden layer node. This algorithm is expected to escaping from the local minimum and make the best environment for convergence to be change the number of hidden layer node. On the simulation tested this algorithm on two learning pattern. One was exclusive-OR learning and the other was $7{\times}5$ dot alphabetic font learning. In both examples, the probability of becoming trapped in local minimum was reduce. Furthermore, in alphabetic font learning, the neural network enhanced to learning efficient about 41.56%~58.28% for the conventional back propagation. and HNAD(Hidden Node Adding and Deleting) algorithm.

• Journal of Korea Multimedia Society
• /
• v.21 no.5
• /
• pp.571-582
• /
• 2018

Recently, development of deep learning has shown better image classification result than human. According to recent research, a hidden layer of deep learning is deeper, and a preservation of extracted features shows good results. However, in the case of general images, the extracted features are clear and easy to sort. This study aims to classify plant leaf images. This plant leaf image has high similarity in each image. Since plant leaf images have high similarity not only between images of different species but also within the same species, classification accuracy is not increased by simply extending the hidden layer or connecting the layers. Therefore, in this paper, we tried to improve the hidden layer of the algorithm called DenseNet which shows the recent excellent classification results, and compare the results of several different modified layers. The proposed method makes it possible to classify plant leaf images collected in a natural environment more easily and accurately than conventional methods. This results in good classification of plant leaf image data including unnecessary noise obtained in a natural environment.