• 전자공학회논문지B
• /
• 제31B권8호
• /
• pp.211-218
• /
• 1994

In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

• Journal of Positioning, Navigation, and Timing
• /
• 제8권4호
• /
• pp.193-200
• /
• 2019

The auto-encoder network which is a good candidate to handle the modeling of the signal strength attenuation is designed for denoising and compensating the distortion of the received data. It provides a non-linear mapping function by iteratively learning the encoder and the decoder. The encoder is the non-linear mapping function, and the decoder demands accurate data reconstruction from the representation generated by the encoder. In addition, the adaptive network width which supports the automatic generation of new hidden nodes and pruning of inconsequential nodes is also implemented in the proposed algorithm for increasing the efficiency of the algorithm. Simulation results show that the proposed method can improve the neural network training surface to achieve the highest possible accuracy of the signal modeling compared with the conventional modeling method.

• Journal of information and communication convergence engineering
• /
• 제16권1호
• /
• pp.1-5
• /
• 2018

In radio-over-fiber (RoF) systems, nonlinear compensation is very important to meet the error vector magnitude (EVM) requirement of the mobile network standards. In this study, a nonlinear compensation technique based on an artificial neural network (ANN) is proposed for RoF systems. This technique is based on a backpropagation neural network (BPNN) with one hidden layer and three neuron units in this study. The BPNN obtains the inverse response of the system to compensate for nonlinearities. The EVM of the signal is measured by changing the number of neurons and the hidden layers in a RoF system modeled by a measured data. Based on our simulation results, it is concluded that one hidden layer and three neuron units are adequate for the RoF system. Our results showed that the EVMs were improved from 4.027% to 2.605% by using the proposed ANN compensator.

• Bulletin of the Korean Chemical Society
• /
• 제26권3호
• /
• pp.399-408
• /
• 2005

We have utilized neural network (NN) studies to predict impact sensitivities of various types of explosive molecules. Two hundreds and thirty four explosive molecules have been taken from a single database, and thirty nine molecular descriptors were computed for each explosive molecule. Optimization of NN architecture has been carried out by examining seven different sets of molecular descriptors and varying the number of hidden neurons. For the optimized NN architecture, we have utilized 17 molecular descriptors which were composed of compositional and topological descriptors in an input layer, and 2 hidden neurons in a hidden layer.

• Communications for Statistical Applications and Methods
• /
• 제9권1호
• /
• pp.155-166
• /
• 2002

Neural networks have been studied as a popular tool for classification and they are very flexible. Also, they are used for many applications of pattern classification and pattern recognition. This paper focuses on Bayesian approach to feed-forward neural networks with single hidden layer of units with logistic activation. In this model, we are interested in deciding the number of nodes of neural network model with p input units, one hidden layer with m hidden nodes and one output unit in Bayesian setup for fixed m. Here, we use the latent variable into the prior of the coefficient regression, and we introduce the 'sequential step' which is based on the idea of the data augmentation by Tanner and Wong(1787). The MCMC method(Gibbs sampler and Metropolish algorithm) can be used to overcome the complicated Bayesian computation. Finally, a proposed method is applied to a simulated data.

• 한국자동차공학회논문집
• /
• 제10권2호
• /
• pp.132-140
• /
• 2002

A momentum backpropagation neural network is prepared to carry out real-time dynamics simulations of a passenger car. A full-car model of fifteen degrees of freedom was constructed for vehicle dynamics analysis. Human body dynamics analysis was performed for a male driver(50 percentile Korean adult) restrained by a three point seatbelt system. The trained data using the neural network were obtained using a dynamic solver, ADAMS . The neural network were formed based on the dynamics of the simulator. The optimized hidden layer was obtained by selecting the optimal number of hidden layers. The driving scenario including bump passing and lane changing has been used for the estimation of the proposed neural network. A comparison between the trained data and neural network outputs is found to be satisfactory to show the applicability of the suggested approach.

• 한국정보통신학회논문지
• /
• 제5권4호
• /
• pp.766-776
• /
• 2001

다층 신경회로망의 모델의 구성은 적용분야에 따라서 임의로 선택되어지고, 최적의 모델 구 성은 긴 시간에 걸친 시행착오를 통하여 결정된다. 본 논문에서는 다층 신경회로망 모델의 은닉층 뉴런 수를 학습 과정에서 퍼지 규칙을 이용하여 최적화하는 방식을 제안하였다. 임의의 패턴 문제와 도립진자의 멥핑에 적용하여 제안한 알고리즘의 유용성을 비교 검토하였다.

• Environmental Engineering Research
• /
• 제25권4호
• /
• pp.515-521
• /
• 2020

Nowadays, due to various pollution sources, it is essential for environmental scientists to monitor water quality. Phytoplanktons form the end of the food chain in water bodies and are one of the most important biological indicators in water pollution studies. Chlorophyll-A, a green pigment, is found in all phytoplankton. Chlorophyll-A concentration indicates phytoplankton biomass directly. Therefore, Chlorophyll-A is an indirect indicator of pollutants, including phosphorus and nitrogen, and their refinement and control are important. The present study, Moderate Resolution Imaging Spectroradiometer (MODIS) satellite images were used to estimate the chlorophyll-A concentration in southern coastal waters in the Caspian Sea. For this purpose, Multi-layer perceptron neural networks (NNs) were applied which contained three and four feed-forward layers. The best three-layer NN has 15 neurons in its hidden layer and the best four-layer one has 5 in each. The three- and four- layer networks both resulted in similar root mean square errors (RMSE), 0.1($\frac{{\mu}g}{l}$), however, the four-layer NNs proved superior in terms of R² and also required less training data. Accordingly, a four-layer feed-forward NN with 5 neurons in each hidden layer, is the best network structure for estimating Chlorophyll-A concentration in the southern coastal waters of the Caspian Sea.

• 정보학연구
• /
• 제5권2호
• /
• pp.55-67
• /
• 2002

본 논문에서는 학습계수를 발생한 오차에 따라서 적응적으로 갱신할 수 있는 학습알고리즘에 은닉 노드의 수를 다양하게 변화시킬 수 있는 적응 역 전파(Back Propagation) 알고리즘을 제안하였다. 제안한 알고리즘은 국소점을 벗어날 수 있는 것으로 기대되고, 수렴환경에 알맞은 은닉 노드의 수를 설정할 수 있다. 모의실험에서는 두 가지의 학습패턴을 가지고 실험하였다. 하나는 X-OR 문제에 대한 학습과 또 다른 하나는 $7{\times}5$ 도트 영문자 폰트에 에 대한 학습이다. 두 모의실험에서 국소 점으로 안주할 확률은 감소하였다. 또한, 영문자 폰트 학습에서의 신경회로망은 기존의 역 전파 알고리즘과 HNAD 알고리즘에 비하여 약 41.56%~58.28%정도 학습효율이 향상됨을 고찰하였다.

• 한국멀티미디어학회논문지
• /
• 제21권5호
• /
• pp.571-582
• /
• 2018

Recently, development of deep learning has shown better image classification result than human. According to recent research, a hidden layer of deep learning is deeper, and a preservation of extracted features shows good results. However, in the case of general images, the extracted features are clear and easy to sort. This study aims to classify plant leaf images. This plant leaf image has high similarity in each image. Since plant leaf images have high similarity not only between images of different species but also within the same species, classification accuracy is not increased by simply extending the hidden layer or connecting the layers. Therefore, in this paper, we tried to improve the hidden layer of the algorithm called DenseNet which shows the recent excellent classification results, and compare the results of several different modified layers. The proposed method makes it possible to classify plant leaf images collected in a natural environment more easily and accurately than conventional methods. This results in good classification of plant leaf image data including unnecessary noise obtained in a natural environment.