• Journal of Advanced Marine Engineering and Technology
• /
• v.21 no.1
• /
• pp.66-70
• /
• 1997

In this paper a new learning algorithm for curvature smoothing and improved generalization for multi-layer neural networks is proposed. To enhance the generalization ability a constraint term of hidden neuron activations is added to the conventional output error, which gives the curvature smoothing characteristics to multi-layer neural networks. When the total cost consisted of the output error and hidden error is minimized by gradient-descent methods, the additional descent term gives not only the Hebbian learning but also the synaptic weight decay. Therefore it incorporates error back-propagation, Hebbian, and weight decay, and additional computational requirements to the standard error back-propagation is negligible. From the computer simulation of the time series prediction with Santafe competition data it is shown that the proposed learning algorithm gives much better generalization performance.

• 제어로봇시스템학회:학술대회논문집
• /
• 1993.10a
• /
• pp.772-777
• /
• 1993

This paper presents a neuro-fuzzy modelling method that determines chemicals dosing model based on historical operation data for effective water quality control in water treatment system and calculates automatically the amount of optimum chemicals dosing against the changes of raw water qualities and flow rate. The structure identification in the modelling by means of neuro-fuzzy reasing is performed by Genetic Algorithm(GA) and Complex Method in which the numbers of hidden layer and its hidden nodes, learning rate and connection pattern between input layer and output layer are identified. The learning network is implemented utilizing Back Propagation(BP) algorithm. The effectiveness of the proposed modelling scheme and the feasibility of the acquired neuro-fuzzy network is evaluated through computer simulation for chemicals dosing control in water treatment system.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.4 no.1
• /
• pp.145-154
• /
• 2000

In this paper we proposed the orthogonal neural network(ONN) to control and identify the unknown controlled system. The proposed ONN used the buffer layer in front of the hidden layer and the hidden layer used the sigmoid function and its derivative a derived RBF that is a derivative of the sigmoid function. In order to verify the property of the proposed, it is examined by simulation results of the Narendra model. Controlled system is composed of ONN and confirmed its usefulness through simulation and experimental results.

• International journal of advanced smart convergence
• /
• v.7 no.4
• /
• pp.57-65
• /
• 2018

Artificial neural network is inspired by the biological neural network. For simplicity, in computer science, it is represented as a set of layers. Many research has been made in evaluating the number of neurons in the hidden layer but still, none was accurate. Several methods are used until now which do not provide the exact formula for calculating the number of thehidden layer as well as the number of neurons in each hidden layer. In this paper model selection approach was presented. Proposed model is based on geographical analysis of decision boundary. Proposed model selection method is useful when we know the distribution of the training data set. To evaluate the performance of the proposed method we compare it to the traditional architecture on IRIS classification problem. According to the experimental result on Iris data proposed method is turned out to be a powerful one.

• International Journal of Internet, Broadcasting and Communication
• /
• v.14 no.3
• /
• pp.143-148
• /
• 2022

In this paper, we employ deep neural network (DNN) to discern Android user interaction data distribution from artificial data distribution. We utilize real Android user interaction trace dataset collected from [1] to evaluate our DNN design. In particular, we use sequential model with 4 dense hidden layers and 1 dense output layer in TensorFlow and Keras. We also deploy sigmoid activation function for a dense output layer with 1 neuron and ReLU activation function for each dense hidden layer with 32 neurons. Our evaluation shows that our DNN design fulfills high test accuracy of at least 0.9955 and low test loss of at most 0.0116 in all cases of artificial data distributions.

• Journal of Biosystems Engineering
• /
• v.37 no.4
• /
• pp.271-278
• /
• 2012

Worldwide trends in animal welfare have resulted in an increased interest in individual management of sows housed in groups within hog barns. Estrus detection has been shown to be one of the greatest determinants of sow productivity. Purpose: We conducted this study to develop a method that can automatically detect the estrus state of a sow by selecting optimal texture parameters from images of a sow's pudendum and by optimizing the number of neurons in the hidden layer of an artificial neural network. Methods: Texture parameters were analyzed according to changes in a sow's pudendum in estrus such as mucus secretion and expansion. Of the texture parameters, eight gray level co-occurrence matrix (GLCM) parameters were used for image analysis. The image states were classified into ten grades for each GLCM parameter, and an artificial neural network was formed using the values for each grade as inputs to discriminate the estrus state of sows. The number of hidden layer neurons in the artificial neural network is an important parameter in neural network design. Therefore, we determined the optimal number of hidden layer units using a trial and error method while increasing the number of neurons. Results: Fifteen hidden layers were determined to be optimal for use in the artificial neural network designed in this study. Thirty images of 10 sows were used for learning, and then 30 different images of 10 sows were used for verification. Conclusions: For learning, the back propagation neural network (BPN) algorithm was used to successful estimate six texture parameters (homogeneity, angular second moment, energy, maximum probability, entropy, and GLCM correlation). Based on the verification results, homogeneity was determined to be the most important texture parameter, and resulted in an estrus detection rate of 70%.

• The Journal of the Acoustical Society of Korea
• /
• v.28 no.1
• /
• pp.32-43
• /
• 2009

In this paper, we improve the performance of cardiac disorder classification by continuous heart sound signals using automatic segmentation and extreme learning machine (ELM). The accuracy of the conventional cardiac disorder classification systems degrades because murmurs and click sounds contained in the abnormal heart sound signals cause incorrect or missing starting points of the first (S1) and the second heart pulses (S2) in the automatic segmentation stage, In order to reduce the performance degradation due to segmentation errors, we find the positions of the S1 and S2 pulses, modify them using the time difference of S1 or S2, and extract a single period of heart sound signals. We then obtain a feature vector consisting of the mel-scaled filter bank energy coefficients and the envelope of uniform-sized sub-segments from the single-period heart sound signals. To classify the heart disorders, we use ELM with a single hidden layer. In cardiac disorder classification experiments with 9 cardiac disorder categories, the proposed method shows the classification accuracy of 81.6% and achieves the highest classification accuracy among ELM, multi-layer perceptron (MLP), support vector machine (SVM), and hidden Markov model (HMM).

• Journal of the Korean Geophysical Society
• /
• v.2 no.3
• /
• pp.209-216
• /
• 1999

In order to get geologic information necessary for underground installation of water pipe, seismic refraction profiling was applied to the southwest side of the Seomjin River which flows between Namwon-gun, Cholabuk-do and Gokseong-gun, Cholanam-do. Before obtaining the in-line refraction data, walkaway data were recorded with 1 m geophone interval and -36∼+36 m offset range. From the walkaway data, it is interpreted that a dry soil layer with the average velocity of 585 m/s covers wet sediments with the average velocity of 1,326 m/s. The second layer overlies basements nearly horizontally with the average velocity of 4,218 m/s. Refraction profiling of 220 m long with the geophone interval of 2 m is interpreted with the Generalized Reciprocal Method (GRM). Three layers are identified with average velocities of 688 m/s, 1,473 m/s, and 3,776 m/s, respectively. The depth to the bedrock impossible for ripping ranges between two extremes, 1.51∼2.43 m and 2.25∼3.54 m, depending upon thickness of the hidden layer. A typical shortcoming of refraction method, the hidden layer problem, prevents accurate estimation in depth of the second layer.

• Journal of Environmental Science International
• /
• v.13 no.7
• /
• pp.611-618
• /
• 2004

The Neural Network Models which mathematically interpret human thought processes were applied to resolve the uncertainty of model parameters and to increase the model's output for the streamflow forecast model. In order to test and verify the flood discharge forecast model eight flood events observed at Kumho station located on the midstream of Kumho river were chosen. Six events of them were used as test data and two events for verification. In order to make an analysis the Levengerg-Marquart method was used to estimate the best parameter for the Neural Network model. The structure of the model was composed of five types of models by varying the number of hidden layers and the number of nodes of hidden layers. Moreover, a logarithmic-sigmoid varying function was used in first and second hidden layers, and a linear function was used for the output. As a result of applying Neural Networks models for the five models, the N10-6model was considered suitable when there is one hidden layer, and the Nl0-9-5model when there are two hidden layers. In addition, when all the Neural Network models were reviewed, the Nl0-9-5model, which has two hidden layers, gave the most preferable results in an actual hydro-event.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.64 no.10
• /
• pp.1469-1478
• /
• 2015

In this paper, The methodology of Type-2 fuzzy set-based Radial Basis Function Neural Network(T2RBFNN) is proposed for Sewage Treatment Process and the simulator is developed for application to the real-world sewage treatment plant by using the proposed model. The proposed model has robust characteristic than conventional RBFNN. architecture of network consist of three layers such as input layer, hidden layer and output layer of RBFNN, and Type-2 fuzzy set is applied to receptive field in contrast with conventional radial basis function. In addition, the connection weights of the proposed model are defined as linear polynomial function, and then are learned through Back-Propagation(BP). Type reduction is carried out by using Karnik and Mendel(KM) algorithm between hidden layer and output layer. Sewage treatment data obtained from real-world sewage treatment plant is employed to evaluate performance of the proposed model, and their results are analyzed as well as compared with those of conventional RBFNN.