• Title/Summary/Keyword: Hidden Neurons

Search Result 133, Processing Time 0.026 seconds

Optimization of Neural Networks Architecture for Impact Sensitivity of Energetic Molecules

  • Cho, Soo-Gyeong;No, Kyoung-Tai;Goh, Eun-Mee;Kim, Jeong-Kook;Shin, Jae-Hong;Joo, Young-Dae;Seong, See-Yearl
    • Bulletin of the Korean Chemical Society
    • /
    • v.26 no.3
    • /
    • pp.399-408
    • /
    • 2005
  • We have utilized neural network (NN) studies to predict impact sensitivities of various types of explosive molecules. Two hundreds and thirty four explosive molecules have been taken from a single database, and thirty nine molecular descriptors were computed for each explosive molecule. Optimization of NN architecture has been carried out by examining seven different sets of molecular descriptors and varying the number of hidden neurons. For the optimized NN architecture, we have utilized 17 molecular descriptors which were composed of compositional and topological descriptors in an input layer, and 2 hidden neurons in a hidden layer.

A Design of Parallel Module Neural Network for Robot Manipulators having a fast Learning Speed (빠른 학습 속도를 갖는 로보트 매니퓰레이터의 병렬 모듈 신경제어기 설계)

  • 김정도;이택종
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.9
    • /
    • pp.1137-1153
    • /
    • 1995
  • It is not yet possible to solve the optimal number of neurons in hidden layer at neural networks. However, it has been proposed and proved by experiments that there is a limit in increasing the number of neuron in hidden layer, because too much incrememt will cause instability,local minima and large error. This paper proposes a module neural controller with pattern recognition ability to solve the above trade-off problems and to obtain fast learning convergence speed. The proposed neural controller is composed of several module having Multi-layer Perrceptron(MLP). Each module have the less neurons in hidden layer, because it learns only input patterns having a similar learning directions. Experiments with six joint robot manipulator have shown the effectiveness and the feasibility of the proposed the parallel module neural controller with pattern recognition perceptron.

  • PDF

연결강도분석을 이용한 통합된 부도예측용 신경망모형

  • Lee Woongkyu;Lim Young Ha
    • Proceedings of the Korea Association of Information Systems Conference
    • /
    • 2002.11a
    • /
    • pp.289-312
    • /
    • 2002
  • This study suggests the Link weight analysis approach to choose input variables and an integrated model to make more accurate bankruptcy prediction model. the Link weight analysis approach is a method to choose input variables to analyze each input node's link weight which is the absolute value of link weight between an input nodes and a hidden layer. There are the weak-linked neurons elimination method, the strong-linked neurons selection method in the link weight analysis approach. The Integrated Model is a combined type adapting Bagging method that uses the average value of the four models, the optimal weak-linked-neurons elimination method, optimal strong-linked neurons selection method, decision-making tree model, and MDA. As a result, the methods suggested in this study - the optimal strong-linked neurons selection method, the optimal weak-linked neurons elimination method, and the integrated model - show much higher accuracy than MDA and decision making tree model. Especially the integrated model shows much higher accuracy than MDA and decision making tree model and shows slightly higher accuracy than the optimal weak-linked neurons elimination method and the optimal strong-linked neurons selection method.

  • PDF

Learning Ability of Deterministic Boltzmann Machine with Non-Monotonic Neurons (비단조뉴런 DBM 네트워크의 학습 능력에 관한 연구)

  • 박철영;이도훈
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2001.12a
    • /
    • pp.275-278
    • /
    • 2001
  • In this paper, We evaluate the learning ability of non-monotonic DBM(Deterministic Boltzmann Machine) network through numerical simulations. The simulation results show that the proposed system has higher performance than monotonic DBM network model. Non-monotonic DBM network also show an interesting result that network itself adjusts the number of hidden layer neurons. DBM network can be realized with fewer components than other neural network models. These results enhance the utilization of non-monotonic neurons in the large scale integration of neuro-chips.

  • PDF

Estrus Detection in Sows Based on Texture Analysis of Pudendal Images and Neural Network Analysis

  • Seo, Kwang-Wook;Min, Byung-Ro;Kim, Dong-Woo;Fwa, Yoon-Il;Lee, Min-Young;Lee, Bong-Ki;Lee, Dae-Weon
    • Journal of Biosystems Engineering
    • /
    • v.37 no.4
    • /
    • pp.271-278
    • /
    • 2012
  • Worldwide trends in animal welfare have resulted in an increased interest in individual management of sows housed in groups within hog barns. Estrus detection has been shown to be one of the greatest determinants of sow productivity. Purpose: We conducted this study to develop a method that can automatically detect the estrus state of a sow by selecting optimal texture parameters from images of a sow's pudendum and by optimizing the number of neurons in the hidden layer of an artificial neural network. Methods: Texture parameters were analyzed according to changes in a sow's pudendum in estrus such as mucus secretion and expansion. Of the texture parameters, eight gray level co-occurrence matrix (GLCM) parameters were used for image analysis. The image states were classified into ten grades for each GLCM parameter, and an artificial neural network was formed using the values for each grade as inputs to discriminate the estrus state of sows. The number of hidden layer neurons in the artificial neural network is an important parameter in neural network design. Therefore, we determined the optimal number of hidden layer units using a trial and error method while increasing the number of neurons. Results: Fifteen hidden layers were determined to be optimal for use in the artificial neural network designed in this study. Thirty images of 10 sows were used for learning, and then 30 different images of 10 sows were used for verification. Conclusions: For learning, the back propagation neural network (BPN) algorithm was used to successful estimate six texture parameters (homogeneity, angular second moment, energy, maximum probability, entropy, and GLCM correlation). Based on the verification results, homogeneity was determined to be the most important texture parameter, and resulted in an estrus detection rate of 70%.

Pattern Recognition Analysis of Two Spirals and Optimization of Cascade Correlation Algorithm using CosExp and Sigmoid Activation Functions (이중나선의 패턴 인식 분석과 CosExp와 시그모이드 활성화 함수를 사용한 캐스케이드 코릴레이션 알고리즘의 최적화)

  • Lee, Sang-Wha
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.15 no.3
    • /
    • pp.1724-1733
    • /
    • 2014
  • This paper presents a pattern recognition analysis of two spirals problem and optimization of Cascade Correlation learning algorithm using in combination with a non-monotone function as CosExp(cosine-modulated symmetric exponential function) and a monotone function as sigmoid function. In addition, the algorithm's optimization is attempted. By using genetic algorithms the optimization of the algorithm will attempt. In the first experiment, by using CosExp activation function for candidate neurons of the learning algorithm is analyzed the recognized pattern in input space of the two spirals problem. In the second experiment, CosExp function for output neurons is used. In the third experiment, the sigmoid activation functions with various parameters for candidate neurons in 8 pools and CosExp function for output neurons are used. In the fourth experiment, the parameters are composed of 8 pools and displacement of the sigmoid function to determine the value of the three parameters is obtained using genetic algorithms. The parameter values applied to the sigmoid activation functions for candidate neurons are used. To evaluate the performance of these algorithms, each step of the training input pattern classification shows the shape of the two spirals. In the optimizing process, the number of hidden neurons was reduced from 28 to15, and finally the learning algorithm with 12 hidden neurons was optimized.

Learning Ability of Deterministic Boltzmann Machine with Non-Monotonic Neurons in Hidden Layer (은닉층에 비단조 뉴런을 갖는 결정론적 볼츠만 머신의 학습능력에 관한 연구)

  • 박철영
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.11 no.6
    • /
    • pp.505-509
    • /
    • 2001
  • In this paper, we evaluate the learning ability of non-monotonic DMM(Deterministic Boltzmann Machine) network through numerical simulations. The simulation results show that the proposed system has higher performance than monotonic DBM network model. Non-monotonic DBM network also show an interesting result that network itself adjusts the number of hidden layer neurons. DBM network can be realized with fewer components than other neural network models. These results enhance the utilization of non-monotonic neurons in the large scale integration of neuro-chips.

  • PDF

Vertical Z-vibration prediction model of ground building induced by subway operation

  • Zhou, Binghua;Xue, Yiguo;Zhang, Jun;Zhang, Dunfu;Huang, Jian;Qiu, Daohong;Yang, Lin;Zhang, Kai;Cui, Jiuhua
    • Geomechanics and Engineering
    • /
    • v.30 no.3
    • /
    • pp.273-280
    • /
    • 2022
  • A certain amount of random vibration excitation to subway track is caused by subway operation. This excitation is transmitted through track foundation, tunnel, soil medium, and ground building to the ground and ground structure, causing vibration. The vibration affects ground building. In this study, the results of ANSYS numerical simulation was used to establish back-propagation (BP) neural network model. Moreover, a back-propagation neural network model consisting of five input neurons, one hidden layer, 11 hidden-layer neurons, and three output neurons was used to analyze and calculate the vertical Z-vibration level of New Capital's ground buildings of Qingdao Metro phase I Project (Line M3). The Z-vibration level under different working conditions was calculated from monolithic roadbed, steel-spring floating slab roadbed, and rubber-pad floating slab roadbed under the working condition of center point of 0-100 m. The steel-spring floating slab roadbed was used in the New Capital area to monitor the subway operation vibration in this area. Comparing the monitoring and prediction results, it was found that the prediction results have a good linear relationship with lower error. The research results have good reference and guiding significance for predicting vibration caused by subway operation.

A Modified Error Back Propagation Algorithm Adding Neurons to Hidden Layer (은닉층 뉴우런 추가에 의한 역전파 학습 알고리즘)

  • 백준호;김유신;손경식
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.29B no.4
    • /
    • pp.58-65
    • /
    • 1992
  • In this paper new back propagation algorithm which adds neurons to hidden layer is proposed. this proposed algorithm is applied to the pattern recognition of written number coupled with back propagation algorithm through omitting redundant learning. Learning rate and recognition rate of the proposed algorithm are compared with those of the conventional back propagation algorithm and the back propagation through omitting redundant learning. The learning rate of proposed algorithm is 4 times as fast as the conventional back propagation algorithm and 2 times as fast as the back propagation through omitting redundant learning. The recognition rate is 96.2% in case of the conventional back propagation algorithm, 96.5% in case of the back propagation through omitting redundant learning and 97.4% in the proposed algorithm.

  • PDF

A Systematic Approach for Designing a Self-Tuning Power System Stabilizer Based on Artificial Neural Network

  • Sedaghati, Alireza
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.281-286
    • /
    • 2005
  • The main objective of the research work presented in this article is to present a systematic approach for designing a multilayer feed-forward artificial neural network based self-tuning power system stabilizer (ST-ANNPSS). In order to suggest an approach for selecting the number of neurons in the hidden layer, the dynamic performance of the system with ST-ANNPSS is studied and hence compared with that of conventional PSS. Finally the effect of variation of loading condition and equivalent reactance, Xe is investigated on dynamic performance of the system with ST-ANNPSS. Investigations reveal that ANN with one hidden layer comprising nine neurons is adequate and sufficient for ST-ANNPSS. Studies show that the dynamic performance of STANNPSS is quite superior to that of conventional PSS for the loading condition different from the nominal. Also it is revealed that the performance of ST-ANNPSS is quite robust to a wide variation in loading condition.

  • PDF