• 제목/요약/키워드: hidden layer

검색결과 511건 처리시간 0.026초

혼합형 학습규칙 신경 회로망을 이용한 제어 방식 (Control Method using Neural Network of Hybrid Learning Rule)

  • 임중규;이현관;권성훈;엄기환
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 1999년도 춘계종합학술대회
    • /
    • pp.370-374
    • /
    • 1999
  • 본 논문에서는 역전파 알고리즘과 헵 학습규칙의 장점을 최대한 살려 이용하고, 역전파 알고리즘의 문제점인 지역 최소점에 빠지는 경우와 학습시간이 느린 단점과 헵 학습규칙의 문제점인 학습 패턴의 저장능력이 매우 제한되고 선형적 분리가 되지 않는 복잡한 문제에는 적용할 수 없다는 단점등을 개선하기 위하여 혼합형 학습규칙을 제안한다. 제안하는 학습규칙은 입력층과 은닉층에 흔합형 학습규칙과 은닉층과 출력층에 역전파(Back-Propagation) 학습규칙을 적용한 혼합형이다. 제안한 혼합형 학습규칙을 이용한 신경회로망의 유용성을 확인하기 위하여 단일관절 매니플레이터를 이용하여 추종제어에 대한 시뮬레이션을 하여 기존의 역전파 알고리즘을 이용한 직접적응 제어 방식과 제어성능을 비교 검토한 결과 다음과 같은 특성을 확인하였다.

  • PDF

GMA 용접의 최적 비드 높이 예측 알고리즘 개발 (Development of Algorithm for Prediction of Bead Height on GMA Welding)

  • 김인수;박창언;김일수;손준식;안영호;김동규;오영생
    • Journal of Welding and Joining
    • /
    • 제17권5호
    • /
    • pp.40-46
    • /
    • 1999
  • The sensors employed in the robotic are welding system must detect the changes in weld characteristics and produce the output that is in some way related to the change being detected. Such adaptive systems, which synchronise the robot arm and eyes using a primitive brain will form the basis for the development of robotic GMA(Gas Metal Arc) welding which increasingly higher levels of artificial intelligence. The objective of this paper is to realize the mapping characteristics of bead height through learning. After learning, the neural estimation can estimate the bead height desired from the learning mapping characteristic. The design parameters of the neural network estimator(the number of hidden layers and the number of nodes in a layer) are chosen from an estimation error analysis. A series of bead of bead-on-plate GMA welding experiments was carried out in order to verify the performance of the neural network estimator. The experimental results show that the proposed neural network estimator can predict the bead height with reasonable accuracy and guarantee the uniform weld quality.

  • PDF

Application of a Hybrid System of Probabilistic Neural Networks and Artificial Bee Colony Algorithm for Prediction of Brand Share in the Market

  • Shahrabi, Jamal;Khameneh, Sara Mottaghi
    • Industrial Engineering and Management Systems
    • /
    • 제15권4호
    • /
    • pp.324-334
    • /
    • 2016
  • Manufacturers and retailers are interested in how prices, promotions, discounts and other marketing variables can influence the sales and shares of the products that they produce or sell. Therefore, many models have been developed to predict the brand share. Since the customer choice models are usually used to predict the market share, here we use hybrid model of Probabilistic Neural Network and Artificial Bee colony Algorithm (PNN-ABC) that we have introduced to model consumer choice to predict brand share. The evaluation process is carried out using the same data set that we have used for modeling individual consumer choices in a retail coffee market. Then, to show good performance of this model we compare it with Artificial Neural Network with one hidden layer, Artificial Neural Network with two hidden layer, Artificial Neural Network trained with genetic algorithms (ANN-GA), and Probabilistic Neural Network. The evaluated results show that the offered model is outperforms better than other previous models, so it can be use as an effective tool for modeling consumer choice and predicting market share.

은닉층 노드의 생성추가를 이용한 적응 역전파 신경회로망의 학습능률 향상에 관한 연구 (On the enhancement of the learning efficiency of the adaptive back propagation neural network using the generating and adding the hidden layer node)

  • 김은원;홍봉화
    • 대한전자공학회논문지TE
    • /
    • 제39권2호
    • /
    • pp.66-75
    • /
    • 2002
  • 본 논문에서는 역전파 신경회로망의 학습능률을 향상시키기 위한 방법으로 발생한 오차에 따라서 학습파라미터와 은닉층의 수를 적응적으로 변경시킬 수 있는 적응 역 전파 학습알고리즘을 제안하였다. 제안한 알고리즘은 역전파 신경회로망이 국소점으로 수렴하는 문제를 해결할 수 있고 최적의 수렴환경을 만들 수 있다. 제안된 알고리즘을 평가하기 위하여 배타적 논리합, 3-패리티 및 7${\times}$5 영문자 폰트의 학습을 이용하였다. 실험결과, 기존에 제안된 알고리즘들에 비하여 국소점에 빠지게 되는 경우가 감소하였고 약 17.6%~64.7%정도 학습능률이 향상하였다.

영상 인식을 위한 개선된 자가 생성 지도 학습 알고리듬에 관한 연구 (A Study on Enhanced Self-Generation Supervised Learning Algorithm for Image Recognition)

  • 김태경;김광백;백준기
    • 한국통신학회논문지
    • /
    • 제30권2C호
    • /
    • pp.31-40
    • /
    • 2005
  • 오류 역전파 알고리즘의 문제점과 ART 신경회로망의 문제점을 개선하기 위해 Jacobs가 제안한 delta-bar-delta 방법과 신경회로망을 결합한 자가 생성 지도 학습 알고리듬을 제안한다. 입력층과 은닉층에서는 ART-1과 ART-2 알고리듬을 이용하고, winner-take-all 방식은 완전 연결 구조이나 연결된 가중치만을 조정하도록 채택하였다. 실험을 위해 학생증, 주민등록증, 컨테이너의 영상으로 추출한 패턴을 신경회로망의 은닉층 노드에 대해 실험하였고, 실험결과 제안된 자기 생성 지도 학습알고리듬이 지역최소화, 학습 속도, 정체 현상이 기존의 방법보다 성능이 개선된 것을 확인하였다.

NETLA를 이용한 이진 신경회로망의 최적 합성방법 (Optimal Synthesis Method for Binary Neural Network using NETLA)

  • 성상규;김태우;박두환;조현우;하홍곤;이준탁
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2001년도 하계학술대회 논문집 D
    • /
    • pp.2726-2728
    • /
    • 2001
  • This paper describes an optimal synthesis method of binary neural network(BNN) for an approximation problem of a circular region using a newly proposed learning algorithm[7] Our object is to minimize the number of connections and neurons in hidden layer by using a Newly Expanded and Truncated Learning Algorithm(NETLA) for the multilayer BNN. The synthesis method in the NETLA is based on the extension principle of Expanded and Truncated Learning(ETL) and is based on Expanded Sum of Product (ESP) as one of the boolean expression techniques. And it has an ability to optimize the given BNN in the binary space without any iterative training as the conventional Error Back Propagation(EBP) algorithm[6] If all the true and false patterns are only given, the connection weights and the threshold values can be immediately determined by an optimal synthesis method of the NETLA without any tedious learning. Futhermore, the number of the required neurons in hidden layer can be reduced and the fast learning of BNN can be realized. The superiority of this NETLA to other algorithms was proved by the approximation problem of one circular region.

  • PDF

Neural and MTS Algorithms for Feature Selection

  • Su, Chao-Ton;Li, Te-Sheng
    • International Journal of Quality Innovation
    • /
    • 제3권2호
    • /
    • pp.113-131
    • /
    • 2002
  • The relationships among multi-dimensional data (such as medical examination data) with ambiguity and variation are difficult to explore. The traditional approach to building a data classification system requires the formulation of rules by which the input data can be analyzed. The formulation of such rules is very difficult with large sets of input data. This paper first describes two classification approaches using back-propagation (BP) neural network and Mahalanobis distance (MD) classifier, and then proposes two classification approaches for multi-dimensional feature selection. The first one proposed is a feature selection procedure from the trained back-propagation (BP) neural network. The basic idea of this procedure is to compare the multiplication weights between input and hidden layer and hidden and output layer. In order to simplify the structure, only the multiplication weights of large absolute values are used. The second approach is Mahalanobis-Taguchi system (MTS) originally suggested by Dr. Taguchi. The MTS performs Taguchi's fractional factorial design based on the Mahalanobis distance as a performance metric. We combine the automatic thresholding with MD: it can deal with a reduced model, which is the focus of this paper In this work, two case studies will be used as examples to compare and discuss the complete and reduced models employing BP neural network and MD classifier. The implementation results show that proposed approaches are effective and powerful for the classification.

머신러닝 기반의 안전도 데이터 필터링 모델 (Electrooculography Filtering Model Based on Machine Learning)

  • 홍기현;이병문
    • 한국멀티미디어학회논문지
    • /
    • 제24권2호
    • /
    • pp.274-284
    • /
    • 2021
  • Customized services to a sleep induction for better sleepcare are more effective because of different satisfaction levels to users. The EOG data measured at the frontal lobe when a person blinks his eyes can be used as biometric data because it has different values for each person. The accuracy of measurement is degraded by a noise source, such as toss and turn. Therefore, it is necessary to analyze the noisy data and remove them from normal EOG by filtering. There are low-pass filtering and high-pass filtering as filtering using a frequency band. However, since filtering within a frequency band range is also required for more effective performance, we propose a machine learning model for the filtering of EOG data in this paper as the second filtering method. In addition, optimal values of parameters such as the depth of the hidden layer, the number of nodes of the hidden layer, the activation function, and the dropout were found through experiments, to improve the performance of the machine learning filtering model, and the filtering performance of 95.7% was obtained. Eventually, it is expected that it can be used for effective user identification services by using filtering model for EOG data.

Vertical Z-vibration prediction model of ground building induced by subway operation

  • Zhou, Binghua;Xue, Yiguo;Zhang, Jun;Zhang, Dunfu;Huang, Jian;Qiu, Daohong;Yang, Lin;Zhang, Kai;Cui, Jiuhua
    • Geomechanics and Engineering
    • /
    • 제30권3호
    • /
    • pp.273-280
    • /
    • 2022
  • A certain amount of random vibration excitation to subway track is caused by subway operation. This excitation is transmitted through track foundation, tunnel, soil medium, and ground building to the ground and ground structure, causing vibration. The vibration affects ground building. In this study, the results of ANSYS numerical simulation was used to establish back-propagation (BP) neural network model. Moreover, a back-propagation neural network model consisting of five input neurons, one hidden layer, 11 hidden-layer neurons, and three output neurons was used to analyze and calculate the vertical Z-vibration level of New Capital's ground buildings of Qingdao Metro phase I Project (Line M3). The Z-vibration level under different working conditions was calculated from monolithic roadbed, steel-spring floating slab roadbed, and rubber-pad floating slab roadbed under the working condition of center point of 0-100 m. The steel-spring floating slab roadbed was used in the New Capital area to monitor the subway operation vibration in this area. Comparing the monitoring and prediction results, it was found that the prediction results have a good linear relationship with lower error. The research results have good reference and guiding significance for predicting vibration caused by subway operation.

Use of multi-hybrid machine learning and deep artificial intelligence in the prediction of compressive strength of concrete containing admixtures

  • Jian, Guo;Wen, Sun;Wei, Li
    • Advances in concrete construction
    • /
    • 제13권1호
    • /
    • pp.11-23
    • /
    • 2022
  • Conventional concrete needs some improvement in the mechanical properties, which can be obtained by different admixtures. However, making concrete samples costume always time and money. In this paper, different types of hybrid algorithms are applied to develop predictive models for forecasting compressive strength (CS) of concretes containing metakaolin (MK) and fly ash (FA). In this regard, three different algorithms have been used, namely multilayer perceptron (MLP), radial basis function (RBF), and support vector machine (SVR), to predict CS of concretes by considering most influencers input variables. These algorithms integrated with the grey wolf optimization (GWO) algorithm to increase the model's accuracy in predicting (GWMLP, GWRBF, and GWSVR). The proposed MLP models were implemented and evaluated in three different layers, wherein each layer, GWO, fitted the best neuron number of the hidden layer. Correspondingly, the key parameters of the SVR model are identified using the GWO method. Also, the optimization algorithm determines the hidden neurons' number and the spread value to set the RBF structure. The results show that the developed models all provide accurate predictions of the CS of concrete incorporating MK and FA with R2 larger than 0.9972 and 0.9976 in the learning and testing stage, respectively. Regarding GWMLP models, the GWMLP1 model outperforms other GWMLP networks. All in all, GWSVR has the worst performance with the lowest indices, while the highest score belongs to GWRBF.