• Title/Summary/Keyword: Error Backpropagation Learning Algorithm

Search Result 60, Processing Time 0.039 seconds

Implementation of the Controller for intelligent Process System Using Neural Network (신경회로망을 이용한 지능형 가공 시스템 제어기 구현)

  • Son, Chang-U;kim, Gwan-Hyeong;Kim, Il;Tak, Han-Ho;Lee, Sang-Bae
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.11a
    • /
    • pp.376-379
    • /
    • 2000
  • In this paper, this system makes use of the analog infrered rays sensor and converts the feature of fish analog signal when sensor is operating with CPU(80C196KC). Then, After signal processing, this feature is classified a special feature and a outline of fish by using the neural network, one of the artificial intelligence scheme. This neural network classifies fish pattern of very simple and short calculation. This has linear activation function and the error backpropagation is used as a learning algorithm. And the neural network is learned in off-line process. Because an adaptation period of neural network is too long time when random initial weights are used, off-line learning is induced to decrease the progress time. We confirmed this method has better performance than somewhat outdated machines.

  • PDF

Vibration Control a Flexible Single Link Robot Manipulator Using Neural Networks (신경회로망을 이용한 유연성 단일 링크 로봇 매니퓰레이터의 진동제어)

  • 탁한호;이상배
    • Journal of the Korean Institute of Navigation
    • /
    • v.21 no.3
    • /
    • pp.55-66
    • /
    • 1997
  • In this paper, applications of neural networks to vibration control of flexible single link robot manipulator are ocnsidered. The architecture of neural networks is a hidden layer, which is comprised of self-recurrent one. Tow neural networks are utilized in a control system ; one as an identifier is called neuro identifier and the othe ra s a controller is called neuro controller. The neural networks can be used to approximate any continuous function to any desired degree of accuracy and the weights are updated by dynamic error-backpropagation algorithm(DEA). To guarantee concegence and to get faster learning, an approach that uses adaptive learning rates is developed by introducing a Lyapunov function. When a flexible manipulator is ratated by a motor through the fixed end, transverse vibration may occur. The motor torque should be controlle dinsuch as way, that the motor is rotated by a specified angle. while simulataneously stabilizing vibration of the flexible manipulators so that it is arrested as soon as possible at the end of rotation. Accurate vibration control of lightweight manipulator during the large body motions, as well as the flexural vibrations. Therefore, dynamic models for a flexible single link manipulator is derived, and LQR controller and nerual networks controller are composed. The effectiveness of the proposed nerual networks control system is confirmed by experiments.

  • PDF

Optimal Parameter Extraction based on Deep Learning for Premature Ventricular Contraction Detection (심실 조기 수축 비트 검출을 위한 딥러닝 기반의 최적 파라미터 검출)

  • Cho, Ik-sung;Kwon, Hyeog-soong
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.12
    • /
    • pp.1542-1550
    • /
    • 2019
  • Legacy studies for classifying arrhythmia have been studied to improve the accuracy of classification, Neural Network, Fuzzy, etc. Deep learning is most frequently used for arrhythmia classification using error backpropagation algorithm by solving the limit of hidden layer number, which is a problem of neural network. In order to apply a deep learning model to an ECG signal, it is necessary to select an optimal model and parameters. In this paper, we propose optimal parameter extraction method based on a deep learning. For this purpose, R-wave is detected in the ECG signal from which noise has been removed, QRS and RR interval segment is modelled. And then, the weights were learned by supervised learning method through deep learning and the model was evaluated by the verification data. The detection and classification rate of R wave and PVC is evaluated through MIT-BIH arrhythmia database. The performance results indicate the average of 99.77% in R wave detection and 97.84% in PVC classification.

Detection of High Impedance Fault Using Adaptive Neuro-Fuzzy Inference System (적응 뉴로 퍼지 추론 시스템을 이용한 고임피던스 고장검출)

  • 유창완
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.9 no.4
    • /
    • pp.426-435
    • /
    • 1999
  • A high impedance fault(HIF) is one of the serious problems facing the electric utility industry today. Because of the high impedance of a downed conductor under some conditions these faults are not easily detected by over-current based protection devices and can cause fires and personal hazard. In this paper a new method for detection of HIF which uses adaptive neuro-fuzzy inference system (ANFIS) is proposed. Since arcing fault current shows different changes during high and low voltage portion of conductor voltage waveform we firstly divided one cycle of fault current into equal spanned four data windows according to the mangnitude of conductor voltage. Fast fourier transform(FFT) is applied to each data window and the frequency spectrum of current waveform are chosen asinputs of ANFIS after input selection method is preprocessed. Using staged fault and normal data ANFIS is trained to discriminate between normal and HIF status by hybrid learning algorithm. This algorithm adapted gradient descent and least square method and shows rapid convergence speed and improved convergence error. The proposed method represent good performance when applied to staged fault data and HIFLL(high impedance like load)such as arc-welder.

  • PDF

Predicting unconfined compression strength and split tensile strength of soil-cement via artificial neural networks

  • Luis Pereira;Luis Godinho;Fernando G. Branco
    • Geomechanics and Engineering
    • /
    • v.33 no.6
    • /
    • pp.611-624
    • /
    • 2023
  • Soil properties make it attractive as a building material due to its mechanical strength, aesthetically appearance, plasticity, and low cost. However, it is frequently necessary to improve and stabilize the soil mechanical properties with binders. Soil-cement is applied for purposes ranging from housing to dams, roads and foundations. Unconfined compression strength (UCS) and split tensile strength (CD) are essential mechanical parameters for ascertaining the aptitude of soil-cement for a given application. However, quantifying these parameters requires specimen preparation, testing, and several weeks. Methodologies that allowed accurate estimation of mechanical parameters in shorter time would represent an important advance in order to ensure shorter deliverable timeline and reduce the amount of laboratory work. In this work, an extensive campaign of UCS and CD tests was carried out in a sandy soil from the Leiria region (Portugal). Then, using the machine learning tool Neural Pattern Recognition of the MATLAB software, a prediction of these two parameters based on six input parameters was made. The results, especially those obtained with resource to a Bayesian regularization-backpropagation algorithm, are frankly positive, with a forecast success percentage over 90% and very low root mean square error (RMSE).

The Inference System of Bead Geometry in GMAW (GMA 용접공정의 비드형상 추론기술)

  • Kim, Myun-Hee;Choi, Young-Geun;Shin, Hyeon-Seung;Lee, Moon-Hwan;Lee, Tae-Young;Lee, Sang-Hyoup
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.5 no.2
    • /
    • pp.111-118
    • /
    • 2002
  • In GMAW(Gas Metal Arc Welding) processes, bead geometry (penetration, bead width and height) is a criterion to estimate welding quality, Bead geometry is affected by welding current, arc voltage and travel speed, shielding gas, CTWD (contact-tip to workpiece distance) and so on. In this paper, welding process variables were selected as welding current, arc voltage and travel speed. And bead geometry was reasoned from the chosen welding process variables using neuro-fuzzy algorithm. Neural networks was applied to design FLC(fuzzy logic control), The parameters of input membership functions and those of consequence functions in FLC were tuned through the method of learning by backpropagation algorithm, Bead geometry could he reasoned from welding current, arc voltage, travel speed on FLC using the results learned by neural networks. On the developed inference system of bead geometry using neuo-fuzzy algorithm, the inference error percent of bead width was within ${\pm}4%$, that of bead height was within ${\pm}3%$, and that of penetration was within ${\pm}8%$, Neural networks came into effect to find the parameters of input membership functions and those of consequence in FLC. Therefore the inference system of welding quality expects to be developed through proposed algorithm.

  • PDF

Underachievers Realm Decision Support System using Computational Intelligence (연산지능을 이용한 부진아 영역진단 지원 시스템)

  • Lim, Chang-Gyoon;Kim, Kang-Chul;Yoo, Jae-Hung;Jhung, Jung-Ha
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.1
    • /
    • pp.30-36
    • /
    • 2006
  • In this paper, we proposed the system that supports underachievers realm decision of Korean language curriculum in the middle school. Learning disability and stagnation should be minimized by using and applying the proposed system. The input layer of the system contains 36 variables, which can be specific items in the Koran language curriculum. The variables are encoded with the specific coding schemes. The number of nodes in the hidden layer was determined through a series of learning stage with best result. We assigned 4 neurons, which correspond to one realm of the curriculum to output layer respectively. We used the multilayer perceptron and the error backpropagation algorithm to develope the system. A total of 2,008 data for training and 380 for testing were used for evaluating the performance.

Prediction of Elementary Students' Computer Literacy Using Neural Networks (신경망을 이용한 초등학생 컴퓨터 활용 능력 예측)

  • Oh, Ji-Young;Lee, Soo-Jung
    • Journal of The Korean Association of Information Education
    • /
    • v.12 no.3
    • /
    • pp.267-274
    • /
    • 2008
  • A neural network is a modeling technique useful for finding out hidden patterns from data through repetitive learning process and for predicting target values for new data. In this study, we built multilayer perceptron neural networks for prediction of the students' computer literacy based on their personal characteristics, home and social environment, and academic record of other subjects. Prediction performance of the network was compared with that of a widely used prediction method, the regression model. From our experiments, it was found that personal characteristic features best explained computer proficiency level of a student, whereas the features of home and social environment resulted in the worse prediction accuracy among all. Moreover, the developed neural network model produced far more accurate prediction than the regression model.

  • PDF

An Intelligent Decision Support System for Selecting Promising Technologies for R&D based on Time-series Patent Analysis (R&D 기술 선정을 위한 시계열 특허 분석 기반 지능형 의사결정지원시스템)

  • Lee, Choongseok;Lee, Suk Joo;Choi, Byounggu
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.3
    • /
    • pp.79-96
    • /
    • 2012
  • As the pace of competition dramatically accelerates and the complexity of change grows, a variety of research have been conducted to improve firms' short-term performance and to enhance firms' long-term survival. In particular, researchers and practitioners have paid their attention to identify promising technologies that lead competitive advantage to a firm. Discovery of promising technology depends on how a firm evaluates the value of technologies, thus many evaluating methods have been proposed. Experts' opinion based approaches have been widely accepted to predict the value of technologies. Whereas this approach provides in-depth analysis and ensures validity of analysis results, it is usually cost-and time-ineffective and is limited to qualitative evaluation. Considerable studies attempt to forecast the value of technology by using patent information to overcome the limitation of experts' opinion based approach. Patent based technology evaluation has served as a valuable assessment approach of the technological forecasting because it contains a full and practical description of technology with uniform structure. Furthermore, it provides information that is not divulged in any other sources. Although patent information based approach has contributed to our understanding of prediction of promising technologies, it has some limitations because prediction has been made based on the past patent information, and the interpretations of patent analyses are not consistent. In order to fill this gap, this study proposes a technology forecasting methodology by integrating patent information approach and artificial intelligence method. The methodology consists of three modules : evaluation of technologies promising, implementation of technologies value prediction model, and recommendation of promising technologies. In the first module, technologies promising is evaluated from three different and complementary dimensions; impact, fusion, and diffusion perspectives. The impact of technologies refers to their influence on future technologies development and improvement, and is also clearly associated with their monetary value. The fusion of technologies denotes the extent to which a technology fuses different technologies, and represents the breadth of search underlying the technology. The fusion of technologies can be calculated based on technology or patent, thus this study measures two types of fusion index; fusion index per technology and fusion index per patent. Finally, the diffusion of technologies denotes their degree of applicability across scientific and technological fields. In the same vein, diffusion index per technology and diffusion index per patent are considered respectively. In the second module, technologies value prediction model is implemented using artificial intelligence method. This studies use the values of five indexes (i.e., impact index, fusion index per technology, fusion index per patent, diffusion index per technology and diffusion index per patent) at different time (e.g., t-n, t-n-1, t-n-2, ${\cdots}$) as input variables. The out variables are values of five indexes at time t, which is used for learning. The learning method adopted in this study is backpropagation algorithm. In the third module, this study recommends final promising technologies based on analytic hierarchy process. AHP provides relative importance of each index, leading to final promising index for technology. Applicability of the proposed methodology is tested by using U.S. patents in international patent class G06F (i.e., electronic digital data processing) from 2000 to 2008. The results show that mean absolute error value for prediction produced by the proposed methodology is lower than the value produced by multiple regression analysis in cases of fusion indexes. However, mean absolute error value of the proposed methodology is slightly higher than the value of multiple regression analysis. These unexpected results may be explained, in part, by small number of patents. Since this study only uses patent data in class G06F, number of sample patent data is relatively small, leading to incomplete learning to satisfy complex artificial intelligence structure. In addition, fusion index per technology and impact index are found to be important criteria to predict promising technology. This study attempts to extend the existing knowledge by proposing a new methodology for prediction technology value by integrating patent information analysis and artificial intelligence network. It helps managers who want to technology develop planning and policy maker who want to implement technology policy by providing quantitative prediction methodology. In addition, this study could help other researchers by proving a deeper understanding of the complex technological forecasting field.

The Pattern Analysis of Financial Distress for Non-audited Firms using Data Mining (데이터마이닝 기법을 활용한 비외감기업의 부실화 유형 분석)

  • Lee, Su Hyun;Park, Jung Min;Lee, Hyoung Yong
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.4
    • /
    • pp.111-131
    • /
    • 2015
  • There are only a handful number of research conducted on pattern analysis of corporate distress as compared with research for bankruptcy prediction. The few that exists mainly focus on audited firms because financial data collection is easier for these firms. But in reality, corporate financial distress is a far more common and critical phenomenon for non-audited firms which are mainly comprised of small and medium sized firms. The purpose of this paper is to classify non-audited firms under distress according to their financial ratio using data mining; Self-Organizing Map (SOM). SOM is a type of artificial neural network that is trained using unsupervised learning to produce a lower dimensional discretized representation of the input space of the training samples, called a map. SOM is different from other artificial neural networks as it applies competitive learning as opposed to error-correction learning such as backpropagation with gradient descent, and in the sense that it uses a neighborhood function to preserve the topological properties of the input space. It is one of the popular and successful clustering algorithm. In this study, we classify types of financial distress firms, specially, non-audited firms. In the empirical test, we collect 10 financial ratios of 100 non-audited firms under distress in 2004 for the previous two years (2002 and 2003). Using these financial ratios and the SOM algorithm, five distinct patterns were distinguished. In pattern 1, financial distress was very serious in almost all financial ratios. 12% of the firms are included in these patterns. In pattern 2, financial distress was weak in almost financial ratios. 14% of the firms are included in pattern 2. In pattern 3, growth ratio was the worst among all patterns. It is speculated that the firms of this pattern may be under distress due to severe competition in their industries. Approximately 30% of the firms fell into this group. In pattern 4, the growth ratio was higher than any other pattern but the cash ratio and profitability ratio were not at the level of the growth ratio. It is concluded that the firms of this pattern were under distress in pursuit of expanding their business. About 25% of the firms were in this pattern. Last, pattern 5 encompassed very solvent firms. Perhaps firms of this pattern were distressed due to a bad short-term strategic decision or due to problems with the enterpriser of the firms. Approximately 18% of the firms were under this pattern. This study has the academic and empirical contribution. In the perspectives of the academic contribution, non-audited companies that tend to be easily bankrupt and have the unstructured or easily manipulated financial data are classified by the data mining technology (Self-Organizing Map) rather than big sized audited firms that have the well prepared and reliable financial data. In the perspectives of the empirical one, even though the financial data of the non-audited firms are conducted to analyze, it is useful for find out the first order symptom of financial distress, which makes us to forecast the prediction of bankruptcy of the firms and to manage the early warning and alert signal. These are the academic and empirical contribution of this study. The limitation of this research is to analyze only 100 corporates due to the difficulty of collecting the financial data of the non-audited firms, which make us to be hard to proceed to the analysis by the category or size difference. Also, non-financial qualitative data is crucial for the analysis of bankruptcy. Thus, the non-financial qualitative factor is taken into account for the next study. This study sheds some light on the non-audited small and medium sized firms' distress prediction in the future.