• Title/Summary/Keyword: Regression Analysis, Neural Networks

Search Result 150, Processing Time 0.029 seconds

Performance Evaluation of Linear Regression, Back-Propagation Neural Network, and Linear Hebbian Neural Network for Fitting Linear Function (선형함수 fitting을 위한 선형회귀분석, 역전파신경망 및 성현 Hebbian 신경망의 성능 비교)

  • 이문규;허해숙
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.20 no.3
    • /
    • pp.17-29
    • /
    • 1995
  • Recently, neural network models have been employed as an alternative to regression analysis for point estimation or function fitting in various field. Thus far, however, no theoretical or empirical guides seem to exist for selecting the tool which the most suitable one for a specific function-fitting problem. In this paper, we evaluate performance of three major function-fitting techniques, regression analysis and two neural network models, back-propagation and linear-Hebbian-learning neural networks. The functions to be fitted are simple linear ones of a single independent variable. The factors considered are size of noise both in dependent and independent variables, portion of outliers, and size of the data. Based on comutational results performed in this study, some guidelines are suggested to choose the best technique that can be used for a specific problem concerned.

  • PDF

Modeling of PECVD Oxide Film Properties Using Neural Networks (신경회로망을 이용한 PECVD 산화막의 특성 모형화)

  • Lee, Eun-Jin;Kim, Tae-Seon
    • Journal of the Korean Institute of Electrical and Electronic Material Engineers
    • /
    • v.23 no.11
    • /
    • pp.831-836
    • /
    • 2010
  • In this paper, Plasma Enhanced Chemical Vapor Deposition (PECVD) $SiO_2$ film properties are modeled using statistical analysis and neural networks. For systemic analysis, Box-Behnken's 3 factor design of experiments (DOE) with response surface method are used. For characterization, deposited film thickness and film stress are considered as film properties and three process input factors including plasma RF power, flow rate of $N_2O$ gas, and flow rate of 5% $SiH_4$ gas contained at $N_2$ gas are considered for modeling. For film thickness characterization, regression based model showed only 0.71% of root mean squared (RMS) error. Also, for film stress model case, both regression model and neural prediction model showed acceptable RMS error. For sensitivity analysis, compare to conventional fixed mid point based analysis, proposed sensitivity analysis for entire range of interest support more process information to optimize process recipes to satisfy specific film characteristic requirements.

A Comparison of Construction Cost Estimation Using Multiple Regression Analysis and Neural Network in Elementary School Project

  • Cho, Hong-Gyu;Kim, Kyong-Gon;Kim, Jang-Young;Kim, Gwang-Hee
    • Journal of the Korea Institute of Building Construction
    • /
    • v.13 no.1
    • /
    • pp.66-74
    • /
    • 2013
  • In the early stages of a construction project, the most important thing is to predict construction costs in a rational way. For this reason, many studies have been performed on the estimation of construction costs for apartment housing and office buildings at early stage using artificial intelligence, statistics, and the like. In this study, cost data held by a provincial Office of Education on elementary schools constructed from 2004 to 2007 were used to compare the multiple regression model with an artificial neural network model. A total of 96 historical data were classified into 76 historical data for constructing models and 20 historical data for comparing the constructed regression model with the artificial neural network model. The results of an analysis of predicted construction costs were that the error rate of the artificial neural network model is lower than that of the multiple regression model.

On the Performance Analysis of a Logistic regression based transient signal classifier (Logistic Regression 방법을 이용한 천이 신호 식별 알고리즘 및 성능 분석)

  • Heo, Sun-Cheol;Kim, Jin-Young;Yoon, Byoung-Soo;Nam, Sang-Won;Oh, Won-Cheon
    • Proceedings of the KIEE Conference
    • /
    • 1995.07b
    • /
    • pp.913-915
    • /
    • 1995
  • In this paper, a transient signal classification system using logistic regression and neural networks is presented, where four neural networks such as MLP, MLP-Class, RBF and LVQ are utilized to classify given transient signals, based on the logistic regression method. Also, some test results with experimental transient signal data are provided.

  • PDF

Using neural networks to model and predict amplitude dependent damping in buildings

  • Li, Q.S.;Liu, D.K.;Fang, J.Q.;Jeary, A.P.;Wong, C.K.
    • Wind and Structures
    • /
    • v.2 no.1
    • /
    • pp.25-40
    • /
    • 1999
  • In this paper, artificial neural networks, a new kind of intelligent method, are employed to model and predict amplitude dependent damping in buildings based on our full-scale measurements of buildings. The modelling method and procedure using neural networks to model the damping are studied. Comparative analysis of different neural network models of damping, which includes multi-layer perception network (MLP), recurrent neural network, and general regression neural network (GRNN), is performed and discussed in detail. The performances of the models are evaluated and discussed by tests and predictions including self-test, "one-lag" prediction and "multi-lag" prediction of the damping values at high amplitude levels. The established models of damping are used to predict the damping in the following three ways : (1) the model is established by part of the data measured from one building and is used to predict the another part of damping values which are always difficult to obtain from field measurements : the values at the high amplitude level. (2) The model is established by the damping data measured from one building and is used to predict the variation curve of damping for another building. And (3) the model is established by the data measured from more than one buildings and is used to predict the variation curve of damping for another building. The prediction results are discussed.

A New Modeling Approach to Fuzzy-Neural Networks Architecture (퍼지 뉴럴 네트워크 구조로의 새로운 모델링 연구)

  • Park, Ho-Sung;Oh, Sung-Kwun;Yoon, Yang-Woung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.8
    • /
    • pp.664-674
    • /
    • 2001
  • In this paper, as a new category of fuzzy-neural networks architecture, we propose Fuzzy Polynomial Neural Networks (FPNN) and discuss a comprehensive design methodology related to its architecture. FPNN dwells on the ideas of fuzzy rule-based computing and neural networks. The FPNN architecture consists of layers with activation nodes based on fuzzy inference rules. Here each activation node is presented as Fuzzy Polynomial Neuron(FPN). The conclusion part of the rules, especially the regression polynomial, uses several types of high-order polynomials such as linear, quadratic and modified quadratic. As the premise part of the rules, both triangular and Gaussian-like membership functions are studied. It is worth stressing that the number of the layers and the nods in each layer of the FPNN are not predetermined, unlike in the case of the popular multilayer perceptron structure, but these are generated in a dynamic manner. With the aid of two representative time series process data, a detailed design procedure is discussed, and the stability is introduced as a measure of stability of the model for the comparative analysis of various architectures.

  • PDF

A Personal Credit Rating Using Convolutional Neural Networks with Transformation of Credit Data to Imaged Data and eXplainable Artificial Intelligence(XAI) (신용 데이터의 이미지 변환을 활용한 합성곱 신경망과 설명 가능한 인공지능(XAI)을 이용한 개인신용평가)

  • Won, Jong Gwan;Hong, Tae Ho;Bae, Kyoung Il
    • The Journal of Information Systems
    • /
    • v.30 no.4
    • /
    • pp.203-226
    • /
    • 2021
  • Purpose The purpose of this study is to enhance the accuracy score of personal credit scoring using the convolutional neural networks and secure the transparency of the deep learning model using eXplainalbe Artifical Inteligence(XAI) technique. Design/methodology/approach This study built a classification model by using the convolutional neural networks(CNN) and applied a methodology that is transformation of numerical data to imaged data to apply CNN on personal credit data. Then layer-wise relevance propagation(LRP) was applied to model we constructed to find what variables are more influenced to the output value. Findings According to the empirical analysis result, this study confirmed that accuracy score by model using CNN is highest among other models using logistic regression, neural networks, and support vector machines. In addition, With the LRP that is one of the technique of XAI, variables that have a great influence on calculating the output value for each observation could be found.

ARTIFICIAL NEURAL NETWORK FOR PREDICTION OF WATER QUALITY IN PIPELINE SYSTEMS

  • Kim, Ju-Hwan;Yoon, Jae-Heung
    • Water Engineering Research
    • /
    • v.4 no.2
    • /
    • pp.59-68
    • /
    • 2003
  • The applicabilities and validities of two methodologies fur the prediction of THM (trihalomethane) formation in a water pipeline system were proposed and discussed. One is the multiple regression technique and the other is an artificial neural network technique. There are many factors which influence water quality, especially THMs formations in water pipeline systems. In this study, the prediction models of THM formation in water pipeline systems are developed based on the independent variables proposed by American Water Works Association(AWWA). Multiple linear/nonlinear regression models are estimated and three layer feed-forward artificial neural networks have been used to predict the THM formation in a water pipeline system. Input parameters of the models consist of organic compounds measured in water pipeline systems such as TOC, DOC and UV254. Also, the reaction time to each measuring site along pipeline is used as input parameter calculated by a hydraulic analysis. Using these variables as model parameters, four models are developed. And the predicted results from the four developed models are compared statistically to the measured THMs data set. It is shown that the artificial neural network approaches are much superior to the conventional regression approaches and that the developed models by neural network can be used more efficiently and reproduce more accurately the THMs formation in water pipeline systems, than the conventional regression methods proposed by AWWA.

  • PDF

Precision indices of neural networks for medicines: structure-activity correlation relationships

  • Zhu, Hanxi;Aoyama, Tomoo;Yoshihara, Ikuo;Lee, Seung-Woo;Kim, Wook-Hyun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.481-481
    • /
    • 2000
  • We investigated the structure-activity relationships on use of multi-layer neural networks. The relationships are techniques required in developments of medicines. Since many kinds of observations might be adopted on the techniques, we discussed some points between the observations and the properties of multi-layer neural networks. In the structure-activity relationships, an important property is not that standard deviations are nearly equal to zero for observed physiological activity, but prediction ability for unknown medicines. Since we adopted non-linear approximation, the function to represent the activity can be defined by observations; therefore, we believe that the standard deviations have not significance. The function was examined by "leave-one-out" method, which was originally introduced for the multi-regression analysis. In the linear approximation, the examination is significance, however, we believe that the method is inappropriate in case of nonlinear fitting as neural networks; therefore, we derived a new index fer the relationships from the differential of information propagation in the neural network. By using the index, we discussed physiological activity of an anti-cancer medicine, Mitomycine derivatives. The neuro-computing suggests that there is no direction to extend the anti-cancer activity of Mitomycine, which is close to the trend of anticancer developing.

  • PDF

Enhancement of Artillery Simulation Training System by Neural Network (신경망을 이용한 포병모의훈련체계 향상방안)

  • Ryu, Hai-Joon;Ko, Hyo-Heon;Kim, Ji-Hyun;Kim, Sung-Shick
    • Journal of the military operations research society of Korea
    • /
    • v.34 no.1
    • /
    • pp.1-11
    • /
    • 2008
  • A methodology for the improvement of simulation based training system for the artillery is proposed in this paper. The complex nonlinear relationship inherent among parameters in artillery firing is difficult to model and analyze. By introducing neural network based simulation, accurate representation of artillery firing is made possible. The artillery training system can greatly benefit from the improved prediction. Neural networks learning is conducted using the conjugate gradient algorithm. The evaluation of the proposed methodology is performed through simulation. Prediction errors of both regression analysis model and neural networks model are analyzed. Implementation of neural networks to training system enables more realistic training, improved combat power and reduced budget.