• Title/Summary/Keyword: regression

검색결과 35,637건 처리시간 0.047초

Optimized Neural Network Weights and Biases Using Particle Swarm Optimization Algorithm for Prediction Applications

  • Ahmadzadeh, Ezat;Lee, Jieun;Moon, Inkyu
    • 한국멀티미디어학회논문지
    • /
    • 제20권8호
    • /
    • pp.1406-1420
    • /
    • 2017
  • Artificial neural networks (ANNs) play an important role in the fields of function approximation, prediction, and classification. ANN performance is critically dependent on the input parameters, including the number of neurons in each layer, and the optimal values of weights and biases assigned to each neuron. In this study, we apply the particle swarm optimization method, a popular optimization algorithm for determining the optimal values of weights and biases for every neuron in different layers of the ANN. Several regression models, including general linear regression, Fourier regression, smoothing spline, and polynomial regression, are conducted to evaluate the proposed method's prediction power compared to multiple linear regression (MLR) methods. In addition, residual analysis is conducted to evaluate the optimized ANN accuracy for both training and test datasets. The experimental results demonstrate that the proposed method can effectively determine optimal values for neuron weights and biases, and high accuracy results are obtained for prediction applications. Evaluations of the proposed method reveal that it can be used for prediction and estimation purposes, with a high accuracy ratio, and the designed model provides a reliable technique for optimization. The simulation results show that the optimized ANN exhibits superior performance to MLR for prediction purposes.

감조하천에서의 저수위 유량산정 다중회귀식 개발 (Development of Regression Equation for Water Quantity Estimation in a Tidal River)

  • 이상진;류경식;이배성;윤종수
    • 한국물환경학회지
    • /
    • 제23권3호
    • /
    • pp.385-390
    • /
    • 2007
  • Reliable flow measurement for dry season is very important to set up the in-stream flow exactly and total maximum daily load control program in the basin. Especially, in the points which tidal current effects are dominant because reliability of the low measurement decrease. The reliable measuring methods are needed. In this study, we analysis the water surface elevation difference of water surface elevation. Quantity relationship to consider tidal currents in these regions. It is known that tidal current effects from Nakdong river barrage are dominant in Samrangjin measuring station. We developed multiple regression equation with water surface elevation, quantity, and difference of water surface elevation and compared these results water measured rating curve. All of these regression equation including linear regression equation and log regression equation fits better measured data them existing water surface elevation quantity line and Among three equations, the log regression equation is best to represent the measured the rating curve in Samrangjin point. The log regression equation is useful method to obtain the quantity in the regions which tidal currents are dominant.

Support Vector Machine for Interval Regression

  • Hong Dug Hun;Hwang Changha
    • 한국통계학회:학술대회논문집
    • /
    • 한국통계학회 2004년도 학술발표논문집
    • /
    • pp.67-72
    • /
    • 2004
  • Support vector machine (SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate interval linear and nonlinear regression models combining the possibility and necessity estimation formulation with the principle of SVM. For data sets with crisp inputs and interval outputs, the possibility and necessity models have been recently utilized, which are based on quadratic programming approach giving more diverse spread coefficients than a linear programming one. SVM also uses quadratic programming approach whose another advantage in interval regression analysis is to be able to integrate both the property of central tendency in least squares and the possibilistic property In fuzzy regression. However this is not a computationally expensive way. SVM allows us to perform interval nonlinear regression analysis by constructing an interval linear regression function in a high dimensional feature space. In particular, SVM is a very attractive approach to model nonlinear interval data. The proposed algorithm here is model-free method in the sense that we do not have to assume the underlying model function for interval nonlinear regression model with crisp inputs and interval output. Experimental results are then presented which indicate the performance of this algorithm.

  • PDF

플라스틱 금형강의 선삭 가공시 중회귀분석을 이용한 표면거칠기 예측 (Predict of Surface Roughness Using Multi-regression Analysisin Turning of Plastic Mold Steel)

  • 배명일;이이선
    • 한국기계가공학회지
    • /
    • 제12권4호
    • /
    • pp.87-92
    • /
    • 2013
  • In this study, we carried out the turning of plastic mold steel(STAVAX) with whisker reinforced ceramic tool(WA1) and analyzed ANOVA(Analysis of Variance) test. Multi-regression analysis was performed to find influential factors to surface roughness and to derive regression equation. Results are follows: From ANOVA test and confidence interval analysis of surface roughness, We found that influential factors to surface roughness was feed rate, cutting speed and depth of cut in order. From multi-regression analysis, we derived regression equation of STAVAX. it's coefficient of determination($R^2$) was 0.945 and It means that regression equation is significant. From experimental verification, we confirmed that surface roughness was predictable by regression equation. Compared with former research, we confirmed that increase of feed rate is the main cause of the growing of surface roughness and cutting force.

TIME SERIES PREDICTION USING INCREMENTAL REGRESSION

  • Kim, Sung-Hyun;Lee, Yong-Mi;Jin, Long;Chai, Duck-Jin;Ryu, Keun-Ho
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2006년도 Proceedings of ISRS 2006 PORSEC Volume II
    • /
    • pp.635-638
    • /
    • 2006
  • Regression of conventional prediction techniques in data mining uses the model which is generated from the training step. This model is applied to new input data without any change. If this model is applied directly to time series, the rate of prediction accuracy will be decreased. This paper proposes an incremental regression for time series prediction like typhoon track prediction. This technique considers the characteristic of time series which may be changed over time. It is composed of two steps. The first step executes a fractional process for applying input data to the regression model. The second step updates the model by using its information as new data. Additionally, the model is maintained by only recent data in a queue. This approach has the following two advantages. It maintains the minimum information of the model by using a matrix, so space complexity is reduced. Moreover, it prevents the increment of error rate by updating the model over time. Accuracy rate of the proposed method is measured by RME(Relative Mean Error) and RMSE(Root Mean Square Error). The results of typhoon track prediction experiment are performed by the proposed technique IMLR(Incremental Multiple Linear Regression) is more efficient than those of MLR(Multiple Linear Regression) and SVR(Support Vector Regression).

  • PDF

스월 인젝션 하이브리드 로켓의 고체연료 국부 후퇴율에 관한 연구 (A Study on the Local Regression Rate of Solid Fuel in Swirl Injection Hybrid Rocket)

  • 김수종;이정표;김기훈;조정태;문희장;성홍계;김진곤
    • 한국추진공학회:학술대회논문집
    • /
    • 한국추진공학회 2008년도 제30회 춘계학술대회논문집
    • /
    • pp.77-81
    • /
    • 2008
  • 스월 인젝션 하이브리드 로켓의 고체연료에서 축 방향 국부 후퇴율 거동을 고찰하였다. 일반적으로 축 인젝션 후퇴율은 연료 그레인 축 위치가 입구에서 멀어질수록 감소하다가, 다시 증가하는 경향을 보인다. 이에 반해 스월 인젝션 후퇴율은 연료 입구부에서 높고, 하류에서는 비교적 균일한 후퇴율을 보임을 확인하였다. 전체 후퇴율은 스월 인젝션의 경우가 축 인젝션의 경우에 비해 54% 증가하였다. 본 연구를 통해 소형 사운딩 로켓에서 스월 인젝터를 사용하는 것이 유용할 수 있음을 확인하였다.

  • PDF

단일특징 분할 회귀트리의 학습성능 개선을 위한 회귀신경망 (Regression Neural Networks for Improving the Learning Performance of Single Feature Split Regression Trees)

  • 임숙;김성천
    • 전자공학회논문지B
    • /
    • 제33B권1호
    • /
    • pp.187-194
    • /
    • 1996
  • 본 논문은 회귀트리에 기반을 둔 회귀 신경망을 제안한다. 회귀트리를 세 개의 계층을 갖는 전향 신경망에 사상하고, 첫 번째 계층에 다중특징 분할함수를 형성시켜 신경망이 보다 더 최적인 입력 공간의 분할을 갖도록 한다. 본 연구에서는 신경망 트레이닝을 위한 두 가지 지도 학습 알고리즘을 제안하여 단일특징 분할함수와 다중특징 분할함수에 실험한다. 실험결과, 제안된 회귀 신경망은 기존의 단일특징 분할 회귀트리 및 단일특징 분할 회귀신경망보다 학습능력이 우수함을 입증한다. 또한 본 논문에서 제안한 알고리즘이 학습 능력을 저하시키지 않으면서도 효과적으로 과성장한 회귀트리를 가지치기 할 수 있음을 보인다.

  • PDF

Comparison of machine learning techniques to predict compressive strength of concrete

  • Dutta, Susom;Samui, Pijush;Kim, Dookie
    • Computers and Concrete
    • /
    • 제21권4호
    • /
    • pp.463-470
    • /
    • 2018
  • In the present study, soft computing i.e., machine learning techniques and regression models algorithms have earned much importance for the prediction of the various parameters in different fields of science and engineering. This paper depicts that how regression models can be implemented for the prediction of compressive strength of concrete. Three models are taken into consideration for this; they are Gaussian Process for Regression (GPR), Multi Adaptive Regression Spline (MARS) and Minimax Probability Machine Regression (MPMR). Contents of cement, blast furnace slag, fly ash, water, superplasticizer, coarse aggregate, fine aggregate and age in days have been taken as inputs and compressive strength as output for GPR, MARS and MPMR models. A comparatively large set of data including 1030 normalized previously published results which were obtained from experiments were utilized. Here, a comparison is made between the results obtained from all the above mentioned models and the model which provides the best fit is established. The experimental results manifest that proposed models are robust for determination of compressive strength of concrete.

MOISTURE CONTENT MEASUREMENT OF POWDERED FOOD USING RF IMPEDANCE SPECTROSCOPIC METHOD

  • Kim, K. B.;Lee, J. W.;S. H. Noh;Lee, S. S.
    • 한국농업기계학회:학술대회논문집
    • /
    • 한국농업기계학회 2000년도 THE THIRD INTERNATIONAL CONFERENCE ON AGRICULTURAL MACHINERY ENGINEERING. V.II
    • /
    • pp.188-195
    • /
    • 2000
  • This study was conducted to measure the moisture content of powdered food using RF impedance spectroscopic method. In frequency range of 1.0 to 30㎒, the impedance such as reactance and resistance of parallel plate type sample holder filled with wheat flour and red-pepper powder of which moisture content range were 5.93∼-17.07%w.b. and 10.87 ∼ 27.36%w.b., respectively, was characterized using by Q-meter (HP4342). The reactance was a better parameter than the resistance in estimating the moisture density defined as product of moisture content and bulk density which was used to eliminate the effect of bulk density on RF spectral data in this study. Multivariate data analyses such as principal component regression, partial least square regression and multiple linear regression were performed to develop one calibration model having moisture density and reactance spectral data as parameters for determination of moisture content of both wheat flour and red-pepper powder. The best regression model was one by the multiple linear regression model. Its performance for unknown data of powdered food was showed that the bias, standard error of prediction and determination coefficient are 0.179% moisture content, 1.679% moisture content and 0.8849, respectively.

  • PDF

알루미늄 합금의 레이저 가공에서 인장 강도 예측을 위한 회귀 모델 및 신경망 모델의 개발 (Development of Statistical Model and Neural Network Model for Tensile Strength Estimation in Laser Material Processing of Aluminum Alloy)

  • 박영환;이세헌
    • 한국정밀공학회지
    • /
    • 제24권4호
    • /
    • pp.93-101
    • /
    • 2007
  • Aluminum alloy which is one of the light materials has been tried to apply to light weight vehicle body. In order to do that, welding technology is very important. In case of the aluminum laser welding, the strength of welded part is reduced due to porosity, underfill, and magnesium loss. To overcome these problems, laser welding of aluminum with filler wire was suggested. In this study, experiment about laser welding of AA5182 aluminum alloy with AA5356 filler wire was performed according to process parameters such as laser power, welding speed and wire feed rate. The tensile strength was measured to find the weldability of laser welding with filler wire. The models to estimate tensile strength were suggested using three regression models and one neural network model. For regression models, one was the multiple linear regression model, another was the second order polynomial regression model, and the other was the multiple nonlinear regression model. Neural network model with 2 hidden layers which had 5 and 3 nodes respectively was investigated to find the most suitable model for the system. Estimation performance was evaluated for each model using the average error rate. Among the three regression models, the second order polynomial regression model had the best estimation performance. For all models, neural network model has the best estimation performance.