• Journal of the Korean Operations Research and Management Science Society
• /
• v.38 no.1
• /
• pp.139-152
• /
• 2013

The purpose of this study is to claim the validity of tuning the architecture of neural network models for multi-class classification. A neural network model for multi-class classification is basically constructed by building a series of neural network models for binary classification. Building a neural network model, we are required to set the values of parameters such as number of hidden nodes and weight decay parameter in advance, which draws special attention as the performance of the model can be quite different by the values of the parameters. For better performance of the model, it is absolutely necessary to have a prior process of tuning the parameters every time the neural network model is built. Nonetheless, previous studies have not mentioned the necessity of the tuning process or proved its validity. In this study, we claim that we should tune the parameters every time we build the neural network model for multi-class classification. Through empirical analysis using wine data, we show that the performance of the model with the tuned parameters is superior to those of untuned models.

• Journal of Environmental Impact Assessment
• /
• v.14 no.4
• /
• pp.157-164
• /
• 2005

Existing models that predict of Daily water supply include statistical models and neural network model. The neural network model was more effective than the statistical models. Only neural network model, which predict of Daily water supply, is focused on estimation of the operational control. Neural network model takes long learning time and gets into local minimum. This study proposes Neuro Genetic hybrid model which a combination of genetic algorithm and neural network. Hybrid model makes up for neural network's shortcomings. In this study, the amount of supply, the mean temperature and the population of the area supplied with water are use for neural network's learning patterns for prediction. RMSE(Root Mean Square Error) is used for a MOE(Measure Of Effectiveness). The comparison of the two models showed that the predicting capability of Hybrid model is more effective than that of neural network model. The proposed hybrid model is able to predict of Daily water, thus it can apply real time estimation of operational control of water works and water drain pipes. Proposed models include accidental cases such as a suspension of water supply. The maximum error rate between the estimation of the model and the actual measurement was 11.81% and the average error was lower than 1.76%. The model is expected to be a real-time estimation of the operational control of water works and water/drain pipes.

• International Journal of Advanced Culture Technology
• /
• v.11 no.3
• /
• pp.310-314
• /
• 2023

The purpose of this study is to predict the remaining capacity of lithium-ion batteries and evaluate their performance using five artificial intelligence models, including linear regression analysis, decision tree, random forest, neural network, and ensemble model. We is in the study, measured Excel data from the CS2 lithium-ion battery was used, and the prediction accuracy of the model was measured using evaluation indicators such as mean square error, mean absolute error, coefficient of determination, and root mean square error. As a result of this study, the Root Mean Square Error(RMSE) of the linear regression model was 0.045, the decision tree model was 0.038, the random forest model was 0.034, the neural network model was 0.032, and the ensemble model was 0.030. The ensemble model had the best prediction performance, with the neural network model taking second place. The decision tree model and random forest model also performed quite well, and the linear regression model showed poor prediction performance compared to other models. Therefore, through this study, ensemble models and neural network models are most suitable for predicting the remaining capacity of lithium-ion batteries, and decision tree and random forest models also showed good performance. Linear regression models showed relatively poor predictive performance. Therefore, it was concluded that it is appropriate to prioritize ensemble models and neural network models in order to improve the efficiency of battery management and energy systems.

• The Journal of Information Technology and Database
• /
• v.3 no.2
• /
• pp.75-96
• /
• 1996

This study is intended to compare the effectiveness of the neural network inductive learning model with a vector space model in information retrieval. As a result, searches responding to incomplete queries in the neural network inductive learning model produced a higher precision and recall as compared with searches responding to complete queries in the vector space model. The results show that the hybrid methodology of integrating an inductive learning technique with the neural network model can help solve information retrieval problems that are the results of inconsistent indexing and incomplete queries--problems that have plagued information retrieval effectiveness.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.56 no.7
• /
• pp.1315-1320
• /
• 2007

In this paper, we introduce a new fuzzy model called fuzzy combined polynomial neural networks, which are based on the representative fuzzy model named polynomial fuzzy model. In the design procedure of the proposed fuzzy model, the coefficients on consequent parts are estimated by using not general least square estimation algorithm that is a sort of global learning algorithm but weighted least square estimation algorithm, a sort of local learning algorithm. We are able to adopt various type of structures as the consequent part of fuzzy model when using a local learning algorithm. Among various structures, we select Polynomial Neural Networks which have nonlinear characteristic and the final result of which is a complex mathematical polynomial. The approximation ability of the proposed model can be improved using Polynomial Neural Networks as the consequent part.

• Journal of the Korean Society of Industry Convergence
• /
• v.16 no.3
• /
• pp.61-68
• /
• 2013

Long-term runoff model can be used to establish the effective plan of water reources allocation and the determination of the storage capacity of reservoir. So this study aims at the development of monthly runoff model using artificial neural network technique. For this, it was selected multi-layer neural network(MLN) and radial basis function neural network(RFN) model. In this study, it was applied model to analysis monthly runoff process at the Wi stream basin in Nakdong river which is representative experimental river basin of IHP. For this, multi-layer neural network model tried to construct input 3, hidden 7, and output 1 for each number of layer. As the result of analysis of monthly runoff process using models connected with artificial neural network technique, it showed that these models were effective in the simulation of monthly runoff.

• Communications for Statistical Applications and Methods
• /
• v.25 no.6
• /
• pp.659-671
• /
• 2018

In this study, we consider the extension of the heterogeneous autoregressive (HAR) model for realized volatility by incorporating a neural network (NN) structure. Since HAR is a linear model, we expect that adding a neural network term would explain the delicate nonlinearity of the realized volatility. Three neural network-based HAR models, namely HAR-NN, $HAR({\infty})-NN$, and HAR-AR(22)-NN are considered with performance measured by evaluating out-of-sample forecasting errors. The results of the study show that HAR-NN provides a slightly wider interval than traditional HAR as well as shows more peaks and valleys on the turning points. It implies that the HAR-NN model can capture sharper changes due to higher volatility than the traditional HAR model. The HAR-NN model for prediction interval is therefore recommended to account for higher volatility in the stock market. An empirical analysis on the multinational realized volatility of stock indexes shows that the HAR-NN that adds daily, weekly, and monthly volatility averages to the neural network model exhibits the best performance.

• 제어로봇시스템학회:학술대회논문집
• /
• 1992.10a
• /
• pp.490-495
• /
• 1992

A neural model predictive control strategy combining a neural network for plant identification and a nonlinear programming algorithm for solving nonlinear control problems is proposed. A constrained nonlinear optimization approach using successive quadratic programming cooperates with neural identification network is used to generate the optimum control law for the complicate continuous/batch chemical reactor systems that have inherent nonlinear dynamics. Based on our approach, we developed a neural model predictive controller(NMPC) which shows excellent performances on nonlinear, model-plant mismatch cases of chemical reactor systems.

• Smart Media Journal
• /
• v.11 no.3
• /
• pp.26-30
• /
• 2022

Spiking neural network is a neural network that applies the working principle of real brain neurons. Due to the biological mechanism of neurons, it consumes less power for training and reasoning than conventional neural networks. Recently, as deep learning models become huge and operating costs increase exponentially, the spiking neural network is attracting attention as a third-generation neural network that connects convolution neural networks and recurrent neural networks, and related research is being actively conducted. However, in order to apply the spiking neural network model to the industry, a lot of research still needs to be done, and the problem of model retraining to apply a new model must also be solved. In this paper, we propose a method to minimize the cost of model retraining by extracting the weights of the existing trained deep learning model and converting them into the weights of the spiking neural network model. In addition, it was found that weight conversion worked correctly by comparing the results of inference using the converted weights with the results of the existing model.

• International Journal of Control, Automation, and Systems
• /
• v.6 no.1
• /
• pp.24-34
• /
• 2008

A novel neural network model, termed the standard neural network model (SNNM), similar to the nominal model in linear robust control theory, is suggested to facilitate the synthesis of controllers for delayed (or non-delayed) nonlinear systems composed of neural networks. The model is composed of a linear dynamic system and a bounded static delayed (or non-delayed) nonlinear operator. Based on the global asymptotic stability analysis of SNNMs, Static state-feedback controller and dynamic output feedback controller are designed for the SNNMs to stabilize the closed-loop systems, respectively. The control design equations are shown to be a set of linear matrix inequalities (LMIs) which can be easily solved by various convex optimization algorithms to determine the control signals. Most neural-network-based nonlinear systems with time delays or without time delays can be transformed into the SNNMs for controller synthesis in a unified way. Two application examples are given where the SNNMs are employed to synthesize the feedback stabilizing controllers for an SISO nonlinear system modeled by the neural network, and for a chaotic neural network, respectively. Through these examples, it is demonstrated that the SNNM not only makes controller synthesis of neural-network-based systems much easier, but also provides a new approach to the synthesis of the controllers for the other type of nonlinear systems.