• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.31B no.7
• /
• pp.179-189
• /
• 1994

A two-phase neural network finds exact feasible solutions for a constrained optimization programming problem. The time-varying programming neural network is a modified steepest-gradient algorithm which solves time-varying optimization problems. In this paper, we propose a time-varying two-phase optimization neural network which incorporates the merits of the two-phase neural network and the time-varying neural network. The proposed algorithm is applied to system identification and function approximation using a multi-layer perceptron. Particularly training of a multi-layer perceptrion is regarded as a time-varying optimization problem. Our algorithm can also be applied to the case where the weights are constrained. Simulation results prove the proposed algorithm is efficient for solving various optimization problems.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.16 no.7
• /
• pp.1322-1331
• /
• 1992

The conventional neural networks are built without considering the underlying structure of the problems. Hence, they usually contain redundant weights and require excessive training time. A novel neural network structure is proposed for symmetric problems, which alleviate some of the aforementioned drawback of the conventional neural networks. This concept is expanded to that of the constrained neural network which may be applied to general structured problems. Because these neural networks can not be trained by the conventional training algorithm, which destroys the weight structure of the neural networks, a proper training algorithm is suggested. The illustrative examples are shown to demonstrate the applicability of the proposed idea.

• 제어로봇시스템학회:학술대회논문집
• /
• 1992.10a
• /
• pp.490-495
• /
• 1992

A neural model predictive control strategy combining a neural network for plant identification and a nonlinear programming algorithm for solving nonlinear control problems is proposed. A constrained nonlinear optimization approach using successive quadratic programming cooperates with neural identification network is used to generate the optimum control law for the complicate continuous/batch chemical reactor systems that have inherent nonlinear dynamics. Based on our approach, we developed a neural model predictive controller(NMPC) which shows excellent performances on nonlinear, model-plant mismatch cases of chemical reactor systems.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1993.06a
• /
• pp.899-902
• /
• 1993

A neural model predictive control strategy combining a neural network for plant identification and a nonlinear programming algorithm for solving nonlinear control problems is proposed. A constrained nonlinear optimization approach using successive quadratic programming combined with neural identification network is used to generate the optimum control law for complex continuous chemical reactor systems that have inherent nonlinear dynamics. The neural model predictive controller (MNPC) shows good performances and robustness. To whom all correspondence should be addressed.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.16 no.1
• /
• pp.9-15
• /
• 2021

Recently, it is increasingly necessary to run high-end neural network applications with huge computation overhead on top of resource-constrained embedded systems, such as wearable devices. While the huge computational overhead can be alleviated by distributed neural networks running on multiple separate devices, existing distributed neural network techniques suffer from a large traffic between the devices; thus are very vulnerable to communication failures. These drawbacks make the distributed neural network techniques inapplicable to wearable devices, which are connected with each other through unstable and low data rate communication medium like human body communication. Therefore, in this paper, we propose a distributed neural network partitioning technique that is resilient to communication failures. Furthermore, we show that the proposed technique also improves the inference accuracy even in case of no communication failure, thanks to the improved network partitioning. We verify through comparative experiments with a real-life neural network application that the proposed technique outperforms the existing state-of-the-art distributed neural network technique in terms of accuracy and resiliency to communication failures.

• 제어로봇시스템학회:학술대회논문집
• /
• 1994.10a
• /
• pp.434-439
• /
• 1994

Recently neural networks leave been proposed as new computational tools for solving constrained optimization problems because of its computational power. In this paper, the shortest path finding algorithm is proposed by rising a Hopfield type neural network. In order to design a Hopfield type neural network, an energy function must be defined at first. To obtain this energy function, the concept of a vector-represented network is introduced to describe the connected path. Through computer simulations, it will be shown that the proposed algorithm works very well in many cases. The local minima problem of a Hopfield type neural network is discussed.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10b
• /
• pp.1169-1172
• /
• 1996

A time-optimal control law for quick, strongly nonlinear systems has been developed and demonstrated. This procedure involves the utilization of neural networks as state feedback controllers that learn the time-optimal control actions by means of an iterative minimization of both the final time and the final state error for the known and unknown systems with constrained inputs and/or states. The nature of neural networks as a parallel processor would circumvent the problem of "curse of dimensionality". The control law has been demonstrated for a velocity input type motor identified by a genetic algorithm called GENOCOP.

• The Journal of the Acoustical Society of Korea
• /
• v.21 no.6
• /
• pp.522-530
• /
• 2002

This paper introduces a neural network (NN) -based nonlinear predictor for the LP (Linear Prediction) residual. To evaluate the effectiveness of the NN-based nonlinear predictor for LP-residual, we first compared the average prediction gain of the linear long-term predictor with that of the NN-based nonlinear long-term predictor. Then, the effects on the quantization noise of the nonlinear prediction residuals were investigated for the NN-based nonlinear predictor A new NN predictor takes into consideration not only prediction error but also quantization effects. To increase robustness against the quantization noise of the nonlinear prediction residual, a constrained back propagation learning algorithm, which satisfies a Kuhn-Tucker inequality condition is proposed. Experimental results indicate that the prediction gain of the proposed NN predictor was not seriously decreased even when the constrained optimization algorithm was employed.

• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.48 no.12
• /
• pp.1498-1506
• /
• 1999

In this paper, a hybridization of Evolutionary Strategy (ES) and a Two-Phase Neural Network(TPNN) is applied to the optimal environmental and economic operation. As the evolutionary computation, ES is to search for the global optimum based on natural selection and genetics but it shows a defect of reducing the convergence rate in the latter part of search, and often does not search the exact solution. Also, neural network theory as a local search technique can be used to search a more exact solution. But it also has the defect that a solution frequently sticks to the local region. So, new algorithm is presented as hybrid methods by combining merits of two methods. The hybrid algorithm has been tested on Emission Constrained Economic Dispatch (ECED) problem and Weighted Emission Economic Dispatch (WEED) problem for optimal environmental and economic operation. The result indicated that the hybrid approach can outperform the other computational efficiency and accuracy.

• Proceedings of the KIEE Conference
• /
• 1998.07c
• /
• pp.1100-1102
• /
• 1998

This paper presents the Two-Phase Neural Network(TPNN) to slove the Optimal Economic Environmental Dispatch problem of thermal generating units in electric power system. The TPNN, Compared with other Neural Networks, is very accurate and it takes smaller computer time for a optimization problem to converge. In this work, in order to provide useful information to the system operator, we are used the total environmental weight and relative weighting of individual insults(e.g., $SO_2$, $NO_X$ and $CO_2$) also, presented the simulation results of the dispatch changes according to the weights. The Two-Phase Neural Network is tested on a 11-unit 3-pollutant system to prove of effectiveness and applicability.