• Journal of information and communication convergence engineering
• /
• v.13 no.2
• /
• pp.123-131
• /
• 2015

Training neural networks is a complex task with great importance in the field of supervised learning. In the training process, a set of input-output patterns is repeated to an artificial neural network (ANN). From those patterns weights of all the interconnections between neurons are adjusted until the specified input yields the desired output. In this paper, a new hybrid algorithm is proposed for global optimization of connection weights in an ANN. Dynamic swarms are shown to converge rapidly during the initial stages of a global search, but around the global optimum, the search process becomes very slow. In contrast, the gradient descent method can achieve faster convergence speed around the global optimum, and at the same time, the convergence accuracy can be relatively high. Therefore, the proposed hybrid algorithm combines the dynamic particle swarm optimization (DPSO) algorithm with the backpropagation (BP) algorithm, also referred to as the DPSO-BP algorithm, to train the weights of an ANN. In this paper, we intend to show the superiority (time performance and quality of solution) of the proposed hybrid algorithm (DPSO-BP) over other more standard algorithms in neural network training. The algorithms are compared using two different datasets, and the results are simulated.

• ETRI Journal
• /
• v.44 no.5
• /
• pp.849-858
• /
• 2022

Dynamic voltage frequency scaling (DVFS) has been widely adopted for runtime power management of various processing units. In the case of neural processing units (NPUs), power management of neural network applications is required to adjust the frequency and voltage every layer to consider the power behavior and performance of each layer. Unfortunately, DVFS is inappropriate for layer-wise run-time power management of NPUs due to the long latency of voltage scaling compared with each layer execution time. Because the frequency scaling is fast enough to keep up with each layer, we propose a layerwise dynamic frequency scaling (DFS) technique for an NPU. Our proposed DFS exploits the highest frequency under the power limit of an NPU for each layer. To determine the highest allowable frequency, we build a power model to predict the power consumption of an NPU based on a real measurement on the fabricated NPU. Our evaluation results show that our proposed DFS improves frame per second (FPS) by 33% and saves energy by 14% on average, compared with DVFS.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.35 no.11
• /
• pp.990-998
• /
• 2007

Adaptive output feedback control technique using Neural Networks(NN) is proposed for uncertain nonlinear Multi-Input Multi-Output(MIMO) systems. Modified Dynamic Inversion Model(MDIM) is introduced to decouple uncertain nonlinearities from inversion-based control input. MDIM consists of approximated dynamic inversion model and inversion model error. One NN is applied to compensate the MDIM of the system. The output of the NN augments the tracking controller which is based upon a filtered error approximation with online weight adaptation laws which are derived from Lyapunov's direct method to guarantee tracking performance and ultimate boundedness. Several numerical results are illustrated in the simulation of Van der Pol system and unmanned helicopter with model uncertainties.

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2001.11b
• /
• pp.46-51
• /
• 2001

For Fast Real-time Recognition of Nonlinear Error Data, a new Neural Network algorithm which recognized the map in real time is proposed. The proposed neural network technique is the real time computation method through the inter-node diffusion, In the network, a node corresponds to a state in the quantized input space. Each node is composed of a processing unit and fixed weights from its neighbor nodes as well as its input terminal. The most reliable algorithm derived for real time recognition of map, is a dynamic programming based algorithm based on sequence matching techniques that would process the data as it arrives and could therefore provide continuously updated neighbor information estimates. Through several simulation experiments, real time reconstruction of the nonlinear map information is processed,

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2003.05b
• /
• pp.90-95
• /
• 2003

For the safety driving of an automobile which is become individual requisites, a new Neural Network algorithm which recognized the load vehicles in real time is proposed. The proposed neural network technique is the real time computation method through the inter-node diffusion. In the network, a node corresponds to a state in the quantized input space. Each node is composed of a processing unit and fixed weights from its neighbor nodes as well as its input terminal. The most reliable algorithm derived for real time recognition of vehicles, is a dynamic programming based algorithm based on sequence matching techniques that would process the data as it arrives and could therefore provide continuously updated neighbor information estimates. Through several simulation experiments, real time reconstruction of the nonlinear image information is processed. 1-D LIPN hardware has been composed and various experiments with static and dynamic signals have been implemented.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.7 no.5
• /
• pp.60-66
• /
• 1997

This paper presents a fuzzy inference-based reinforcement learning algorithm of dynamci recurrent neural networks, which is very similar to the psychological learning method of higher animals. By useing the fuzzy inference technique the linguistic and concetional expressions have an effect on the controller's action indirectly, which is shown in human's behavior. The intervlas of fuzzy membership functions are found optimally by genetic algorithms. And using recurrent neural networks composed of dynamic neurons as action-generation networks, past state as well as current state is considered to make an action in dynamical environment. We show the validity of the proposed learning algorithm by applying it to the inverted pendulum control problem.

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2001.11a
• /
• pp.46-51
• /
• 2001

For Fast Real-time Recognition of Nonlinear Error Data, a new Neural Network algorithm which recognized the map in real time is proposed. The proposed neural network technique is the real time computation method through the inter-node diffusion. In the network, a node corresponds to a state in the quantized input space. Each node is composed of a processing unit and fixed weights from its neighbor nodes as well as its input terminal. The most reliable algorithm derived for real time recognition of map, is a dynamic programming based algorithm based on sequence matching techniques that would process the data as it arrives and could therefore provide continuously updated neighbor information estimates. Through several simulation experiments, real time reconstruction of the nonlinear map information is processed.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.1728-1729
• /
• 2007

This paper presents an adaptive neural dynamic surface control (DSC) approach with $H_{\infty}$ tracking performance for a full dynamics of a nonlinear flight system. It is assumed in this paper that model uncertainties such as structured and unstrutured uncertainties and external disturbances influence the nonlinear aircraft model. In our control system, self recurrent wavelet neural networks (SRWNNs) are used to compensate model uncertainties of the nonlinear flight system, and an adaptive DSC technique is extended for disturbance attenuation of the nonlinear flight system. From Lyapunov stability theorem, it is shown that $H_{\infty}$ performance from external disturbances can be obtained. Finally, we perform the simulation for the nonlinear six-degree-of-freedom F-16 aircraft model to confirm the effectiveness of the proposed control system.

• Proceedings of the KIEE Conference
• /
• 2001.07d
• /
• pp.2283-2285
• /
• 2001

This paper proposed to a neural network based fuzzy control (neuro-fuzzy control) technique for attitude control of helicopter with strongly dynamic nonlinearities and derived a helicopter aerodynamic torque equation of helicopter and the force balance equation. A neuro-fuzzy system is a feedforward network that employs a back-propagation algorithm for learning purpose. A neuro-fuzzy system is used to identify nonlinear dynamic systems. Hence, this paper presents methods for the design of a neural network(NN) based fuzzy controller(that is, neuro-fuzzy control) for a helicopter of nonlinear MIMO systems. The proposed neuro-fuzzy control determined to a input-output membership function in fuzzy control and neural networks constructed to improve through learning of input-output membership functions determined in fuzzy control.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2004.11a
• /
• pp.219-222
• /
• 2004

This research is about SDM (Structural Dynamics Modification) technique using embosses. SDM using embosses do not need to add additional mass element ana model of embosses and resulting huge calculation for getting analytical solution of an embossed structure. The object of this research is to suggest a method to guide placing embossment in a structure to raise its natural frequencies. Two methods to optimize model with embossing are suggested, indepuldently. The former is response surface analysis by neural network. And the latter is an indirect method using modal dynamic strain energy.