• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.1281-1284
• /
• 1998

This paper proposes an efficient time series prediction of the nonlinear dynamical discrete-time systems using multilayer neural networks of a hybrid learning algorithm. The proposed learning algorithm is a hybrid backpropagation algorithm based on the steepest descent for high-speed optimization and the dynamic tunneling for global optimization. The proposed algorithm has been applied to the y00 samples of 700 sequences to predict the next 100 samples. The simulation results shows that the proposed algorithm has better performances of the convergence and the prediction, in comparision with that using backpropagation algorithm based on the gradient descent for multilayer neural network.

• Proceedings of the KSME Conference
• /
• 2001.11a
• /
• pp.821-826
• /
• 2001

Out of all metal-cutting processes, the hole-making process is the most widely used. It is estimated to be more than 30% of the total metal-cutting process. It is therefore desirable to monitor and detect drill wear during the hole-drilling process. One important aspect in controlling the drilling process is monitoring drill wear status. Accordingly, this paper deals with Basic system and Online system. Basic system comprised of spindle rotational speed, feed rates, thrust, torque and flank wear measured tool microscope. Online system comprised of spindle rotational speed, feed rates, AE signal, flank wear area measured computer vision. On-line monitoring system does not need to stop the process to inspect drill wear. Backpropagation neural networks (BPNs) were used for on-line detection of drill wear. This paper deals with an on-line drill wear monitoring system to fit the detection of the abnormal tool state.

• Transactions of the Korean Society of Machine Tool Engineers
• /
• v.14 no.6
• /
• pp.16-21
• /
• 2005

The cutting characteristics of hardened steel(AISI 52100) by PCBN tools is investigated with respect to cutting force, workpiece surface roughness and tool flank wear by the vision system. Hard Owning is carried out with various cutting conditions; spindle rotational speed, depth of cut and feed rate. Backpropagation neural networks(BPNs) are used for detection of tool wear. The input vectors of neural network comprise of spindle rotational speed, feed rates, vision flank wear, and thrust force signals. The output is the tool wear state which is either usable or failure. The detection of the abnormal states using BPNs achieves $96.8\%$ reliability even when the spindle rotational speed and feedrate are changed.

• Journal of Intelligence and Information Systems
• /
• v.22 no.2
• /
• pp.127-142
• /
• 2016

Deep learning model is a kind of neural networks that allows multiple hidden layers. There are various deep learning architectures such as convolutional neural networks, deep belief networks and recurrent neural networks. Those have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. Among those architectures, convolutional neural networks and recurrent neural networks are classified as the supervised learning model. And in recent years, those supervised learning models have gained more popularity than unsupervised learning models such as deep belief networks, because supervised learning models have shown fashionable applications in such fields mentioned above. Deep learning models can be trained with backpropagation algorithm. Backpropagation is an abbreviation for "backward propagation of errors" and a common method of training artificial neural networks used in conjunction with an optimization method such as gradient descent. The method calculates the gradient of an error function with respect to all the weights in the network. The gradient is fed to the optimization method which in turn uses it to update the weights, in an attempt to minimize the error function. Convolutional neural networks use a special architecture which is particularly well-adapted to classify images. Using this architecture makes convolutional networks fast to train. This, in turn, helps us train deep, muti-layer networks, which are very good at classifying images. These days, deep convolutional networks are used in most neural networks for image recognition. Convolutional neural networks use three basic ideas: local receptive fields, shared weights, and pooling. By local receptive fields, we mean that each neuron in the first(or any) hidden layer will be connected to a small region of the input(or previous layer's) neurons. Shared weights mean that we're going to use the same weights and bias for each of the local receptive field. This means that all the neurons in the hidden layer detect exactly the same feature, just at different locations in the input image. In addition to the convolutional layers just described, convolutional neural networks also contain pooling layers. Pooling layers are usually used immediately after convolutional layers. What the pooling layers do is to simplify the information in the output from the convolutional layer. Recent convolutional network architectures have 10 to 20 hidden layers and billions of connections between units. Training deep learning networks has taken weeks several years ago, but thanks to progress in GPU and algorithm enhancement, training time has reduced to several hours. Neural networks with time-varying behavior are known as recurrent neural networks or RNNs. A recurrent neural network is a class of artificial neural network where connections between units form a directed cycle. This creates an internal state of the network which allows it to exhibit dynamic temporal behavior. Unlike feedforward neural networks, RNNs can use their internal memory to process arbitrary sequences of inputs. Early RNN models turned out to be very difficult to train, harder even than deep feedforward networks. The reason is the unstable gradient problem such as vanishing gradient and exploding gradient. The gradient can get smaller and smaller as it is propagated back through layers. This makes learning in early layers extremely slow. The problem actually gets worse in RNNs, since gradients aren't just propagated backward through layers, they're propagated backward through time. If the network runs for a long time, that can make the gradient extremely unstable and hard to learn from. It has been possible to incorporate an idea known as long short-term memory units (LSTMs) into RNNs. LSTMs make it much easier to get good results when training RNNs, and many recent papers make use of LSTMs or related ideas.

• Journal of Welding and Joining
• /
• v.11 no.4
• /
• pp.44-56
• /
• 1993

The arc welding processes are substantially nonlinear, in addition to being highly coupled multivariable systems, Frequently, not all the variables affecting the welding quality are known, nor may they be easily quantified. From this point of view, decoupling between the welding parameters from the welding quality is very difficult, which makes it also difficult to control the welding parameters for obtaining the desired welding quality. In this study, a neural network based on the backpropagation algorithm was implemented and adopted for the selection of gas metal arc welding parameters of the fillet joint, that is, welding current, arc voltage and welding speed. The performance of the neural network for modeling the relationship between the welding quality and welding parameters was presented and evaluated by using the actual welding data. To obtain the optimal neural network structure, various types of the neural network structures were tested with the experimental data. It was revealed that the neural network can be effectively adopted to select the appropriate gas metal arc welding parameter of fillet joints for a given weld quality.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.2 no.2
• /
• pp.95-99
• /
• 2002

The Loose Part Monitoring System(LPMS) has been designed to detect. locate and evaluate detached or loosened parts and foreign objects in the reactor coolant system. In this paper, at first, we presents an application of the back propagation neural network. At the preprocessing step, the moving window average filter is adopted to reject the reject the low frequency background noise components. And then, extracting the acoustic signature such as Starting point of impact signal. Rising time. Half period. and Global time, they are used as the inputs to neural network . Secondly, we applied the neural network algorithm to LPMS in order to estimate the mass of loose parts. We trained the impact test data of YGN3 using the backpropagation method. The input parameter for training is Rising clime. Half Period amplitude. The result shored that the neural network would be applied to LPMS. Also, applying the neural network to thin practical false alarm data during startup and impact test signal at nuclear power plant, the false alarms are reduced effectively.

• Proceedings of the Korean Society of Machine Tool Engineers Conference
• /
• 2004.10a
• /
• pp.280-285
• /
• 2004

In this study, we made a comparative study of backpropagation neural network and probabilistic neural network and bayesian classifier and perceptron as shape recognition algorithm of welding flaws. For this purpose, variables are applied the same to four algorithms. Here, feature variable is composed of time domain signal itself and frequency domain signal itself. Through this process, we comfirmed advantages/disadvantages of four algorithms and identified application methods of four algorithms.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.05a
• /
• pp.153-156
• /
• 2003

본 연구는 화자종속 소어휘 음성인식의 성능을 개선하는 데 그 목적이 있다. 인식에 사용될 음성의 특징을 얻기 위해 Winer 필터와 LPC＆Cepstrum을 이용하여 프레임 당 12차 패턴을 추출하였다. 추출된 특징패턴을 인식하는 인식부는 특히 소어휘 음성인식에 우수한 성능을 보이는 기존의 역전파 신경회로망(Backpropagation Neural Network)에 인식율 개선을 위하여 퍼지추론시스템을 결합한 형태로 구현되었다. 실험결과 신경망만을 사용한 경우에 비하여 인식율이 향상됨을 연구하였다.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1996.11a
• /
• pp.206-211
• /
• 1996

A major problem in automation of turning operation is the difficulty in obtaining a sufficient and reliable chip control. Therefore it becomes desirable to find a method which can detect the chip form. In this paper, a method of the identification of chip form using output of pyrometer and neural network technique is developed. An efficiency of developed method is examined by experiments in turning and the validity of it is confirmed.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.28B no.12
• /
• pp.59-67
• /
• 1991

In this paper, we aimed to develop associative pattern recognizer based on neural network for aircraft identification. For obtaining invariant feature space description of an object regardless of its scale change and rotation, Log-polar sampling technique recently developed partly due to its similarity to the human visual system was introduced with Fourier transform post-processing. In addition to the recognition results, image recall was associatively performed and also used for the visualization of the recognition reliability. The multilayer perceptron model was learned by backpropagation algorithm.