• The Journal of the Acoustical Society of Korea
• /
• v.20 no.8
• /
• pp.12-18
• /
• 2001

In this paper, we propose the Recurrent Neural Predictive HMM (RNPHMM). The RNPHMM is the hybrid network of the recurrent neural network and HMM. The predictive recurrent neural network trained to predict the future vector based on several last feature vectors, and defined every state of HMM. This method uses the prediction value from the predictive recurrent neural network, which is dynamically changing due to the effects of the previous feature vectors instead of the stable average vectors. The models of the RNPHMM are Elman network prediction HMM and Jordan network prediction HMM. In the experiment, we compared the recognition abilities of the RNPHMM as we increased the state number, prediction order, and number of hidden nodes for the isolated digits. As a result of the experiments, Elman network prediction HMM and Jordan network prediction HMM have good recognition ability as 98.5% for test data, respectively.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.25 no.3B
• /
• pp.565-569
• /
• 2000

We compose the two-stage recurrent neural network that returns both signals of a hidden and an output layer to the hidden layer. It is tested on the basis of syllables for Korean spoken digit from /gong/to /gu. For these experiments, we adjust the neuron number of the hidden layer, the predictive order of input data and self-recurrent coefficient of the decision state layer. By the experimental results, the recognition rate of this neural network is between 91% and 97.5% in the speaker-dependent case and between 80.75% and 92% in the speaker-independent case. In the speaker-dependent case, this network shows an equivalent recognition performance to Jordan and Elman network but in the speaker-independent case, it does improved performance.

• BMB Reports
• /
• v.43 no.10
• /
• pp.670-676
• /
• 2010

In this paper, a novel approach, ELM-PCA, is introduced for the first time to predict protein subcellular localization. Firstly, Protein Samples are represented by the pseudo amino acid composition (PseAAC). Secondly, the principal component analysis (PCA) is employed to extract essential features. Finally, the Elman Recurrent Neural Network (RNN) is used as a classifier to identify the protein sequences. The results demonstrate that the proposed approach is effective and practical.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.22.3-22
• /
• 2001

An attention task, in which context information should be extracted from the first presented pattern, and the recognition answer of the second presented pattern should be generated using the context information, is employed in this paper. An Elman-type recurrent neural network is utilized to extract and keep the context information. A reinforcement signal that indicates whether the answer is correct or not, is only a signal that the system can obtain for the learning. Only by this learning, necessary context information became to be extracted and kept, and the system became to generate the correct answers. Furthermore, the function of an associative memory is observed in the feedback loop in the Elman-type neural network.

• Structural Engineering and Mechanics
• /
• v.16 no.6
• /
• pp.643-654
• /
• 2003

Two real-time modeling prediction (RMP) schemes are presented in this paper for analyzing the behavior of deep excavations during construction. The first RMP scheme is developed from the traditional AR(p) model. The second is based on the simplified Elman-style recurrent neural networks. An on-line learning algorithm is introduced to describe the dynamic behavior of deep excavations. As a case study, in-situ measurements of an excavation were recorded and the measured data were used to verify the reliability of the two schemes. They proved to be both effective and convenient for predicting the behavior of deep excavations during construction. It is shown through the case study that the RMP scheme based on the neural network is more accurate than that based on the traditional AR(p) model.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2000.12a
• /
• pp.201-204
• /
• 2000

This paper describes a study on the time-varying control of parameters in learning of the neural network. Elman recurrent neural network (RNN) is used to implement the control of parameters. The parameters of learning and momentum rates In the error backpropagation algorithm ate updated at every iteration using fuzzy rules based on performance index. In addition, the gain and slope of the neuron's activation function are also considered time-varying parameters. These function parameters are updated using the gradient descent algorithm. Simulation results show that the auto-tuned learning algorithm results in faster convergence and lower system error than regular backpropagation in the system identification.

• Journal of the Korean Geotechnical Society
• /
• v.23 no.7
• /
• pp.17-25
• /
• 2007

Various geotechnical problems due to insufficient bearing capacity or excessive settlement are likely to occur when constructing roads or large complexes on soft ground. Accurate predictions of the magnitude of settlement and the consolidation time provide numerous options of ground improvement methods and, thus, enable to save time and expense of the whole project. Asaoka's method is probably the most frequently used one for settlement prediction and the empirical formulae such as Hyperbolic method and Hoshino's method are also often used. To find an elaborate method of predicting the embankment settlement, two recurrent type neural network models, such as Jordan model and Elman-Jordan model, are adopted. The data sets of settlement measured at several domestic sites are analyzed to obtain the most suitable model structures. It was shown from the comparison between predicted and measured settlements that Jordan model provides better predictions than Elman-Jordan model does and that the predictions using CPT results are more accurate than those using SPT results. It is believed that RNN using cone penetration test results can be a highly efficient tool in predicting settlements if enough field data can be obtained.

• Proceedings of the KIEE Conference
• /
• 2006.10a
• /
• pp.145-146
• /
• 2006

본 논문은 부분방전(PD: Partial Discharge)의 패턴인식 확률 극대화를 목적으로 신경망(NN: Neural Network) 파라미터 중에서 은닉층 뉴런의 수, 모멘텀(momentum)의 Step size와 Decay rate 를 최적화하기 위하여 유전 알고리즘(GA: Genetic Algonthm)을 적응하였다. 실험적 연구의 대상으로서, GIS(Gas Insulated Switchgear)사고의 주요 원인으로 보고되어있는 결함들을 인위적으로 모의한 16개 Test cell을 이용하여 부분방전을 발생시켰다. 부분방전 신호는 본 연구팀이 개발한 센서를 이용하여 검출되어 데이터베이스가 구축되어 그로부터 추출된 학습 데이터들의 학습에 다음과 같은 5가지 신경망 모델이 적응되었다: Multilayer Perception (MLP), Jordan-Elman Network (JEN), Recurrent Network (RN), Self-Organizing Feature Map (SOFM), Time-Lag Recurrent Network (TLRN). 유전 알고리즘 적용 효율성을 분석하기 위하여 동일한 데이터를 이용하여 다음과 같은 두 가지 방법을 적용한 결과를 상호 비교하였다. 우선 상기 선택된 모델만 적용하였고 다근 하나는 상기 모델과 Genetic Algorithm이 동시에 적용되었다. 모든 모델에 대하여 학습오차와 패턴 분류 확률을 비교한 결과, 유전 알고리즘 적응 시 부분방전 패턴인식 확률이 향상되었음이 확인되어 향후 신뢰성 있는 GIS 부분방전 진단기술에 활용될 수 있을 것으로 사료된다.

• JSTS:Journal of Semiconductor Technology and Science
• /
• v.14 no.2
• /
• pp.252-261
• /
• 2014

A Bayesian network (BN) based fault diagnosis framework for semiconductor etching equipment is presented. Suggested framework contains data preprocessing, data synchronization, time series modeling, and BN inference, and the established BNs show the cause and effect relationship in the equipment module level. Statistically significant state variable identification (SVID) data of etch equipment are preselected using principal component analysis (PCA) and derivative dynamic time warping (DDTW) is employed for data synchronization. Elman's recurrent neural networks (ERNNs) for individual SVID parameters are constructed, and the predicted errors of ERNNs are then used for assigning prior conditional probability in BN inference of the fault diagnosis. For the demonstration of the proposed methodology, 300 mm etch equipment model is reconstructed in subsystem levels, and several fault diagnosis scenarios are considered. BNs for the equipment fault diagnosis consists of three layers of nodes, such as root cause (RC), module (M), and data parameter (DP), and the constructed BN illustrates how the observed fault is related with possible root causes. Four out of five different types of fault scenarios are successfully diagnosed with the proposed inference methodology.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.18 no.4
• /
• pp.959-979
• /
• 2024

Rice pest identification is essential in modern agriculture for the health of rice crops. As global rice consumption rises, yields and quality must be maintained. Various methodologies were employed to identify pests, encompassing sensor-based technologies, deep learning, and remote sensing models. Visual inspection by professionals and farmers remains essential, but integrating technology such as satellites, IoT-based sensors, and drones enhances efficiency and accuracy. A computer vision system processes images to detect pests automatically. It gives real-time data for proactive and targeted pest management. With this motive in mind, this research provides a novel farmland fertility algorithm with a deep learning-based automated rice pest detection and classification (FFADL-ARPDC) technique. The FFADL-ARPDC approach classifies rice pests from rice plant images. Before processing, FFADL-ARPDC removes noise and enhances contrast using bilateral filtering (BF). Additionally, rice crop images are processed using the NASNetLarge deep learning architecture to extract image features. The FFA is used for hyperparameter tweaking to optimise the model performance of the NASNetLarge, which aids in enhancing classification performance. Using an Elman recurrent neural network (ERNN), the model accurately categorises 14 types of pests. The FFADL-ARPDC approach is thoroughly evaluated using a benchmark dataset available in the public repository. With an accuracy of 97.58, the FFADL-ARPDC model exceeds existing pest detection methods.