• Title/Summary/Keyword: Term network

Search Result 1,559, Processing Time 0.026 seconds

Cross-Domain Text Sentiment Classification Method Based on the CNN-BiLSTM-TE Model

  • Zeng, Yuyang;Zhang, Ruirui;Yang, Liang;Song, Sujuan
    • Journal of Information Processing Systems
    • /
    • v.17 no.4
    • /
    • pp.818-833
    • /
    • 2021
  • To address the problems of low precision rate, insufficient feature extraction, and poor contextual ability in existing text sentiment analysis methods, a mixed model account of a CNN-BiLSTM-TE (convolutional neural network, bidirectional long short-term memory, and topic extraction) model was proposed. First, Chinese text data was converted into vectors through the method of transfer learning by Word2Vec. Second, local features were extracted by the CNN model. Then, contextual information was extracted by the BiLSTM neural network and the emotional tendency was obtained using softmax. Finally, topics were extracted by the term frequency-inverse document frequency and K-means. Compared with the CNN, BiLSTM, and gate recurrent unit (GRU) models, the CNN-BiLSTM-TE model's F1-score was higher than other models by 0.0147, 0.006, and 0.0052, respectively. Then compared with CNN-LSTM, LSTM-CNN, and BiLSTM-CNN models, the F1-score was higher by 0.0071, 0.0038, and 0.0049, respectively. Experimental results showed that the CNN-BiLSTM-TE model can effectively improve various indicators in application. Lastly, performed scalability verification through a takeaway dataset, which has great value in practical applications.

Prediction of Wind Power Generation using Deep Learnning (딥러닝을 이용한 풍력 발전량 예측)

  • Choi, Jeong-Gon;Choi, Hyo-Sang
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.16 no.2
    • /
    • pp.329-338
    • /
    • 2021
  • This study predicts the amount of wind power generation for rational operation plan of wind power generation and capacity calculation of ESS. For forecasting, we present a method of predicting wind power generation by combining a physical approach and a statistical approach. The factors of wind power generation are analyzed and variables are selected. By collecting historical data of the selected variables, the amount of wind power generation is predicted using deep learning. The model used is a hybrid model that combines a bidirectional long short term memory (LSTM) and a convolution neural network (CNN) algorithm. To compare the prediction performance, this model is compared with the model and the error which consist of the MLP(:Multi Layer Perceptron) algorithm, The results is presented to evaluate the prediction performance.

A SE Approach for Machine Learning Prediction of the Response of an NPP Undergoing CEA Ejection Accident

  • Ditsietsi Malale;Aya Diab
    • Journal of the Korean Society of Systems Engineering
    • /
    • v.19 no.2
    • /
    • pp.18-31
    • /
    • 2023
  • Exploring artificial intelligence and machine learning for nuclear safety has witnessed increased interest in recent years. To contribute to this area of research, a machine learning model capable of accurately predicting nuclear power plant response with minimal computational cost is proposed. To develop a robust machine learning model, the Best Estimate Plus Uncertainty (BEPU) approach was used to generate a database to train three models and select the best of the three. The BEPU analysis was performed by coupling Dakota platform with the best estimate thermal hydraulics code RELAP/SCDAPSIM/MOD 3.4. The Code Scaling Applicability and Uncertainty approach was adopted, along with Wilks' theorem to obtain a statistically representative sample that satisfies the USNRC 95/95 rule with 95% probability and 95% confidence level. The generated database was used to train three models based on Recurrent Neural Networks; specifically, Long Short-Term Memory, Gated Recurrent Unit, and a hybrid model with Long Short-Term Memory coupled to Convolutional Neural Network. In this paper, the System Engineering approach was utilized to identify requirements, stakeholders, and functional and physical architecture to develop this project and ensure success in verification and validation activities necessary to ensure the efficient development of ML meta-models capable of predicting of the nuclear power plant response.

A Study on the Forecasting of Bunker Price Using Recurrent Neural Network

  • Kim, Kyung-Hwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.10
    • /
    • pp.179-184
    • /
    • 2021
  • In this paper, we propose the deep learning-based neural network model to predict bunker price. In the shipping industry, since fuel oil accounts for the largest portion of ship operation costs and its price is highly volatile, so companies can secure market competitiveness by making fuel oil purchasing decisions based on rational and scientific method. In this paper, short-term predictive analysis of HSFO 380CST in Singapore is conducted by using three recurrent neural network models like RNN, LSTM, and GRU. As a result, first, the forecasting performance of RNN models is better than LSTM and GRUs using long-term memory, and thus the predictive contribution of long-term information is low. Second, since the predictive performance of recurrent neural network models is superior to the previous studies using econometric models, it is confirmed that the recurrent neural network models should consider nonlinear properties of bunker price. The result of this paper will be helpful to improve the decision quality of bunker purchasing.

A NEW APPROACH OF FAULT DETECTION BASED ON WAVEARX NEURAL NETWORK OBSERVER

  • Ma, Liling;Yang, Yinghua;Wang, Fuli
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 2001.10a
    • /
    • pp.116-122
    • /
    • 2001
  • A novel approach based on WaveARX neural network observer is proposed far the fault detect of a class of nonlinear systems which consist of known linear part and unknown nonlinear part. A linear observer is first designed, then a nonlinear compensation term in the nonlinear observer is estimated by using a deconvolution method. The WaveARX network is used to model the obtained compensation term. At last, the residual fur fault detection is generated based on the analysis of the upper bound approximate error. Simulation results have shown the feasibility and effectiveness of the method.

  • PDF

Pattern Recognition of Long-term Ecological Data in Community Changes by Using Artificial Neural Networks: Benthic Macroinvertebrates and Chironomids in a Polluted Stream

  • Chon, Tae-Soo;Kwak, Inn-Sil;Park, Young-Seuk
    • The Korean Journal of Ecology
    • /
    • v.23 no.2
    • /
    • pp.89-100
    • /
    • 2000
  • On community data. sampled in regular intervals on a long-term basis. artificial neural networks were implemented to extract information on characterizing patterns of community changes. The Adaptive Resonance Theory and Kohonen Network were both utilized in learning benthic macroinvertebrate communities in the Soktae Stream of the Suyong River collected monthly for three years. Initially, by regarding each monthly collection as a separate sample unit, communities were grouped into similar patterns after training with the networks. Subsequently, changes in communities in a sequence of samplings (e.g., two-month, four-month, etc.) were given as input to the networks. After training, it was possible to recognize new data set in line with the sampling procedure. Through the comparative study on benthic macroinvertebrates with these learning processes, patterns of community changes in chironomids diverged while those of the total benthic macro-invertebrates tended to be more stable.

  • PDF

Prediction for Rolling Force in Hot-rolling Mill Using On-line learning Neural Network (On-line 학습 신경회로망을 이용한 열간 압연하중 예측)

  • Son Joon-Sik;Lee Duk-Man;Kim Ill-Soo;Choi Seung-Gap
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.14 no.1
    • /
    • pp.52-57
    • /
    • 2005
  • In the foe of global competition, the requirements for the continuously increasing productivity, flexibility and quality(dimensional accuracy, mechanical properties and surface properties) have imposed a mai or change on steel manufacturing industries. Indeed, one of the keys to achieve this goal is the automation of the steel-making process using AI(Artificial Intelligence) techniques. The automation of hot rolling process requires the developments of several mathematical models for simulation and quantitative description of the industrial operations involved. In this paper, an on-line training neural network for both long-term teaming and short-term teaming was developed in order to improve the prediction of rolling force in hot rolling mill. This analysis shows that the predicted rolling force is very closed to the actual rolling force, and the thickness error of the strip is considerably reduced.

Prediction for Rolling Force in Hot-rolling Mill Using On-line loaming Neural Network (On-line 학습 신경회로망을 이용한 열간 압연하중 예측)

  • 손준식;이덕만;김일수;최승갑
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2003.04a
    • /
    • pp.124-129
    • /
    • 2003
  • In the face of global competitor the requirements flor the continuously increasing productivity, flexibility and quality(dimensional accuracy, mechanical properties and surface properties) have imposed a major change on steel manufacturing industries. Indeed, one of the keys to achieve this goal is the automation of the steel-making process using AI(Artificial Intelligence) techniques. The automation of hot rolling process requires the developments of several mathematical models fir simulation and quantitative description of the industrial operations involved. In this paper, a on-line training neural network for both long-term teaming and short-term teaming was developed in order to improve the prediction of rolling force in hot rolling mill. This analysis shows that the predicted rolling force is very closed to the actual rolling force, and the thickness error of the strip is considerably reduced.

  • PDF

Statistical Characteristics of Self-similar Data Traffic (자기유사성을 갖는 데이터 트래픽의 통계적인 특성)

  • Koo Hye-Ryun;Hong Keong-Ho;Lim Seog-Ku
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2005.05a
    • /
    • pp.410-415
    • /
    • 2005
  • Recent measurements of local-area and wide-area traffic have shown that network traffic exhibits at a wide range of scales - Self-similarity. Self-similarity is expressed by long term dependency, this is contradictory concept with Poisson model that have relativity short term dependency. Therefore, first of all for design and dimensioning of next generation communication network, traffic model that are reflected burstness and self-similarity is required. Here self-similarity can be characterized by Hurst parameter. In this paper, when different many data traffic being integrated under various environments is arrived to communication network, Hurst Parameter's change is analyzed and compared with simulation results.

  • PDF

Short-term Load Forecasting Using Artificial Neural Network (인공신경망을 이용한 단기 부하예측모형)

  • Park, Moon-Hee
    • Journal of Energy Engineering
    • /
    • v.6 no.1
    • /
    • pp.68-76
    • /
    • 1997
  • This paper presents a new neural network training algorithm which reduces the required training time considerably and overcomes many of the shortcomings presented by the conventional back-propagation algorithm. The algorithm uses a modified form of the back-propagation algorithm to minimize the mean squared error between the desired and actual outputs with respect to the inputs to the nonlinearities. Artificial Neural Network (ANN) model using the new algorithm is applied to forecast the short-term electric load. Inputs to the ANN are past loads and the output of the ANN is the hourly load forecast for a given day.

  • PDF