• Journal of IKEEE
• /
• v.23 no.1
• /
• pp.120-126
• /
• 2019

Recently, accurate prediction of power consumption based on machine learning techniques in Internet of Energy (IoE) has been actively studied using the large amount of electricity data acquired from advanced metering infrastructure (AMI). In this paper, we propose a deep learning model based on Gated Recurrent Unit (GRU) as an artificial intelligence (AI) network that can effectively perform pattern recognition of time series data such as the power consumption, and analyze performance of the prediction based on real household power usage data. In the performance analysis, performance comparison between the proposed GRU-based learning model and the conventional learning model of Long Short Term Memory (LSTM) is described. In the simulation results, mean squared error (MSE), mean absolute error (MAE), forecast skill score, normalized root mean square error (RMSE), and normalized mean bias error (NMBE) are used as performance evaluation indexes, and we confirm that the performance of the prediction of the proposed GRU-based learning model is greatly improved.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.1
• /
• pp.29-35
• /
• 2019

As the fourth industrial revolution is emerging, many companies are increasingly interested in smart factories and the importance of sensors is being emphasized. In the case that sensors for collecting sensing data fail, the plant could not be optimized and further it could not be operated properly, which may incur a financial loss. For this purpose, it is necessary to diagnose the status of sensors to prevent sensor' fault. In the paper, we propose a scheme to diagnose digital-sensor' fault by analyzing the rising time and falling time of digital sensors through the LSTM(Long Short Term Memory) of Deep Learning RNN algorithm. Experimental results of the proposed scheme are compared with those of rule-based fault diagnosis algorithm in terms of AUC(Area Under the Curve) of accuracy and ROC(Receiver Operating Characteristic) curve. Experimental results show that the proposed system has better and more stable performance than the rule-based fault diagnosis algorithm.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.39 no.1
• /
• pp.23-28
• /
• 2021

Data analysis research using deep learning has recently been studied in various field. In this paper, we conduct a GNSS (Global Navigation Satellite System)-based meteorological study applying deep learning by estimating the ZWD (Zenith tropospheric Wet Delay) through MLP (Multi-Layer Perceptron) and LSTM (Long Short-Term Memory) models. Deep learning models were trained with meteorological data and ZWD which is estimated using zenith tropospheric total delay and dry delay. We apply meteorological data not used for learning to the learned model to estimate ZWD with centimeter-level RMSE (Root Mean Square Error) in both models. It is necessary to analyze the GNSS data from coastal areas together and increase time resolution in order to estimate ZWD in various situations.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.42 no.2
• /
• pp.263-272
• /
• 2022

As a result of climate change, the heatwave and urban heat island phenomena have become more common, and the frequency of heatwaves is expected to increase by two to six times by the year 2050. In particular, the heat sensation index felt by workers at construction sites during a heatwave is very high, and the sensation index becomes even higher if the urban heat island phenomenon is considered. The construction site environment and the situations of construction workers vulnerable to heat are not improving, and it is now imperative to respond effectively to reduce such damage. In this study, satellite imagery, land surface temperatures (LST), and long short-term memory (LSTM) were applied to analyze areas above 33 ℃, with the most vulnerable areas with increased synergistic damage from heat waves and the urban heat island phenomena then predicted. It is expected that the prediction results will ensure the safety of construction workers and will serve as the basis for a construction site early-warning system.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.22 no.6
• /
• pp.165-171
• /
• 2022

Human heart rate can be used to measure exercise intensity as an important indicator. If heart rate can be predicted, exercise can be performed more efficiently by regulating the intensity of exercise in advance. In this paper, a FitRec-based prediction model is proposed for estimating running heart rate for users. Endomondo data is utilized for training the proposed prediction model. The processing algorithms for time-series data, such as LSTM(long short term memory) and GRU(gated recurrent unit), are employed to compare their performance. On the basis of simulation results, it was demonstrated that the proposed model trained with running exercise performed better than the model trained with several cardiac exercises.

• Annual Conference on Human and Language Technology
• /
• 2017.10a
• /
• pp.301-304
• /
• 2017

시간정보추출 연구는 자연어 문장으로부터 대화의 문맥과 상황을 파악하고 사용자의 의도에 적합한 서비스를 제공하는데 중요한 역할을 하지만, 한국어의 고유한 언어적 특성으로 인해 한국어 텍스트에서는 개체간의 시간관계를 정확하게 인식하기 어려운 경향이 있다. 특히, 시간표현이나 사건에 대한 상대적인 시간관계는 시간 문맥을 체계적으로 파악하기 위해 중요한 개념이다. 본 논문에서는 한국어 자연어 문장에서 상대적인 시간표현과 사건 간의 관계를 추출하기 위한 LSTM(long short-term memory) 기반의 상대시간관계 추출 모델을 제안한다. 시간정보추출 연구에는 TIMEX3, EVENT, TLINK 추출의 세 가지 과정이 포함되지만, 본 논문에서는 특정 문장에 대해서 이미 추출된 TIMEX3 및 EVENT 개체를 제공하고 상대시간관계 TLINK를 추출하는 것만을 목표로 한다. 또한, 사람이 직접 태깅한 한국어 시간정보 주석 말뭉치를 대상으로 LSTM 기반 제안모델들의 상대적 시간관계 추출 성능을 비교한다.

• 한국어정보학회:학술대회논문집
• /
• 2017.10a
• /
• pp.301-304
• /
• 2017

시간정보추출 연구는 자연어 문장으로부터 대화의 문맥과 상황을 파악하고 사용자의 의도에 적합한 서비스를 제공하는데 중요한 역할을 하지만, 한국어의 고유한 언어적 특성으로 인해 한국어 텍스트에서는 개체간의 시간관계를 정확하게 인식하기 어려운 경향이 있다. 특히, 시간표현이나 사건에 대한 상대적인 시간관계는 시간 문맥을 체계적으로 파악하기 위해 중요한 개념이다. 본 논문에서는 한국어 자연어 문장에서 상대적인 시간표현과 사건 간의 관계를 추출하기 위한 LSTM(long short-term memory) 기반의 상대시간관계 추출 모델을 제안한다. 시간정보추출 연구에는 TIMEX3, EVENT, TLINK 추출의 세 가지 과정이 포함되지만, 본 논문에서는 특정 문장에 대해서 이미 추출된 TIMEX3 및 EVENT 개체를 제공하고 상대시간관계 TLINK를 추출하는 것만을 목표로 한다. 또한, 사람이 직접 태깅한 한국어 시간정보 주석 말뭉치를 대상으로 LSTM 기반 제안모델들의 상대적 시간관계 추출 성능을 비교한다.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2019.05a
• /
• pp.319-319
• /
• 2019

기후변화로 인한 극한 기후 상황의 증가로 홍수기 홍수피해와 갈수기 가뭄피해가 심화되고 있으며, 수자원 관리에 대한 어려움이 발생하고 있다. 효율적인 수자원 관리를 위해 국내에는 약 1,8000여개의 댐을 운영하고 있으며, 댐의 유입량과 저수량을 감안하여 물을 적절하게 방류하는 것을 목적으로 한다. 그러기 위해서는 유입량이 우선적으로 확보되어야 하며, 더 나아가 유입량을 미리 예측할 수 있다면 더욱 효율적인 댐 운영이 가능할 것이다. 기존에는 수위나 유량을 예측하기 위해서는 주로 물리적 모형이 사용되어 왔으며, 물리적 모형은 매개변수 결정을 위한 많은 자료를 필요로 하고 그 과정에서 많은 불확실성을 포함하고 있기 때문에 계산 과정을 거치는 동안 다양한 오차가 반복 누적되는 단점이 있다. 반면에 시계열 데이터 예측을 위한 알고리즘 LSTM(Long Short-Term Memory)은 입력된 데이터와 출력된 데이터를 동시에 이용하여 보다 정확한 예측 값을 얻을 수 있다. 따라서 본 연구는 다목적댐의 유입유량 예측을 위해 구글에서 제공하는 딥러닝 오픈소스 라이브러리를 활용하여 LSTM모형을 구축하고 댐 유입유량을 예측하였다. 분석 자료로는 wamis에서 제공하는 용담댐의 2006년부터 2018년까지의 시간당 유입량 자료를 사용하였으며, 입력 데이터로 모형을 학습한 후 2018년의 유입량을 예측하였다. 예측 값의 정확도를 판단하기 위해 2018년의 실제 유입량 자료와 비교하였다.

• Journal of Information Processing Systems
• /
• v.16 no.6
• /
• pp.1407-1423
• /
• 2020

A graph is a data structure consisting of nodes and edges between these nodes. Graph embedding is to generate a low dimensional vector for a given graph that best represents the characteristics of the graph. Recently, there have been studies on graph embedding, especially using deep learning techniques. However, until now, most deep learning-based graph embedding techniques have focused on unweighted graphs. Therefore, in this paper, we propose a graph embedding technique for weighted graphs based on long short-term memory (LSTM) autoencoders. Given weighted graphs, we traverse each graph to extract node-weight sequences from the graph. Each node-weight sequence represents a path in the graph consisting of nodes and the weights between these nodes. We then train an LSTM autoencoder on the extracted node-weight sequences and encode each nodeweight sequence into a fixed-length vector using the trained LSTM autoencoder. Finally, for each graph, we collect the encoding vectors obtained from the graph and combine them to generate the final embedding vector for the graph. These embedding vectors can be used to classify weighted graphs or to search for similar weighted graphs. The experiments on synthetic and real datasets show that the proposed method is effective in measuring the similarity between weighted graphs.

• International Journal of Contents
• /
• v.17 no.4
• /
• pp.1-15
• /
• 2021

Named entity recognition (NER) is a crucial task for NLP, which aims to extract information from texts. To build NER systems, deep learning (DL) models are learned with dictionary features by mapping each word in the dataset to dictionary features and generating a unique index. However, this technique might generate noisy labels, which pose significant challenges for the NER task. In this paper, we proposed DL-dictionary features, and evaluated them on two datasets, including the OntoNotes 5.0 dataset and our new infectious disease outbreak dataset named GFID. We used (1) a Bidirectional Long Short-Term Memory (BiLSTM) character and (2) pre-trained embedding to concatenate with (3) our proposed features, named the Convolutional Neural Network (CNN), BiLSTM, and self-attention dictionaries, respectively. The combined features (1-3) were fed through BiLSTM - Conditional Random Field (CRF) to predict named entity classes as outputs. We compared these outputs with other predictions of the BiLSTM character, pre-trained embedding, and dictionary features from previous research, which used the exact matching and partial matching dictionary technique. The findings showed that the model employing our dictionary features outperformed other models that used existing dictionary features. We also computed the F1 score with the GFID dataset to apply this technique to extract medical or healthcare information.