• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제15권3호
• /
• pp.853-873
• /
• 2021

In recent years, deep reinforcement learning (DRL) models are enjoying great interest as their success in a variety of challenging tasks. Deep Q-Network (DQN) is a widely used deep reinforcement learning model, which trains an intelligent agent that executes optimal actions while interacting with an environment. This model is well known for its ability to surpass skilled human players across many Atari 2600 games. Although DQN has achieved excellent performance in practice, there lacks a clear understanding of why the model works. In this paper, we present a visual analytics system for understanding deep Q-network in a non-blind matter. Based on the stored data generated from the training and testing process, four coordinated views are designed to expose the internal execution mechanism of DQN from different perspectives. We report the system performance and demonstrate its effectiveness through two case studies. By using our system, users can learn the relationship between states and Q-values, the function of convolutional layers, the strategies learned by DQN and the rationality of decisions made by the agent.

• ETRI Journal
• /
• 제46권1호
• /
• pp.137-153
• /
• 2024

This study introduces a new approach in Korean morphological analysis combining dictionary-based techniques with Transformer-based deep learning models. The key innovation is the use of a BERT-based reranking system, significantly enhancing the accuracy of traditional morphological analysis. The method generates multiple suboptimal paths, then employs BERT models for reranking, leveraging their advanced language comprehension. Results show remarkable performance improvements, with the first-stage reranking achieving over 20% improvement in error reduction rate compared with existing models. The second stage, using another BERT variant, further increases this improvement to over 30%. This indicates a significant leap in accuracy, validating the effectiveness of merging dictionary-based analysis with contemporary deep learning. The study suggests future exploration in refined integrations of dictionary and deep learning methods as well as using probabilistic models for enhanced morphological analysis. This hybrid approach sets a new benchmark in the field and offers insights for similar challenges in language processing applications.

• International Journal of Internet, Broadcasting and Communication
• /
• 제16권2호
• /
• pp.127-135
• /
• 2024

Recent studies have shown that inverse design using deep learning has the potential to rapidly generate the optimal design that satisfies the target performance without the need for iterative optimization processes. Unlike traditional methods, deep learning allows the network to rapidly generate a large number of solution candidates for the same objective after a single training, and enables the generation of diverse designs tailored to the objectives of inverse design. These inverse design techniques are expected to significantly enhance the efficiency and innovation of design processes in various fields such as aerospace, biology, medical, and engineering. We analyzes inverse design models that are mainly utilized in the nano and chemical fields, and proposes inverse design models based on supervised and unsupervised learning that can be applied to the engineering system. It is expected to present the possibility of effectively applying inverse design methodologies to the design optimization problem in the field of engineering according to each specific objective.

• 한국정보통신학회논문지
• /
• 제25권8호
• /
• pp.1005-1012
• /
• 2021

최근 웹에서 지도(Map)를 이용한 Location based Services 기반의 다양한 위치정보시스템 활용이 점점 확대되고 있으며 에너지 절약을 위한 대안으로 전력 수요 현황을 실시간으로 확인할 수 있는 모니터링 시스템의 필요성이 요구되고 있다. 본 연구에서는 딥러닝과 같은 기계학습을 이용하여 전력 수요 데이터의 특성을 분석하고 예측하는 모듈을 개발하여 지역 단위별 전력 에너지 사용 현황과 예측 추세를 실시간으로 확인할 수 있는 오픈소스 기반 지도 서비스를 이용한 딥러닝 실시간 가상 전력수요예측 웹 시스템을 개발하였다. 특히 제안한 시스템은 LSTM 딥러닝 모델을 이용하여 지역적으로 전력 수요량과 예측 분석이 실시간으로 가능하고 분석된 정보를 가시화하여 제공한다. 향후 제안된 시스템을 통해 지역별 에너지의 수급 및 예측 현황을 확인하고 분석하는데 활용될 수 있을 뿐만 아니라 다른 산업 에너지에도 적용될 수 있을 것이다.

• International Journal of Naval Architecture and Ocean Engineering
• /
• 제12권1호
• /
• pp.768-783
• /
• 2020

Typically, a Dynamic Positioning System (DPS) uses a PID feed-back system, and it often adopts a wind feed-forward system because of its easier implementation than a feed-forward system based on current or wave. But, because a ship's drifting motion is caused by wind, current, and wave drift loads, all three environmental loads should be considered. In this study, a motion predictive control for the PID feedback system of the DPS is proposed, which considers the three environmental loads by utilizing predicted drifted ship positions in the future since it contains information about the three environmental loads from the moment to the future. The prediction accuracy for the future drifted ship position is ensured by adopting deep learning algorithms and a replay buffer. Finally, it is shown that the proposed motion predictive system results in better station-keeping performance than the wind feed-forward system.

• 디지털콘텐츠학회 논문지
• /
• 제19권6호
• /
• pp.1115-1121
• /
• 2018

본 논문에서는 사이버대학교 학습관리시스템에 누적된 데이터를 기반으로 학습 성과를 예측하기 위하여 딥러닝에 기반한 데이터 분석 방법을 연구하였다. 학습자의 학업 성취도를 예측하면, 학습자의 학습을 촉진하여 교육의 질을 높일 수 있는 도구로 활용될 수 있다. 학습 성과의 예측의 정확도를 향상시키기 위하여 오토인코더에 기반하여 한학기 출결 상황을 예측하고, 학기 진행 중인 평가 요소들과 결합하여 딥러닝으로 학습하여 최종 예측의 정확도를 높였다. 제안하는 예측 방법을 검증하기 위하여 학습 진행 과정의 출결데이터의 예측과 평가요소 데이터를 활용하여 최종학습 성취도를 예측하였다. 실험을 통하여 학기 진행중에 학습자의 성취도를 예측할 수 있는 것을 보였다.

• 한국정보전자통신기술학회논문지
• /
• 제11권5호
• /
• pp.521-530
• /
• 2018

본 논문에서 제안하는 "농산물 생산성 향상을 위한 딥러닝 기반 농업 의사결정 시스템"에서는 정밀농업을 지원하는 농장의 위치 정보를 기반으로 기상 정보를 수집하고, 수집한 기상 정보와 농작물의 실시간 데이터를 이용하여, 작물의 현재 상태를 예측하고 그 결과를 농장 관리인에게 알려준다. 제안하는 시스템은 첫째, 정밀농업을 지원하는 농장의 위치 정보를 기반으로 기상 정보를 수집하는 ICM(Information Collection System)을 설계하고, 둘째, 딥러닝 알고리즘을 기반으로 현재 날씨에 따라 농장 토지의 탄소, 수소, 산소, 질소, 수분 함유량이 재배하고 있는 작물에 적합특정 작물을 재배하기 좋은 상태인지 판단하는 DRCM(Deep learning based Risk Calculation Module)을 설계하고, 셋째, DRCM의 결과를 기반으로 사용자에게 작물의 상태를 점검할 것을 알려주는 메시지를 전송하는 RNM(Risk Notification Module)을 설계한다. 제안하는 시스템은 기존의 시스템과 비교하였을 때, 데이터양의 증가로 인해 발생하는 정확도 감소 비율이 낮고, 분석 단계에 비지도학습을 적용하기 때문에 안정성을 향상 시킬 수 있다. 결과적으로 농장 데이터 분석 성공률이 약 5.15%가량 향상되었고, 환경 변화에 따른 작물 성장의 위험한 상태정보 다양하게 적용하였을 때, 위험한 상태정보에 대하여 상세하게 추론할 수 있었다. 이는 다양한 내 외부 환경으로부터 발생할 수 있는 작물의 질병을 미연에 예방할 수 있고, 작물이 성장하는데 최적화된 환경을 제공할 수 있는 효과를 나타낸다.

• 드라이브 ㆍ 컨트롤
• /
• 제18권4호
• /
• pp.9-18
• /
• 2021

This study proposes a method for creating learning datasets to recognize obstacles using deep learning algorithms in automated construction machinery or an autonomous vehicle. Recently, many researchers and engineers have developed various recognition algorithms based on deep learning following an increase in computing power. In particular, the image classification technology and image segmentation technology represent deep learning recognition algorithms. They are used to identify obstacles that interfere with the driving situation of an autonomous vehicle. Therefore, various organizations and companies have started distributing open datasets, but there is a remote possibility that they will perfectly match the user's desired environment. In this study, we created an interface of the virtual simulator such that users can easily create their desired training dataset. In addition, the customized dataset was further advanced by using the RDBMS system, and the recognition rate was improved.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제12권10호
• /
• pp.5159-5178
• /
• 2018

Network Intrusion detection is a rapidly growing field of information security due to its importance for modern IT infrastructure. Many supervised and unsupervised learning techniques have been devised by researchers from discipline of machine learning and data mining to achieve reliable detection of anomalies. In this paper, a deep convolutional neural network (DCNN) based intrusion detection system (IDS) is proposed, implemented and analyzed. Deep CNN core of proposed IDS is fine-tuned using Randomized search over configuration space. Proposed system is trained and tested on NSLKDD training and testing datasets using GPU. Performance comparisons of proposed DCNN model are provided with other classifiers using well-known metrics including Receiver operating characteristics (RoC) curve, Area under RoC curve (AuC), accuracy, precision-recall curve and mean average precision (mAP). The experimental results of proposed DCNN based IDS shows promising results for real world application in anomaly detection systems.

• 한국컴퓨터정보학회논문지
• /
• 제24권3호
• /
• pp.87-93
• /
• 2019

In this paper, we propose a real-time drone-based violent protest detection system. Our proposed system uses drones to detect scenes of violent protest in real-time. The important problem is that the victims and violent actions have to be manually searched in videos when the evidence has been collected. Firstly, we focused to solve the limitations of existing collecting evidence devices by using drone to collect evidence live and upload in AWS(Amazon Web Service)[1]. Secondly, we built a Deep Learning based violence detection model from the videos using Yolov3 Feature Pyramid Network for human activity recognition, in order to detect three types of violent action. The built model classifies people with possession of gun, swinging pipe, and violent activity with the accuracy of 92, 91 and 80.5% respectively. This system is expected to significantly save time and human resource of the existing collecting evidence.