• Title/Summary/Keyword: 신경망 모델선정

Search Result 130, Processing Time 0.029 seconds

Cyber Threats Prediction model based on Artificial Neural Networks using Quantification of Open Source Intelligence (OSINT) (공개출처정보의 정량화를 이용한 인공신경망 기반 사이버위협 예측 모델)

  • Lee, Jongkwan;Moon, Minam;Shin, Kyuyong;Kang, Sungrok
    • Convergence Security Journal
    • /
    • v.20 no.3
    • /
    • pp.115-123
    • /
    • 2020
  • Cyber Attack have evolved more and more in recent years. One of the best countermeasure to counter this advanced and sophisticated cyber threat is to predict cyber attacks in advance. It requires a lot of information and effort to predict cyber threats. If we use Open Source Intelligence(OSINT), the core of recent information acquisition, we can predict cyber threats more accurately. In order to predict cyber threats using OSINT, it is necessary to establish a Database(DB) for cyber attacks from OSINT and to select factors that can evaluate cyber threats from the established DB. We are based on previous researches that built a cyber attack DB using data mining and analyzed the importance of core factors among accumulated DG factors by AHP technique. In this research, we present a method for quantifying cyber threats and propose a cyber threats prediction model based on artificial neural networks.

Performance improvement of artificial neural network based water quality prediction model using explainable artificial intelligence technology (설명가능한 인공지능 기술을 이용한 인공신경망 기반 수질예측 모델의 성능향상)

  • Lee, Won Jin;Lee, Eui Hoon
    • Journal of Korea Water Resources Association
    • /
    • v.56 no.11
    • /
    • pp.801-813
    • /
    • 2023
  • Recently, as studies about Artificial Neural Network (ANN) are actively progressing, studies for predicting water quality of rivers using ANN are being conducted. However, it is difficult to analyze the operation process inside ANN, because ANN is form of Black-box. Although eXplainable Artificial Intelligence (XAI) is used to analyze the computational process of ANN, research using XAI technology in the field of water resources is insufficient. This study analyzed Multi Layer Perceptron (MLP) to predict Water Temperature (WT), Dissolved Oxygen (DO), hydrogen ion concentration (pH) and Chlorophyll-a (Chl-a) at the Dasan water quality observatory in the Nakdong river using Layer-wise Relevance Propagation (LRP) among XAI technologies. The MLP that learned water quality was analyzed using LRP to select the optimal input data to predict water quality, and the prediction results of the MLP learned using the optimal input data were analyzed. As a result of selecting the optimal input data using LRP, the prediction accuracy of MLP, which learned the input data except daily precipitation in the surrounding area, was the highest. Looking at the analysis of MLP's DO prediction results, it was analyzed that the pH and DO a had large influence at the highest point, and the effect of WT was large at the lowest point.

Forecasting the Precipitation of the Next Day Using Deep Learning (딥러닝 기법을 이용한 내일강수 예측)

  • Ha, Ji-Hun;Lee, Yong Hee;Kim, Yong-Hyuk
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.26 no.2
    • /
    • pp.93-98
    • /
    • 2016
  • For accurate precipitation forecasts the choice of weather factors and prediction method is very important. Recently, machine learning has been widely used for forecasting precipitation, and artificial neural network, one of machine learning techniques, showed good performance. In this paper, we suggest a new method for forecasting precipitation using DBN, one of deep learning techniques. DBN has an advantage that initial weights are set by unsupervised learning, so this compensates for the defects of artificial neural networks. We used past precipitation, temperature, and the parameters of the sun and moon's motion as features for forecasting precipitation. The dataset consists of observation data which had been measured for 40 years from AWS in Seoul. Experiments were based on 8-fold cross validation. As a result of estimation, we got probabilities of test dataset, so threshold was used for the decision of precipitation. CSI and Bias were used for indicating the precision of precipitation. Our experimental results showed that DBN performed better than MLP.

Development of a Network Expert System for Safety Analysis of Structures Adjacent to Tunnel Excavation Sites (터널굴착 현장에 인접한 지상구조물의 안전성 평가용 전문가 시스템의 개발)

  • 배규진;김창용;신휴성;홍성환
    • Explosives and Blasting
    • /
    • v.17 no.4
    • /
    • pp.67-88
    • /
    • 1999
  • Ground settlements induced by tunnel excavation cause the foundations of the neighboring superstructures to deform. An expert system called NESASS was developed to analyze the structural safety of such superstructures. NESASS predicts the trend of ground settlements to be resulted from tunnel excavation and carries out a safety analysis for superstructures on the basis of the predicted ground settlements. Using neural network techniques, NESASS learns a data base consisting of the measured ground settlements collected from numerous actual fields and infers a settlement trend at the field of interest. NESASS calculates the magnitudes of angular distortion, deflection ratio, and differential settlement of the structure and, in turn, determines the safety of the structure. In addition, NESASS predicts the patterns of cracks to be formed on the structure using Dulacskas model for crack evaluation. In this study, the ground settlements measured from the Seoul subway construction sites were collected and sorted with respect to the major factors influencing ground settlement. Subsequently, a database of ground settlement due to tunnel excavation was built. A parametric study was performed to verify the reliability of the proposed neural network structure. A comparison of the ground settlement trends predicted by NESASS with the measured ones indicates that NESASS leads to reasonable predictions. An examples is presented in this paper where NESASS is used to evaluate the safety of a structure subject to deformation due to tunnel excavation near to the structure.

  • PDF

Flood Estimation Using MAPLE Forecasted Precipitation Data (MAPLE 강우예보자료를 활용한 유출량 예측)

  • Choi, Chang-Won;Yi, Jae-Eung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2012.05a
    • /
    • pp.984-984
    • /
    • 2012
  • 지구온난화와 기후변화의 영향으로 전 지구적으로 이상홍수, 이상가뭄, 한파와 같은 이상기상 현상이 빈번하게 발생하고 있다. 국내에서는 2010년 추석 광화문 침수사태와 2011년 우면산 산사태와 같은 국지성 집중호우로 인한 인적 물적 피해가 속출하고 있다. 전통적으로 시기나 양적인 측면에서 대부분 장마기간에 국한되었던 강우집중현상이 과거와 달리 특정기간에 상관없이 발생하고 단기성, 국지성을 지닌 호우의 발생빈도가 높아지는 등 국내 강우의 특성이 변하고 있다. 이러한 변화에 대응하기 위해서 강우예측과 유출량예측의 정확도를 높이기 위한 시도가 다양하게 이루어지고 있다. 강우예측의 정확성을 높이기 위해 기상청에서는 단기예보를 목적으로 전지구 통합모델과 지역 통합모델을 연계한 동네예보를 수행하고 있으며, 초단기 예보를 위한 목적으로 VSRF, SCAN, VDRAS, MAPLE 등의 예보를 수행하고 있다. 홍수량 예측에서는 일반적으로 사용하고 있는 물리적 기반의 모형에 레이더강우와 같은 격자형 강우자료를 사용하여 정확성을 높이거나, 기존의 집중형 모형을 분포형 모형으로 대체하기 위한 연구 등이 이루어지고 있으며, 모형 구축이 간편하고 예측 정확도가 우수하다는 장점으로 인해 신경회로망이나 퍼지추론기법 등을 사용한 연구도 지속적으로 이루어지고 있다. 본 연구에서는 수자원분야에 산재한 불확실성을 적극적으로 인정하고 수학적으로 해석하기 위한 이론인 퍼지이론에 신경망 이론을 도입한 neuro-fuzzy 기법을 사용하여 홍수량을 예측하였다. 모형의 입력자료로는 관측된 강우자료와 유출량자료 및 기상청에서 제공하는 MAPLE(McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation) 강우예측자료를 사용하여 적용성을 평가해보았다. 모형의 적용성을 평가하기 위해 시험유역을 충주댐 상류 유역으로 선정하였으며, 2010년 2011년 홍수기의 충주댐 유입량을 예측하였다. 모형의 입력자료를 변경하여 입력자료의 변화에 따른 결과를 비교하였고, clustering 반경의 변화에 따른 정확도를 비교하였다. 모형의 정확도는 평균제곱근오차와 첨두수위오차를 통해 비교하였으며, 비교결과 전반적으로 lead time이 길어질수록 MAPLE 사용 시 예측 정확도가 우수하였고, clustering 반경은 0.5일 때 가장 우수한 결과를 보였다.

  • PDF

Context Aware Feature Selection Model for Salient Feature Detection from Mobile Video Devices (모바일 비디오기기 위에서의 중요한 객체탐색을 위한 문맥인식 특성벡터 선택 모델)

  • Lee, Jaeho;Shin, Hyunkyung
    • Journal of Internet Computing and Services
    • /
    • v.15 no.6
    • /
    • pp.117-124
    • /
    • 2014
  • Cluttered background is a major obstacle in developing salient object detection and tracking system for mobile device captured natural scene video frames. In this paper we propose a context aware feature vector selection model to provide an efficient noise filtering by machine learning based classifiers. Since the context awareness for feature selection is achieved by searching nearest neighborhoods, known as NP hard problem, we apply a fast approximation method with complexity analysis in details. Separability enhancement in feature vector space by adding the context aware feature subsets is studied rigorously using principal component analysis (PCA). Overall performance enhancement is quantified by the statistical measures in terms of the various machine learning models including MLP, SVM, Naïve Bayesian, CART. Summary of computational costs and performance enhancement is also presented.

Water temperature prediction of Daecheong Reservoir by a process-guided deep learning model (역학적 모델과 딥러닝 모델을 융합한 대청호 수온 예측)

  • Kim, Sung Jin;Park, Hyungseok;Lee, Gun Ho;Chung, Se Woong
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2021.06a
    • /
    • pp.88-88
    • /
    • 2021
  • 최근 수자원과 수질관리 분야에 자료기반 머신러닝 모델과 딥러닝 모델의 활용이 급증하고 있다. 그러나 딥러닝 모델은 Blackbox 모델의 특성상 고전적인 질량, 운동량, 에너지 보존법칙을 고려하지 않고, 데이터에 내재된 패턴과 관계를 해석하기 때문에 물리적 법칙을 만족하지 않는 예측결과를 가져올 수 있다. 또한, 딥러닝 모델의 예측 성능은 학습데이터의 양과 변수 선정에 크게 영향을 받는 모델이기 때문에 양질의 데이터가 제공되지 않으면 모델의 bias와 variation이 클 수 있으며 정확도 높은 예측이 어렵다. 최근 이러한 자료기반 모델링 방법의 단점을 보완하기 위해 프로세스 기반 수치모델과 딥러닝 모델을 결합하여 두 모델링 방법의 장점을 활용하는 연구가 활발히 진행되고 있다(Read et al., 2019). Process-Guided Deep Learning (PGDL) 방법은 물리적 법칙을 반영하여 딥러닝 모델을 훈련시킴으로써 순수한 딥러닝 모델의 물리적 법칙 결여성 문제를 해결할 수 있는 대안으로 활용되고 있다. PGDL 모델은 딥러닝 모델에 물리적인 법칙을 해석할 수 있는 추가변수를 도입하며, 딥러닝 모델의 매개변수 최적화 과정에서 Cost 함수에 물리적 법칙을 위반하는 경우 Penalty를 추가하는 알고리즘을 도입하여 물리적 보존법칙을 만족하도록 모델을 훈련시킨다. 본 연구의 목적은 대청호의 수심별 수온을 예측하기 위해 역학적 모델과 딥러닝 모델을 융합한 PGDL 모델을 개발하고 적용성을 평가하는데 있다. 역학적 모델은 2차원 횡방향 평균 수리·수질 모델인 CE-QUAL-W2을 사용하였으며, 대청호를 대상으로 2017년부터 2018년까지 총 2년간 수온과 에너지 수지를 모의하였다. 기상(기온, 이슬점온도, 풍향, 풍속, 운량), 수문(저수위, 유입·유출 유량), 수온자료를 수집하여 CE-QUAL-W2 모델을 구축하고 보정하였으며, 모델은 저수위 변화, 수온의 수심별 시계열 변동 특성을 적절하게 재현하였다. 또한, 동일기간 대청호 수심별 수온 예측을 위한 순환 신경망 모델인 LSTM(Long Short-Term Memory)을 개발하였으며, 종속변수는 수온계 체인을 통해 수집한 수심별 고빈도 수온 자료를 사용하고 독립 변수는 기온, 풍속, 상대습도, 강수량, 단파복사에너지, 장파복사에너지를 사용하였다. LSTM 모델의 매개변수 최적화는 지도학습을 통해 예측값과 실측값의 RMSE가 최소화 되로록 훈련하였다. PGDL 모델은 동일 기간 LSTM 모델과 동일 입력 자료를 사용하여 구축하였으며, 역학적 모델에서 얻은 에너지 수지를 만족하지 않는 경우 Cost Function에 Penalty를 추가하여 물리적 보존법칙을 만족하도록 훈련하고 수심별 수온 예측결과를 비교·분석하였다.

  • PDF

A study on the standardization strategy for building of learning data set for machine learning applications (기계학습 활용을 위한 학습 데이터세트 구축 표준화 방안에 관한 연구)

  • Choi, JungYul
    • Journal of Digital Convergence
    • /
    • v.16 no.10
    • /
    • pp.205-212
    • /
    • 2018
  • With the development of high performance CPU / GPU, artificial intelligence algorithms such as deep neural networks, and a large amount of data, machine learning has been extended to various applications. In particular, a large amount of data collected from the Internet of Things, social network services, web pages, and public data is accelerating the use of machine learning. Learning data sets for machine learning exist in various formats according to application fields and data types, and thus it is difficult to effectively process data and apply them to machine learning. Therefore, this paper studied a method for building a learning data set for machine learning in accordance with standardized procedures. This paper first analyzes the requirement of learning data set according to problem types and data types. Based on the analysis, this paper presents the reference model to build learning data set for machine learning applications. This paper presents the target standardization organization and a standard development strategy for building learning data set.

Customer Churn Prediction of Automobile Insurance by Multiple Models (다중모델을 이용한 자동차 보험 고객의 이탈예측)

  • LeeS Jae-Sik;Lee Jin-Chun
    • Journal of Intelligence and Information Systems
    • /
    • v.12 no.2
    • /
    • pp.167-183
    • /
    • 2006
  • Since data mining attempts to find unknown facts or rules by dealing with also vaguely-known data sets, it always suffers from high error rate. In order to reduce the error rate, many researchers have employed multiple models in solving a problem. In this research, we present a new type of multiple models, called DyMoS, whose unique feature is that it classifies the input data and applies the different model developed appropriately for each class of data. In order to evaluate the performance of DyMoS, we applied it to a real customer churn problem of an automobile insurance company, The result shows that the DyMoS outperformed any model which employed only one data mining technique such as artificial neural network, decision tree and case-based reasoning.

  • PDF

A Study of Prediction of Daily Water Supply Usion ANFIS (ANFIS를 이용한 상수도 1일 급수량 예측에 관한 연구)

  • Rhee, Kyoung-Hoon;Moon, Byoung-Seok;Kang, Il-Hwan
    • Journal of Korea Water Resources Association
    • /
    • v.31 no.6
    • /
    • pp.821-832
    • /
    • 1998
  • This study investigates the prediction of daily water supply, which is a necessary for the efficient management of water distribution system. Fuzzy neuron, namely artificial intelligence, is a neural network into which fuzzy information is inputted and then processed. In this study, daily water supply was predicted through an adaptive learning method by which a membership function and fuzzy rules were adapted for daily water supply prediction. This study was investigated methods for predicting water supply based on data about the amount of water supplied to the city of Kwangju. For variables choice, four analyses of input data were conducted: correlation analysis, autocorrelation analysis, partial autocorrelation analysis, and cross-correlation analysis. Input variables were (a) the amount of water supplied (b) the mean temperature, and (c)the population of the area supplied with water. Variables were combined in an integrated model. Data of the amount of daily water supply only was modelled and its validity was verified in the case that the meteorological office of weather forecast is not always reliable. Proposed models include accidental cases such as a suspension of water supply. The maximum error rate between the estimation of the model and the actual measurement was 18.35% and the average error was lower than 2.36%. The model is expected to be a real-time estimation of the operational control of water works and water/drain pipes.

  • PDF