• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.420-420
• /
• 2023

하천의 유량 자료는 하천 관리에 필수적인 요소로, 지속적인 유량측정을 위해 국가 유량 측정망을 구성하여 주요 지점을 대상으로 유량 측정을 수행하고 있다. 측정된 유량자료는 일반적으로 수위-유량 관계곡선식을 개발하여 제공되고 있으며, 홍수파와 배수 영향 등으로 인해 수위-유량 관계곡선식에서 발생하는 산포로 인한 신뢰도에 문제가 우려되는 경우에는 실시간의 정확한 유량자료를 제공하기 위해 H-ADCP를 설치하여 지표유속법 기반의 실시간 유량 자료 생산하여 제공하고 있다. 그러나 H-ADCP를 이용한 유량 측정 방법은 장비의 한계로 인해 상대적으로 규모가 작고 수심이 얕은 하천에 적용하기 어려운 문제가 있다. 따라서, 최근에는 자동유량관측소 지점 확대를 위해 비접촉식 유속계를 활용한 자동유량관측소 운영이 점차 고려되고 있다. 이에 따라 비접촉식유속계를 이용한 유량 측정 결과의 검증 및 유지 관리를 위한 소프트웨어가 필요하다. 이에 본 연구에서는 비접촉식유속계 중 전자파를 이용하여 수표면의 표면유속을 측정할 수 있는 장비인 RQ-30의 측정결과를 분석하기 위해 Microsoft Visual Studio(C#) 사용하여 측정결과의 검토 및 자료 관리를 위한 후처리 소프트웨어를 개발하였다. 개발한 소프트웨어는 측정 원시자료를 읽고, 도시하여 측정 결과를 확인할 수 있으며, 머신러닝 기반의 알고리즘을 적용하여 수위 및 유속 시계열 자료에서 발생하는 이상치를 탐색할 수 있도록 개발하였다. 그리고 탐지된 이상치에 대한 보정을 위해 선형보간, LOESS, SuperSmoother를 사용하여 이상치를 보정하여 결과를 도출할 수 있도록 개발하였다. 추후 본 연구를 통해 개발된 프로그램을 활용하여 측정 자료의 유지 관리 효율성을 증대시킬 수 있을 것으로 기대되며, 지속적인 프로그램의 개선을 통해서 실무적으로 활용이 가능할 것으로 판단된다.

• Journal of Korea Water Resources Association
• /
• v.51 no.8
• /
• pp.703-711
• /
• 2018

Water distribution system (WDS) pipe bursts are caused from excessive pressure, pipe aging, and ground shift from temperature change and earthquake. Prompt detection of and response to the failure event help prevent large-scale service interruption and catastrophic sinkhole generation. To that end, this study proposes a improved Western Electric Company (WECO) method to improve the detection effectiveness and efficiency of the original WECO method. The original WECO method is an univariate Statistical Process Control (SPC) technique used for identifying any non-random patterns in system output data. The improved WECO method multiples a threshold modifier (w) to each threshold of WECO sub-rules in order to control the sensitivity of anomaly detection in a water distribution network of interest. The Austin network was used to demonstrated the proposed method in which normal random and abnormal pipe flow data were generated. The best w value was identified from a sensitivity analysis, and the impact of measurement frequency (dt = 5, 10, 15 min etc.) was also investigated. The proposed method was compared to the original WECO method with respect to detection probability, false alarm rate, and averaged detection time. Finally, this study provides a set of guidelines on the use of the WECO method for real-life WDS pipe burst detection.

• Proceedings of the KAIS Fall Conference
• /
• 2011.05a
• /
• pp.53-56
• /
• 2011

지난 7.7 DDoS(Distributed Denial of Service), 3.3 DDoS 대란을 통해서 보여주듯 DDoS 공격이 네트워크 주요 위협요소로 매우 부각되고 있으나, 공격에 대해서 실시간으로 감지하고 대응하기에 어렵다. 그리고 현재 여러 분야에서 매우 많은 용도로 사용되는 SMS(Short Message Service)도 DDoS 공격 수단으로 사용되어 이동전화 시스템에 큰 혼란을 야기할 수 있다. 기존의 Bloom Filter 탐지 기법은 구조가 간단하고 실시간 탐지가 가능한 장점을 갖지만 오탐지율에 대한 문제점을 가진다. 본 논문에서는 목적지 기반의 다중의 해시함수를 사용한 Counting Bloom Filter 기법을 이용하여 임계치 이상 카운트된 동일한 목적지로 발송되는 SMS에 대하여 공격으로 탐지하고 SMSC에 통보하여 차단시키는 시스템을 제안한다.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.21 no.4
• /
• pp.125-144
• /
• 2022

When a variable message signs (VMS) system displays false information related to traffic safety caused by malicious attacks, it could pose a serious risk to drivers. If the normal message patterns displayed on the VMS system are learned, it would be possible to detect and respond to the anomalous messages quickly. This paper proposes a method for detecting anomalous messages by learning the normal patterns of messages using a bi-directional generative pre-trained transformer (GPT) network. In particular, the proposed method was trained using the normal messages and their system parameters to minimize the corresponding negative log-likelihood (NLL) values. After adequate training, the proposed method could detect an anomalous message when its NLL value was larger than a pre-specified threshold value. The experiment results showed that the proposed method could detect malicious messages and cases when the system error occurs.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.24 no.1
• /
• pp.55-58
• /
• 2024

In this paper, we propose a design and implementation of big data-based fine dust anomaly detection machine learning system. The proposed is system that classifies the fine dust air quality index through meteorological information composed of fine dust and big data. This system classifies fine dust through the design of an anomaly detection algorithm according to the outliers for each air quality index classification categories based on machine learning. Depth data of the image collected from the camera collects images according to the level of fine dust, and then creates a fine dust visibility mask. And, with a learning-based fingerprinting technique through a mono depth estimation algorithm, the fine dust level is derived by inferring the visibility distance of fine dust collected from the monoscope camera. For experimentation and analysis of this method, after creating learning data by matching the fine dust level data and CCTV image data by region and time, a model is created and tested in a real environment.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.14 no.1
• /
• pp.22-28
• /
• 2021

Multivariate processes, such as chemical and mechanical process, power plants are operated in a state where several facilities are complexly connected, the fault of a particular system can also have fatal consequences for the entire process. In addition, since process data is measured in an unstable environment, outlier is likely to be include in the data. Therefore, monitoring technology is essential, which can remove outlier from measured data and detect failures in advance. In this paper, data obtained from dynamic and multivariate process models was used to detect fault in various type of processes. The dynamic process is a simulation of a process with autoregressive property, and the multivariate process is a model that describes a situation when a specific sensor fault. Mahalanobis distance was used to remove outlier contained in the data generated by dynamic process model and multivariate process model, and fault detection was performed using ICA. For comparison, we compared performance with and a conventional single ICA method. The proposed fault detection method improves performance by 0.84%p for bias data and 6.82%p for drift data in the dynamic process. In the case of the multivariate process, the performance was improves by 3.78%p, therefore, the proposed method showed better fault detection performance.

• Journal of Convergence for Information Technology
• /
• v.11 no.11
• /
• pp.57-65
• /
• 2021

We propose a novel method to detect abnormal data of specific symptoms using deep learning in air pollution measurement system. Existing methods generally detect abnomal data by classifying data showing unusual patterns different from the existing time series data. However, these approaches have limitations in detecting specific symptoms. In this paper, we use DeepLab V3+ model mainly used for foreground segmentation of images, whose structure has been changed to handle one-dimensional data. Instead of images, the model receives time-series data from multiple sensors and can detect data showing specific symptoms. In addition, we improve model's performance by reducing the complexity of noisy form time series data by using 'piecewise aggregation approximation'. Through the experimental results, it can be confirmed that anomaly data detection can be performed successfully.

• The Journal of Society for e-Business Studies
• /
• v.26 no.1
• /
• pp.127-140
• /
• 2021

Recently, sequence data containing time information, such as sensor measurement data and purchase history, has been generated in various applications. So far, many methods for finding sequences that are significantly different from other sequences among given sequences have been proposed. However, most of them have a limitation that they consider only the order of elements in the sequences. Therefore, in this paper, we propose a new anomalous sequence detection method that considers both the order of elements and the time interval between elements. The proposed method uses an extended LSTM autoencoder model, which has an additional layer that converts a sequence into a form that can help effectively learn both the order of elements and the time interval between elements. The proposed method learns the features of the given sequences with the extended LSTM autoencoder model, and then detects sequences that the model does not reconstruct well as anomalous sequences. Using experiments on synthetic data that contains both normal and anomalous sequences, we show that the proposed method achieves an accuracy close to 100% compared to the method that uses only the traditional LSTM autoencoder.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.1
• /
• pp.33-39
• /
• 2013

In the transformation of response variable in partial linear models outliers can cause a bad effect on estimating the transformation parameter, just as in the linear models. To solve this problem the processes of estimating transformation parameter and detecting outliers are needed, but have difficulties to be performed due to the arbitrariness of the nonparametric function included in the partial linear model. In this study, through the estimation of nonparametric function and outlier detection methods such as a sequential test and a maximum trimmed likelihood estimation, processes for transforming response variable robust to outliers in partial linear models are suggested. The proposed methods are verified and compared their effectiveness by simulation study and examples.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2023.11a
• /
• pp.185-187
• /
• 2023

고장 진단은 IoT 장비의 안전성과 효율성을 유지하는데 필요한 기술 중 하나이다. 따라서, 본 연구는 IoT 센서 데이터를 기반한 고장 진단 알고리즘을 개발하는데 목적이 있다. 본 연구는 알고리즘의 효율성을 개선하기 위해 기술통계량을 기반하여 데이터 차원을 축소하였으며, 이를 바탕으로 고장 진단 알고리즘의 정확도 및 연산시간을 개선하였다. 본 연구는 다양한 후보 알고리즘을 활용하여 고장진단을 수행하였으며, 정확도를 기반으로 가장 우수한 알고리즘을 선정하였다. 연구 결과, Isolation Forest 알고리즘이 가장 뛰어난 분류 결과를 나타내었다. 본 연구결과를 통해 IoT 센서의 안전성과 신뢰성을 향상시키는 데 도움을 줄 수 있다.