• Title/Summary/Keyword: 이상 탐지 프로세스

Search Result 37, Processing Time 0.022 seconds

Dynamic Seed Selection for Twitter Data Collection (트위터 데이터 수집을 위한 동적 시드 선택)

  • Lee, Hyoenchoel;Byun, Changhyun;Kim, Yanggon;Lee, Sang Ho
    • Journal of KIISE:Databases
    • /
    • v.41 no.4
    • /
    • pp.217-225
    • /
    • 2014
  • Analysis of social media such as Twitter can yield interesting perspectives to understanding human behavior, detecting hot issues, identifying influential people, or discovering a group and community. However, it is difficult to gather the data relevant to specific topics due to the main characteristics of social media data; data is large, noisy, and dynamic. This paper proposes a new algorithm that dynamically selects the seed nodes to efficiently collect tweets relevant to topics. The algorithm utilizes attributes of users to evaluate the user influence, and dynamically selects the seed nodes during the collection process. We evaluate the proposed algorithm with real tweet data, and get satisfactory performance results.

A Pre-processing Process Using TadGAN-based Time-series Anomaly Detection (TadGAN 기반 시계열 이상 탐지를 활용한 전처리 프로세스 연구)

  • Lee, Seung Hoon;Kim, Yong Soo
    • Journal of Korean Society for Quality Management
    • /
    • v.50 no.3
    • /
    • pp.459-471
    • /
    • 2022
  • Purpose: The purpose of this study was to increase prediction accuracy for an anomaly interval identified using an artificial intelligence-based time series anomaly detection technique by establishing a pre-processing process. Methods: Significant variables were extracted by applying feature selection techniques, and anomalies were derived using the TadGAN time series anomaly detection algorithm. After applying machine learning and deep learning methodologies using normal section data (excluding anomaly sections), the explanatory power of the anomaly sections was demonstrated through performance comparison. Results: The results of the machine learning methodology, the performance was the best when SHAP and TadGAN were applied, and the results in the deep learning, the performance was excellent when Chi-square Test and TadGAN were applied. Comparing each performance with the papers applied with a Conventional methodology using the same data, it can be seen that the performance of the MLR was significantly improved to 15%, Random Forest to 24%, XGBoost to 30%, Lasso Regression to 73%, LSTM to 17% and GRU to 19%. Conclusion: Based on the proposed process, when detecting unsupervised learning anomalies of data that are not actually labeled in various fields such as cyber security, financial sector, behavior pattern field, SNS. It is expected to prove the accuracy and explanation of the anomaly detection section and improve the performance of the model.

River monitoring using low-cost drone sensors (저가용 드론 센서를 활용한 하천 모니터링)

  • Lee, Geun Sang;Kim, Young Joo;Jung, Kwan Sue;Park, Bomi;Kim, Bo Yeong
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.346-346
    • /
    • 2020
  • 홍수기 효과적인 하천관리를 위해서는 광역 모니터링을 위한 기술 확보가 매우 중요하며, 최근 드론을 활용한 하천 모니터링에 관한 관심이 점차 증가되고 있다. 하천관리에 필요한 드론 탑재용 센서는 기본적으로 RGB 광학센서를 비롯하여 근적외선(Nir) 및 열적외선 센서가 함께 운용되는 것이 효과적이다. 그러나 현재 판매되는 드론 카메라를 살펴보면 근적외선과 열적외선 센서가 별도로 분리되어 있고 광학센서에 비해 상대적으로 매우 고가로 판매되고 있는 실정이다. 따라서 하천 모니터링을 위해서는 광학(RGB), 근적외선 그리고 열적외선 센서가 통합된 저가의 탑재체 개발이 시급하고 이를 활용한 하천 모니터링 프로세스를 정립할 필요가 있다. 본 연구에서는 일반 드론에 쉽게 탑재 가능한 하천 모니터링용 탑재체를 개발하였으며, 이를 기반으로 하천 홍수 및 부유사 모니터링에 활용하였다. 광학센서는 하천의 주요 형상을 확인하는데 이용하였으며, 근적외선 센서는 홍수 및 부유사 탐지에 활용하였다. 특히 본 연구에서는 비교적 넓은 하천 구역에 대한 공간정보를 구축하기 위해 75% 이상의 중복도를 가지고 촬영하도록 세팅하였으며 영상접합 SW를 활용하여 정사영상을 생성하였다. 구축한 근적외선 정사영상으로부터 영상분석 프로그램을 활용하여 홍수 및 부유사 영역을 추출하였으며 이를 통해 홍수기 하천 모니터링 및 치수 업무 의사결정을 위한 정보를 제공할 수 있었다. 저가용 드론 센서는 상용 SW와의 연계가 어렵기 때문에 자동비행 프로그램처럼 해당 위치별 영상 촬영이 어려운 한계가 있었으며, 본 연구에서는 센서의 제원특성을 활용하여 자동비행 SW에서도 일정 이상의 중복도를 확보할 수 있는 비행고도별 촬영시간 등을 종합적으로 설계하였다. 이를 통해 해당 지역에 대한 하천 모니터링용 정사영상을 구축할 수 있었으며 기존의 고가용 드론 센서와 유사한 효과를 가져올 수 있었다.

  • PDF

ECPS: Efficient Cloud Processing Scheme for Massive Contents (클라우드 환경에서 대규모 콘텐츠를 위한 효율적인 자원처리 기법)

  • Na, Moon-Sung;Kim, Seung-Hoon;Lee, Jae-Dong
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.15 no.4
    • /
    • pp.17-27
    • /
    • 2010
  • Major IT vendors expect that cloud computing technology makes it possible to reduce the contents service cycle, speed up application deployment and skip the installation process, reducing operational costs, proactive management etc. However, cloud computing environment for massive content service solutions requires high-performance data processing to reduce the time of data processing and analysis. In this study, Efficient_Cloud_Processing_Scheme(ECPS) is proposed for allocation of resources for massive content services. For high-performance services, optimized resource allocation plan is presented using MapReduce programming techniques and association rules that is used to detect hidden patterns in data mining, based on levels of Hadoop platform(Infrastructure as a service). The proposed ECPS has brought more than 20% improvement in performance and speed compared to the traditional methods.

Study on Energy Efficiency Improvement in Manufacturing Core Processes through Energy Process Innovation (에너지 프로세스 혁신을 통한 제조 핵심 공정의 에너지 효율화 방안 연구)

  • Sang-Joon Cho;Hyun-Mu Lee;Jin-Soo Lee
    • Journal of Advanced Technology Convergence
    • /
    • v.2 no.4
    • /
    • pp.43-48
    • /
    • 2023
  • Globally, there is a collaborative effort to achieve global carbon neutrality in response to climate change. In the case of South Korea, greenhouse gas emissions are rapidly increasing, presenting an urgent situation that requires resolution. In this context, this study developed a thermal energy collection device named a 'steam trap' and created an AI model capable of predicting future electricity usage by collecting energy usage data through steam traps. The average accuracy of electricity usage prediction with this AI model was 96.7%, demonstrating high precision. Consequently, the AI model enables the prediction and management of days with high electricity consumption and identifies which facilities contribute to elevated power usage. Future research aims to optimize energy consumption efficiency through efficient equipment operation using anomaly detection in steam traps and standardizing energy management systems, with the ultimate goal of reducing greenhouse gas emissions.

Research on BGP dataset analysis and CyCOP visualization methods (BGP 데이터셋 분석 및 CyCOP 가시화 방안 연구)

  • Jae-yeong Jeong;Kook-jin Kim;Han-sol Park;Ji-soo Jang;Dong-il Shin;Dong-kyoo Shin
    • Journal of Internet Computing and Services
    • /
    • v.25 no.1
    • /
    • pp.177-188
    • /
    • 2024
  • As technology evolves, Internet usage continues to grow, resulting in a geometric increase in network traffic and communication volumes. The network path selection process, which is one of the core elements of the Internet, is becoming more complex and advanced as a result, and it is important to effectively manage and analyze it, and there is a need for a representation and visualization method that can be intuitively understood. To this end, this study designs a framework that analyzes network data using BGP, a network path selection method, and applies it to the cyber common operating picture for situational awareness. After that, we analyze the visualization elements required to visualize the information and conduct an experiment to implement a simple visualization. Based on the data collected and preprocessed in the experiment, the visualization screens implemented help commanders or security personnel to effectively understand the network situation and take command and control.

LxBSM: Loadable Kernel Module for the Creation of C2 Level Audit Data based on Linux (LxBSM: C2 수준의 감사 자료 생성을 위한 리눅스 기반 동적 커널 모듈)

  • 전상훈;최재영;김세환;심원태
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.10 no.2
    • /
    • pp.146-155
    • /
    • 2004
  • Currently most of commercial operating systems contain a high-level audit feature to increase their own security level. Linux does not fall behind the other commercial operating systems in performance and stability, but Linux does not have a good audit feature. Linux is required to support a higher security feature than C2 level of the TCSEC in order to be used as a server operating system, which requires the kernel-level audit feature that provides the system call auditing feature and audit event. In this paper, we present LxBSM, which is a kernel module to provide the kernel-level audit features. The audit record format of LxBSM is compatible with that of Sunshield BSM. The LxBSM is implemented as a loadable kernel module, so it has the enhanced usability. It provides the rich audit records including the user-level audit events such as login/logout. It supports both the pipe and file interface for increasing the connectivity between LxBSM and intrusion detection systems (IDS). The performance of LxBSM is compared and evaluated with that of Linux kernel without the audit features. The response time was increased when the system calls were called to create the audit data, such as fork, execve, open, and close. However any other performance degradation was not observed.