• 제목/요약/키워드: Anomaly data detection

Search Result 380, Processing Time 0.032 seconds

Research on BGP dataset analysis and CyCOP visualization methods (BGP 데이터셋 분석 및 CyCOP 가시화 방안 연구)

  • Jae-yeong Jeong;Kook-jin Kim;Han-sol Park;Ji-soo Jang;Dong-il Shin;Dong-kyoo Shin
    • Journal of Internet Computing and Services
    • /
    • v.25 no.1
    • /
    • pp.177-188
    • /
    • 2024
  • As technology evolves, Internet usage continues to grow, resulting in a geometric increase in network traffic and communication volumes. The network path selection process, which is one of the core elements of the Internet, is becoming more complex and advanced as a result, and it is important to effectively manage and analyze it, and there is a need for a representation and visualization method that can be intuitively understood. To this end, this study designs a framework that analyzes network data using BGP, a network path selection method, and applies it to the cyber common operating picture for situational awareness. After that, we analyze the visualization elements required to visualize the information and conduct an experiment to implement a simple visualization. Based on the data collected and preprocessed in the experiment, the visualization screens implemented help commanders or security personnel to effectively understand the network situation and take command and control.

Unstructured Data Analysis using Equipment Check Ledger: A Case Study in Telecom Domain (장비점검 일지의 비정형 데이터분석을 통한 고장 대응 효율화 사례 연구)

  • Ju, Yeonjin;Kim, Yoosin;Jeong, Seung Ryul
    • Journal of Internet Computing and Services
    • /
    • v.21 no.1
    • /
    • pp.127-135
    • /
    • 2020
  • As the importance of the use and analysis of big data is emerging, there is a growing interest in natural language processing techniques for unstructured data such as news articles and comments. Particularly, as the collection of big data becomes possible, data mining techniques capable of pre-processing and analyzing data are emerging. In this case study with a telecom company, we propose a methodology how to formalize unstructured data using text mining. The domain is determined as equipment failure and the data is about 2.2 million equipment check ledger data. Data on equipment failures by 800,000 per year is accumulated in the equipment check ledger. The equipment check ledger coexist with both formal and unstructured data. Although formal data can be easily used for analysis, unstructured data is difficult to be used immediately for analysis. However, in unstructured data, there is a high possibility that important information. Because it can be contained that is not written in a formal. Therefore, in this study, we study to develop digital transformation method for unstructured data in equipment check ledger.

Seismic AVO Analysis, AVO Modeling, AVO Inversion for understanding the gas-hydrate structure (가스 하이드레이트 부존층의 구조파악을 위한 탄성파 AVO 분석 AVO모델링, AVO역산)

  • Kim Gun-Duk;Chung Bu-Heung
    • 한국신재생에너지학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.643-646
    • /
    • 2005
  • The gas hydrate exploration using seismic reflection data, the detection of BSR(Bottom Simulating Reflector) on the seismic section is the most important work flow because the BSR have been interpreted as being formed at the base of a gas hydrate zone. Usually, BSR has some dominant qualitative characteristics on seismic section i.e. Wavelet phase reversal compare to sea bottom signal, Parallel layer with sea bottom, Strong amplitude, Masking phenomenon above the BSR, Cross bedding with other geological layer. Even though a BSR can be selected on seismic section with these guidance, it is not enough to conform as being true BSR. Some other available methods for verifying the BSR with reliable analysis quantitatively i.e. Interval velocity analysis, AVO(Amplitude Variation with Offset)analysis etc. Usually, AVO analysis can be divided by three main parts. The first part is AVO analysis, the second is AVO modeling and the last is AVO inversion. AVO analysis is unique method for detecting the free gas zone on seismic section directly. Therefore it can be a kind of useful analysis method for discriminating true BSR, which might arise from an Possion ratio contrast between high velocity layer, partially hydrated sediment and low velocity layer, water saturated gas sediment. During the AVO interpretation, as the AVO response can be changed depend upon the water saturation ratio, it is confused to discriminate the AVO response of gas layer from dry layer. In that case, the AVO modeling is necessary to generate synthetic seismogram comparing with real data. It can be available to make conclusions from correspondence or lack of correspondence between the two seismograms. AVO inversion process is the method for driving a geological model by iterative operation that the result ing synthetic seismogram matches to real data seismogram wi thin some tolerance level. AVO inversion is a topic of current research and for now there is no general consensus on how the process should be done or even whether is valid for standard seismic data. Unfortunately, there are no well log data acquired from gas hydrate exploration area in Korea. Instead of that data, well log data and seismic data acquired from gas sand area located nearby the gas hydrate exploration area is used to AVO analysis, As the results of AVO modeling, type III AVO anomaly confirmed on the gas sand layer. The Castagna's equation constant value for estimating the S-wave velocity are evaluated as A=0.86190, B=-3845.14431 respectively and water saturation ratio is $50\%$. To calculate the reflection coefficient of synthetic seismogram, the Zoeppritz equation is used. For AVO inversion process, the dataset provided by Hampson-Rushell CO. is used.

  • PDF

RADARSAT SAR Investigations of Lineament and Spring Water in Cheju Island (RADARSAT SAR 자료를 이용한 제주도 선구조 연구 및 용천 특성 연구)

  • 원중선;류주형;지광훈
    • Korean Journal of Remote Sensing
    • /
    • v.14 no.4
    • /
    • pp.325-342
    • /
    • 1998
  • Two RADARSAT SAR images with different modes acquired by Canadian Space Agency to test the effectiveness of geological lineament extraction and spring water detection over the Cheju Island. Geological lineaments are poorly developed this basalt dominant volcanic island, but more linear features can be extracted when SAR and TM images are simultaneously analyzed than when TM image alone is used. This results mainly owe to the facts that RADARSAT SAR systems are able to provide data with different frequencies, azimuth, and incidence angles. Distribution of spring water along coast is poorly correlated with geological lineaments or drainage pattern, but those in middle range of mountain region are developed along geological lineaments. Detection of spring water using remotely sensed images are turned out to be very difficult to achieve. Radial shaped sea surface temperature anomaly derived from TM thermal band should be the best candidate for spring water, but the resolution is not high enough. We also investigate the normalized radar cross section (or sigma naught) converted from RADARSAT and ERS-1 SAR data but to discriminate the spring water effectively except where relatively large water mass is observed on land side. Speckle noise and irregularity in physical sea surface condition are the serious obstacles for this application. ERS-1 SAR image acquired in low incidence angle was more useful for geological lineament estimation and water body study than RADARSAT SAR images with high incidence angles. Therefore the selection of incidence angle is critical in geological and spring water applications of SAR images, and low incidence angles less than about 30$^{\circ}$ are recommended to monitor the Cheju volcanic island.

Implementation of Security Information and Event Management for Realtime Anomaly Detection and Visualization (실시간 이상 행위 탐지 및 시각화 작업을 위한 보안 정보 관리 시스템 구현)

  • Kim, Nam Gyun;Park, Sang Seon
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.8 no.5
    • /
    • pp.303-314
    • /
    • 2018
  • In the past few years, government agencies and corporations have succumbed to stealthy, tailored cyberattacks designed to exploit vulnerabilities, disrupt operations and steal valuable information. Security Information and Event Management (SIEM) is useful tool for cyberattacks. SIEM solutions are available in the market but they are too expensive and difficult to use. Then we implemented basic SIEM functions to research and development for future security solutions. We focus on collection, aggregation and analysis of real-time logs from host. This tool allows parsing and search of log data for forensics. Beyond just log management it uses intrusion detection and prioritize of security events inform and support alerting to user. We select Elastic Stack to process and visualization of these security informations. Elastic Stack is a very useful tool for finding information from large data, identifying correlations and creating rich visualizations for monitoring. We suggested using vulnerability check results on our SIEM. We have attacked to the host and got real time user activity for monitoring, alerting and security auditing based this security information management.

320-Channel Multi-Frequency Trans-Admittance Scanner(TAS) for Anomaly Detection (도전율 및 유전율이 다른 병소의 검출을 위한 320-채널 다주파수 Trans-Admittance Scanner(TAS))

  • Oh, Tong-In;Lee, Min-Hyoung;Kim, Hee-Jin;Woo, Eung-Je
    • Journal of Biomedical Engineering Research
    • /
    • v.28 no.1
    • /
    • pp.84-94
    • /
    • 2007
  • In order to collect information on local distribution of conductivity and permittivity underneath a scan probe, we developed a multi-frequency trans-admittance scanner (TAS). Applying a sinusoidal voltage with variable frequency on a chosen distal part of a human body, we measure exit currents from 320 grounded electrodes placed on a chosen surface of the subject. The electrodes are packaged inside a small and light scan probe. The system includes one voltage source and 17 digital ammeters. Front-end of each ammeter is a current-to-voltage converter with virtual grounding of a chosen electrode. The rest of the ammeter is a voltmeter performing digital phase-sensitive demodulation. Using resistor loads, we calibrate the system including the scan probe to compensate frequency-dependent variability of current measurements and also inter-channel variability among multiple. We found that SNR of each ammeter is about 85dB and the minimal measurable current is 5nA. Using saline phantoms with objects made from TX-151, we verified the performance of the lesion estimation algorithm. The error rate of the depth estimation was about 19.7%. For the size estimate, the error rate was about 15.3%. The results suggest improvement in lesion estimation algorithm based on multi-frequency trans-admittance data.

Application of Highland Kimchi Cabbage Status Map for Growth Monitoring based on Unmanned Aerial Vehicle

  • Na, Sang-Il;Park, Chan-Won;Lee, Kyung-Do
    • Korean Journal of Soil Science and Fertilizer
    • /
    • v.49 no.5
    • /
    • pp.469-479
    • /
    • 2016
  • Kimchi cabbage is one of the most important vegetables in Korea and a target crop for market stabilization as well. In particular Kimchi cabbages in a highland area are very sensitive to the fluctuations in supply and demand. Yield variability due to growth conditions dictates the market fluctuations of Kimchi cabbage price. This study was carried out to understand the distribution of the highland Kimchi cabbage growth status in Anbandeok. Anbandeok area in Gangneung, Gangwon-do, Korea is one of the main producing districts of highland Kimchi cabbage. The highland Kimchi cabbage status map of each growth factor was obtained from unmanned aerial vehicle (UAV) imagery and field survey data. Six status maps include UAVRGB image map, normalized difference vegetation index (NDVI) distribution/anomaly map, Crop distribution map, Planting/Harvest distribution map, Growth parameter map and Growth disorder map. As a result, the highland Kimchi cabbage status maps from May 31 to Sep. 6 in 2016 were presented to show spatial variability in the field. The benefits of the highland Kimchi cabbage status map can be summarized as follows: crop growth monitoring, reference for field observations and survey, the relative comparison of the growth condition in field scale, evaluation of growth in comparison of average year, change detection of annual crops or planting areas, abandoned fields monitoring, prediction of harvest season etc.

Real-time security Monitroing assessment model for cybersecurity vulnera bilities in network separation situations (망분리 네트워크 상황에서 사이버보안 취약점 실시간 보안관제 평가모델)

  • Lee, DongHwi;Kim, Hong-Ki
    • Convergence Security Journal
    • /
    • v.21 no.1
    • /
    • pp.45-53
    • /
    • 2021
  • When the security monitoring system is performed in a separation network, there is little normal anomaly detection in internal networks or high-risk sections. Therefore, after the establishment of the security network, a model is needed to evaluate state-of-the-art cyber threat anomalies for internal network in separation network to complete the optimized security structure. In this study, We evaluate it by generating datasets of cyber vulnerabilities and malicious code arising from general and separation networks, It prepare for the latest cyber vulnerabilities in internal network cyber attacks to analyze threats, and established a cyber security test evaluation system that fits the characteristics. The study designed an evaluation model that can be applied to actual separation network institutions, and constructed a test data set for each situation and applied a real-time security assessment model.

Intelligent Abnormal Situation Event Detections for Smart Home Users Using Lidar, Vision, and Audio Sensors (스마트 홈 사용자를 위한 라이다, 영상, 오디오 센서를 이용한 인공지능 이상징후 탐지 알고리즘)

  • Kim, Da-hyeon;Ahn, Jun-ho
    • Journal of Internet Computing and Services
    • /
    • v.22 no.3
    • /
    • pp.17-26
    • /
    • 2021
  • Recently, COVID-19 has spread and time to stay at home has been increasing in accordance with quarantine guidelines of the government such as recommendations to refrain from going out. As a result, the number of single-person households staying at home is also increasingsingle-person households are less likely to be notified to the outside world in times of emergency than multi-person households. This study collects various situations occurring in the home with lidar, image, and voice sensors and analyzes the data according to the sensors through their respective algorithms. Using this method, we analyzed abnormal patterns such as emergency situations and conducted research to detect abnormal signs in humans. Artificial intelligence algorithms that detect abnormalities in people by each sensor were studied and the accuracy of anomaly detection was measured according to the sensor. Furthermore, this work proposes a fusion method that complements the pros and cons between sensors by experimenting with the detectability of sensors for various situations.

Study on Energy Efficiency Improvement in Manufacturing Core Processes through Energy Process Innovation (에너지 프로세스 혁신을 통한 제조 핵심 공정의 에너지 효율화 방안 연구)

  • Sang-Joon Cho;Hyun-Mu Lee;Jin-Soo Lee
    • Journal of Advanced Technology Convergence
    • /
    • v.2 no.4
    • /
    • pp.43-48
    • /
    • 2023
  • Globally, there is a collaborative effort to achieve global carbon neutrality in response to climate change. In the case of South Korea, greenhouse gas emissions are rapidly increasing, presenting an urgent situation that requires resolution. In this context, this study developed a thermal energy collection device named a 'steam trap' and created an AI model capable of predicting future electricity usage by collecting energy usage data through steam traps. The average accuracy of electricity usage prediction with this AI model was 96.7%, demonstrating high precision. Consequently, the AI model enables the prediction and management of days with high electricity consumption and identifies which facilities contribute to elevated power usage. Future research aims to optimize energy consumption efficiency through efficient equipment operation using anomaly detection in steam traps and standardizing energy management systems, with the ultimate goal of reducing greenhouse gas emissions.