• 제목/요약/키워드: data pre-processing

검색결과 801건 처리시간 0.031초

절연파괴 예측을 위한 트리방전의 영상처리에 관한 연구 (A Study on Image Processing of Tree Discharges for Insulation Destructive Prediction)

  • 오무송;김태성
    • 한국전기전자재료학회논문지
    • /
    • 제14권1호
    • /
    • pp.26-33
    • /
    • 2001
  • The proposed system was composed of pre-processor which was executing binary/high-pass filtering and post-processor which ranged from statistic data to prediction. In post-processor work, step one was filter process of image, step two was image recognition, and step three was destruction degree/time prediction. After these processing, we could predict image of the last destruction timestamp. This research was produced variation value according to growth of tree pattern. This result showed improved correction, when this research was applied image Processing. Pre-processing step of original image had good result binary work after high pas- filter execution. In the case of using partial discharge of the image, our research could predict the last destruction timestamp. By means of experimental data, this prediction system was acquired $\pm$3.2% error range.

  • PDF

근전도 기반의 Spider Chart와 딥러닝을 활용한 일상생활 잡기 손동작 분류 (Classification of Gripping Movement in Daily Life Using EMG-based Spider Chart and Deep Learning)

  • 이성문;피승훈;한승호;조용운;오도창
    • 대한의용생체공학회:의공학회지
    • /
    • 제43권5호
    • /
    • pp.299-307
    • /
    • 2022
  • In this paper, we propose a pre-processing method that converts to Spider Chart image data for classification of gripping movement using EMG (electromyography) sensors and Convolution Neural Networks (CNN) deep learning. First, raw data for six hand gestures are extracted from five test subjects using an 8-channel armband and converted into Spider Chart data of octagonal shapes, which are divided into several sliding windows and are learned. In classifying six hand gestures, the classification performance is compared with the proposed pre-processing method and the existing methods. Deep learning was performed on the dataset by dividing 70% of the total into training, 15% as testing, and 15% as validation. For system performance evaluation, five cross-validations were applied by dividing 80% of the entire dataset by training and 20% by testing. The proposed method generates 97% and 94.54% in cross-validation and general tests, respectively, using the Spider Chart preprocessing, which was better results than the conventional methods.

TadGAN 기반 시계열 이상 탐지를 활용한 전처리 프로세스 연구 (A Pre-processing Process Using TadGAN-based Time-series Anomaly Detection)

  • 이승훈;김용수
    • 품질경영학회지
    • /
    • 제50권3호
    • /
    • pp.459-471
    • /
    • 2022
  • Purpose: The purpose of this study was to increase prediction accuracy for an anomaly interval identified using an artificial intelligence-based time series anomaly detection technique by establishing a pre-processing process. Methods: Significant variables were extracted by applying feature selection techniques, and anomalies were derived using the TadGAN time series anomaly detection algorithm. After applying machine learning and deep learning methodologies using normal section data (excluding anomaly sections), the explanatory power of the anomaly sections was demonstrated through performance comparison. Results: The results of the machine learning methodology, the performance was the best when SHAP and TadGAN were applied, and the results in the deep learning, the performance was excellent when Chi-square Test and TadGAN were applied. Comparing each performance with the papers applied with a Conventional methodology using the same data, it can be seen that the performance of the MLR was significantly improved to 15%, Random Forest to 24%, XGBoost to 30%, Lasso Regression to 73%, LSTM to 17% and GRU to 19%. Conclusion: Based on the proposed process, when detecting unsupervised learning anomalies of data that are not actually labeled in various fields such as cyber security, financial sector, behavior pattern field, SNS. It is expected to prove the accuracy and explanation of the anomaly detection section and improve the performance of the model.

KorPatELECTRA : A Pre-trained Language Model for Korean Patent Literature to improve performance in the field of natural language processing(Korean Patent ELECTRA)

  • Jang, Ji-Mo;Min, Jae-Ok;Noh, Han-Sung
    • 한국컴퓨터정보학회논문지
    • /
    • 제27권2호
    • /
    • pp.15-23
    • /
    • 2022
  • 특허 분야에서 자연어처리(Natural Language Processing) 태스크는 특허문헌의 언어적 특이성으로 문제 해결의 난이도가 높은 과제임에 따라 한국 특허문헌에 최적화된 언어모델의 연구가 시급한 실정이다. 최근 자연어처리 분야에서는 특정 도메인에 특화되게 사전 학습(Pre-trained)한 언어모델을 구축하여 관련 분야의 다양한 태스크에서 성능을 향상시키려는 시도가 지속적으로 이루어지고 있다. 그 중, ELECTRA는 Google이 BERT 이후에 RTD(Replaced Token Detection)라는 새로운 방식을 제안하며 학습 효율성을 높인 사전학습 언어모델이다. 본 연구에서는 대량의 한국 특허문헌 데이터를 사전 학습한 KorPatELECTRA를 제안한다. 또한, 특허 문헌의 특성에 맞게 학습 코퍼스를 정제하고 특허 사용자 사전 및 전용 토크나이저를 적용하여 최적화된 사전 학습을 진행하였다. KorPatELECTRA의 성능 확인을 위해 실제 특허데이터를 활용한 NER(Named Entity Recognition), MRC(Machine Reading Comprehension), 특허문서 분류 태스크를 실험하였고 비교 대상인 범용 모델에 비해 3가지 태스크 모두에서 가장 우수한 성능을 확인하였다.

GOES-9 Raw Data Acquisition & Image Extraction

  • Kang C. H.;Park D. J.;Koo I. H.;Ahn S. I.;Kim E. K.
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2005년도 Proceedings of ISRS 2005
    • /
    • pp.582-585
    • /
    • 2005
  • The Geostationary Operational Environmental Satellite (GOES) 9, which is currently located at 155°E geostationary orbits, has transmitted earth observation data acquired by imager to CDA at NOAA. After the acquisition on ground, observation data are corrected on ground and re-transmitted to GOES-9 for the dissemination to users. In this paper, the procedure and result from raw data acquisition and pre-processing for earth observation imagery retrieval from GOES-9 Raw data acquired in Korea at May 2005 are introduced.

  • PDF

Assessment of Improving SWAT Weather Input Data using Basic Spatial Interpolation Method

  • Felix, Micah Lourdes;Choi, Mikyoung;Zhang, Ning;Jung, Kwansue
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2022년도 학술발표회
    • /
    • pp.368-368
    • /
    • 2022
  • The Soil and Water Assessment Tool (SWAT) has been widely used to simulate the long-term hydrological conditions of a catchment. Two output variables, outflow and sediment yield have been widely investigated in the field of water resources management, especially in determining the conditions of ungauged subbasins. The presence of missing data in weather input data can cause poor representation of the climate conditions in a catchment especially for large or mountainous catchments. Therefore, in this study, a custom module was developed and evaluated to determine the efficiency of utilizing basic spatial interpolation methods in the estimation of weather input data. The module has been written in Python language and can be considered as a pre-processing module prior to using the SWAT model. The results of this study suggests that the utilization of the proposed pre-processing module can improve the simulation results for both outflow and sediment yield in a catchment, even in the presence of missing data.

  • PDF

매스콘크리트의 온도균열 예측해석에서의 전후처리 시스템 개발에 관한 연구 (Pre- and Post Processing System on Prediction Analysis of Thermal Stress in Mass Concrete Structure)

  • 김유석;강석화;박칠림
    • 한국콘크리트학회:학술대회논문집
    • /
    • 한국콘크리트학회 1996년도 봄 학술발표회 논문집
    • /
    • pp.270-274
    • /
    • 1996
  • Until recently pre & post-processing of finite element model has been heavily relied on expensive graphic peripheral devices. But today, with the aid of inexpensive microcomputers, very effective pre & postprocessor graphics has been developed. In this study, Pre & Post processor(MASSPRE, MASSPOST) of prediction analysis of thermal stress in mass concrete structure is developed. The developed pre & post processors are raise to the efficiency in making input data for the main program and analysis of the results produced by the main program. This MASSPOST presents a stress contour graph, volume slice, time-temperature history graph, time-stress history graph, etc.

  • PDF

이동통신망을 활용한 무인비행장치 기반 이미지 획득, 전처리, 전송 시스템 (UAV-based Image Acquisition, Pre-processing, Transmission System Using Mobile Communication Networks)

  • 박종홍;안일엽
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2022년도 추계학술대회
    • /
    • pp.594-596
    • /
    • 2022
  • 본 논문은 무인비행장치에 탑재된 카메라를 통해 획득한 고화질의 이미지를 무인비행장치 상에서 전처리를 하여 이동통신망을 통해 서버로 전송하기 위한 시스템 및 기법에 관한 것이다. 기존의 이미지 획득 서비스용 무인비행장치의 경우, 무인비행장치에 탑재된 카메라의 외부저장장치에 획득한 이미지를 저장하고, 비행이 완료된 이후에 저장장치를 직접 옮기는 방식으로 이미지를 확인하였다. 이러한 방식의 경우, 외부저장장치를 통해 직접적으로 이미지 데이터를 확인하기 전에는 이미지 획득이나 전처리가 제대로 수행되었는지 확인할 수 없다는 한계점이 존재한다. 또한 해당 데이터는 외부저장장치에만 저장되기 때문에 데이터의 공유가 번거롭다는 단점이 존재한다. 본 논문에서는 위와 같은 문제점을 해결하기 위하여, 원격에서 이미지를 실시간으로 확인 가능한 시스템을 제안한다. 더 나아가, 무인비행장치에서의 촬영을 통한 이미지 획득 외에 지오태깅과 같은 전처리와 이동통신망을 통한 전송까지 수행이 가능한 시스템 및 방법을 제안한다.

  • PDF

대용량 데이터 처리를 위한 하이브리드형 클러스터링 기법 (A Hybrid Clustering Technique for Processing Large Data)

  • 김만선;이상용
    • 정보처리학회논문지B
    • /
    • 제10B권1호
    • /
    • pp.33-40
    • /
    • 2003
  • 데이터 마이닝은 지식발견 과정에서 중요한 역할을 수행하며, 여러 데이터 마이닝의 알고리즘들은 특정의 목적을 위하여 선택될 수 있다. 대부분의 전통적인 계층적 클러스터링 방법은 적은 양의 데이터 집합을 처리하는데 적합하여 제한된 리소스와 부족한 효율성으로 인하여 대용량의 데이터 집합을 다루기가 곤란하다. 본 연구에서는 대용량의 데이터에 적용되어 알려지지 않은 패턴을 발견할 수 있는 하이브리드형 신경망 클러스터링 기법의 PPC(Pre-Post Clustrering) 기법을 제안한다. PPC 기법은 인공지능적 방법인 자기조직화지도(SOM)와 통계적 방법인 계층적 클러스터링을 결합하여 두 과정에서는 군집의 내부적 특징을 나타내는 응집거리와 군집간의 외부적 거리를 나타내는 인접거리에 따라 유사도를 측정한다. 최종적으로 PPC 기법은 측정된 유사도를 이용하여 대용량 데이터 집합을 군집화한다. PPC 기법은 UCI Repository 데이터를 이용하여 실험해 본 결과, 다른 클러스터링 기법들 보다 우수한 응집도를 보였다.

INTRODUCTION OF COMS IDACS SYSTEM FOR METEOROLOGCIAL AND OCDAN MISSION

  • Lim, Hyun-Su;Park, Durk-Jong;Koo, In-Hoi;Kang, Chi-Ho
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2006년도 Proceedings of ISRS 2006 PORSEC Volume I
    • /
    • pp.67-70
    • /
    • 2006
  • KARI is developing Image Data Acquisition and Control System (IDACS) for pre-processing meteorological and ocean data acquired on geostationary orbit. This paper describes the functions and architecture of IDACS and gives its operation policy including backup operation to overcome limitation of single-configured antenna system. The COMS IDACS provides the capability to receive the raw sensor data and disseminate processed MI data to users via a satellite. From the processed image data, users can produce a set of meteorological and ocean products for a wide range of applications. Most of IDACS subsystems are being developed by Korean technologies and experience acquired from previous projects. In case of COMS geometric correction software module, as it is closely dependent on the characteristics of imagers and spacecraft bus system, it is being co-developed with overseas prime contractor who develops spacecraft bus system.

  • PDF