• Title/Summary/Keyword: Preprocessing Process

Search Result 434, Processing Time 0.023 seconds

Anomaly Detection and Performance Analysis using Deep Learning (딥러닝을 활용한 설비 이상 탐지 및 성능 분석)

  • Hwang, Ju-hyo;Jin, Kyo-hong
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.78-81
    • /
    • 2021
  • Through the smart factory construction project, sensors can be installed in manufacturing production facilities and various process data can be collected in real time. Through this, research on real-time facility anomaly detection is being actively conducted to reduce production interruption due to facility abnormality in the manufacturing process. In this paper, to detect abnormalities in production facilities, the manufacturing data was applied to deep learning models Autoencoder(AE), VAE(Variational Autoencoder), and AAE(Adversarial Autoencoder) to derive the results. Manufacturing data was used as input data through a simple moving average technique and preprocessing process, and performance analysis was conducted according to the window size of the simple movement average technique and the feature vector size of the AE model.

  • PDF

Anomaly Detection of Machining Process based on Power Load Analysis (전력 부하 분석을 통한 절삭 공정 이상탐지)

  • Jun Hong Yook;Sungmoon Bae
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.46 no.4
    • /
    • pp.173-180
    • /
    • 2023
  • Smart factory companies are installing various sensors in production facilities and collecting field data. However, there are relatively few companies that actively utilize collected data, academic research using field data is actively underway. This study seeks to develop a model that detects anomalies in the process by analyzing spindle power data from a company that processes shafts used in automobile throttle valves. Since the data collected during machining processing is time series data, the model was developed through unsupervised learning by applying the Holt Winters technique and various deep learning algorithms such as RNN, LSTM, GRU, BiRNN, BiLSTM, and BiGRU. To evaluate each model, the difference between predicted and actual values was compared using MSE and RMSE. The BiLSTM model showed the optimal results based on RMSE. In order to diagnose abnormalities in the developed model, the critical point was set using statistical techniques in consultation with experts in the field and verified. By collecting and preprocessing real-world data and developing a model, this study serves as a case study of utilizing time-series data in small and medium-sized enterprises.

Empirical Process Monitoring Via On-line Analysis of Complex Process Measurement Data (복잡한 공정 측정 데이터의 실시간 분석을 통한 공정 감시)

  • Cho, Hyun-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.7
    • /
    • pp.374-379
    • /
    • 2016
  • On-line process monitoring schemes are designed to give early warnings of process faults. In the artificial intelligence and machine learning fields, reliable approaches have been utilized, such as kernel-based nonlinear techniques. This work presents a kernel-based empirical monitoring scheme with a small sample problem. The measurement data of normal operations are easy to collect, whereas special events or faults data are difficult to collect. In such situations, noise filtering techniques can be helpful in enhancing the process monitoring performance. This can be achieved by the preprocessing of raw process data and eliminating unwanted variations of data. In this work, the performance of several monitoring schemes was demonstrated using three-dimensional batch process data. The results showed that the monitoring performance was improved significantly in terms of the detection success rate.

Comparison on the Deep Learning Performance of a Field of View Variable Color Images of Uterine Cervix (컬러 자궁경부 영상에서 딥러닝 기법에서의 영상영역 처리 방법에 따른 성능 비교 연구)

  • Seol, Yu Jin;Kim, Young Jae;Nam, Kye Hyun;Kim, Kwang Gi
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.7
    • /
    • pp.812-818
    • /
    • 2020
  • Cervical cancer is the second most common female cancer in the world. In Korea, cervical cancer accounts for 13 percent of female cancers and 4,200 cases occur annually[1]. The purpose of this study is to use a deep learning model to identify the possibility of lesions in the cervix and to evaluate the efficient image preprocessing in order to diagnose diverse types of cervix in form. The study used 4,107 normal photographs of uterine cervix and 6,285 abnormal photographs of uterine cervix. Two types of image preprocessing were resized to square. The methods are cropping based on height and filling the space up and down with black images. In addition, all images were resampled to 256×256. The average accuracy of cropped cases is 94.15%. The average accuracy of the filled cases is 93.41%. According to the study, the model performance of cropped data was slightly better. But there were several images that were not accurately classified. Therefore, the additional experiment with pre-treatment process based on cropping is needed to cover images of the cervix in more detail.

A detailed information browsing as a standard of the hierarchical structure on 3D national treasure building (3D 건조물 문화재의 계층적 구조를 기반으로 한 상세정보브라우징)

  • Jung, jung-il;Cho, Jin-so
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.816-821
    • /
    • 2009
  • In this paper, I would like to talk about a step by step detailed information browsing which is founded on hierarchical structure for offering suitable information about the mass 3D data of a national treasure building to user as a standard of the visual distance. A step by step detailed information of the national treasure building of gigantic proportions offers a process of detailed information browsing which decided suitable hierarchical structure as considering of the preprocessing procedure which produces hierarchical structure and a visual distance of user. In the preprocessing procedure, 3D data is divided and controlled by optimized spacial structures. The relevance connection between the inner spacial surface is then examined and reconfigured in order to prevent holes or distortions. Finally, relative information data is created. In detailed information browsing, by examining the visual distance between model and user, then by browsing proper step of data, suitable level model data can be provided to the users in accordance with the position of observation.

  • PDF

Development of Feature Extraction Algorithm for Finger Vein Recognition (지정맥 인식을 위한 특징 검출 알고리즘 개발)

  • Kim, Taehoon;Lee, Sangjoon
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.7 no.9
    • /
    • pp.345-350
    • /
    • 2018
  • This study is an algorithm for detecting vein pattern features important for finger vein recognition. The feature detection algorithm is important because it greatly affects recognition results in pattern recognition. The recognition rate is degraded because the reference is changed according to the finger position change. In addition, the image obtained by irradiating the finger with infrared light is difficult to separate the image background and the blood vessel pattern, and the detection time is increased because the image preprocessing process is performed. For this purpose, the presented algorithm can be performed without image preprocessing, and the detection time can be reduced. SWDA (Down Slope Trace Waveform) algorithm is applied to the finger vein images to detect the fingertip position and vein pattern. Because of the low infrared transmittance, relatively dark vein images can be detected with minimal detection error. In addition, the fingertip position can be used as a reference in the classification stage to compensate the decrease in the recognition rate. If we apply algorithms proposed to various recognition fields such as palm and wrist, it is expected that it will contribute to improvement of biometric feature detection accuracy and reduction of recognition performance time.

A Prediction Model for Coating Thickness Based on PLS Model and Variable Selection (부분최소자승법과 변수선택을 이용한 코팅두께 예측모델 개발)

  • Lee, Hye-Seon;Lee, Young-Rok;Jun, Chi-Hyuck;Hong, Jae-Hwa
    • The Korean Journal of Applied Statistics
    • /
    • v.23 no.2
    • /
    • pp.295-304
    • /
    • 2010
  • Coating thickness is one of target variables in quality control process in steel industry. To predict coating thickness and to control quality of anti-fingerprint steel coils, ultraviolet-visible spectra are measured. We propose a variable-interval selection procedure based on the variable importance in projection in partial least square model. Using the proposed variable interval selection method, prediction performance gets better in the reduced model than the full model with full spectra absorbance. It is also shown that the first differencing as a data preprocessing technique does work well for the prediction of coating thickness.

Pre-processing Method of Raw Data Based on Ontology for Machine Learning (머신러닝을 위한 온톨로지 기반의 Raw Data 전처리 기법)

  • Hwang, Chi-Gon;Yoon, Chang-Pyo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.5
    • /
    • pp.600-608
    • /
    • 2020
  • Machine learning constructs an objective function from learning data, and predicts the result of the data generated by checking the objective function through test data. In machine learning, input data is subjected to a normalisation process through a preprocessing. In the case of numerical data, normalization is standardized by using the average and standard deviation of the input data. In the case of nominal data, which is non-numerical data, it is converted into a one-hot code form. However, this preprocessing alone cannot solve the problem. For this reason, we propose a method that uses ontology to normalize input data in this paper. The test data for this uses the received signal strength indicator (RSSI) value of the Wi-Fi device collected from the mobile device. These data are solved through ontology because they includes noise and heterogeneous problems.

Design of a Mapping Framework on Image Correction and Point Cloud Data for Spatial Reconstruction of Digital Twin with an Autonomous Surface Vehicle (무인수상선의 디지털 트윈 공간 재구성을 위한 이미지 보정 및 점군데이터 간의 매핑 프레임워크 설계)

  • Suhyeon Heo;Minju Kang;Jinwoo Choi;Jeonghong Park
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.61 no.3
    • /
    • pp.143-151
    • /
    • 2024
  • In this study, we present a mapping framework for 3D spatial reconstruction of digital twin model using navigation and perception sensors mounted on an Autonomous Surface Vehicle (ASV). For improving the level of realism of digital twin models, 3D spatial information should be reconstructed as a digitalized spatial model and integrated with the components and system models of the ASV. In particular, for the 3D spatial reconstruction, color and 3D point cloud data which acquired from a camera and a LiDAR sensors corresponding to the navigation information at the specific time are required to map without minimizing the noise. To ensure clear and accurate reconstruction of the acquired data in the proposed mapping framework, a image preprocessing was designed to enhance the brightness of low-light images, and a preprocessing for 3D point cloud data was included to filter out unnecessary data. Subsequently, a point matching process between consecutive 3D point cloud data was conducted using the Generalized Iterative Closest Point (G-ICP) approach, and the color information was mapped with the matched 3D point cloud data. The feasibility of the proposed mapping framework was validated through a field data set acquired from field experiments in a inland water environment, and its results were described.

On-line Process Data-driven Diagnostics Using Statistical Techniques (실시간 공정 데이터와 통계적 방법에 기반한 이상진단)

  • Cho, Hyun-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.3
    • /
    • pp.40-45
    • /
    • 2018
  • Intelligent monitoring and diagnosis of production processes based on multivariate statistical methods has been one of important tasks for safety and quality issues. This is due to the fact that faults and unexpected events may have serious impacts on the operation of processes. This study proposes a diagnostic scheme based on effective representation of process measurement data and is evaluated using simulation process data. The effects of utilizing a preprocessing step and nonlinear statistical methods are also tested using fifteen faults of the simulation process. Results show that the proposed scheme produced more reliable results and outperformed other tested schemes with none of the filtering step and nonlinear methods. The proposed scheme is expected to be robust to process noises and easy to develop due to the lack of required rigorous mathematical process models or expert knowledge.