• Title/Summary/Keyword: Preprocessing Process

Search Result 427, Processing Time 0.028 seconds

Prediction of Distillation Column Temperature Using Machine Learning and Data Preprocessing (머신 러닝과 데이터 전처리를 활용한 증류탑 온도 예측)

  • Lee, Yechan;Choi, Yeongryeol;Cho, Hyungtae;Kim, Junghwan
    • Korean Chemical Engineering Research
    • /
    • v.59 no.2
    • /
    • pp.191-199
    • /
    • 2021
  • A distillation column, which is a main facility of the chemical process, separates the desired product from a mixture by using the difference of boiling points. The distillation process requires the optimization and the prediction of operation because it consumes much energy. The target process of this study is difficult to operate efficiently because the composition of feed flow is not steady according to the supplier. To deal with this problem, we could develop a data-driven model to predict operating conditions. However, data preprocessing is essential to improve the predictive performance of the model because the raw data contains outlier and noise. In this study, after optimizing the predictive model based long-short term memory (LSTM) and Random forest (RF), we used a low-pass filter and one-class support vector machine for data preprocessing and compared predictive performance according to the method and range of the preprocessing. The performance of the predictive model and the effect of the preprocessing is compared by using R2 and RMSE. In the case of LSTM, R2 increased from 0.791 to 0.977 by 23.5%, and RMSE decreased from 0.132 to 0.029 by 78.0%. In the case of RF, R2 increased from 0.767 to 0.938 by 22.3%, and RMSE decreased from 0.140 to 0.050 by 64.3%.

A computation method of reliability for preprocessing filters in the fire control system using Markov process and state transition probability matrix (Markov process 및 상태천이확률 행렬 계산을 통한 사격통제장치 전처리필터 신뢰성 산출 기법)

  • Kim, Jae-Hun;Lyou, Joon
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.2 no.2
    • /
    • pp.131-139
    • /
    • 1999
  • An easy and efficient method is proposed for a computation of reliability of preprocessing filters in the fire control system when the sensor data are frequently unreliable depending on the operation environment. It computes state transition probability matrix after modeling filter states as a Markov process, and computing false alarm and detection probability of each filter state under the given sensor failure probability. It shows that two important indices such as distributed state probability and error variance can be derived easily for a reliability assessment of the given sensor fusion system.

  • PDF

SMD Detection and Classification Using YOLO Network Based on Robust Data Preprocessing and Augmentation Techniques

  • NDAYISHIMIYE, Fabrice;Lee, Joon Jae
    • Journal of Multimedia Information System
    • /
    • v.8 no.4
    • /
    • pp.211-220
    • /
    • 2021
  • The process of inspecting SMDs on the PCB boards improves the product quality, performance and reduces frequent issues in this field. However, undesirable scenarios such as assembly failure and device breakdown can occur sometime during the assembly process and result in costly losses and time-consuming. The detection of these components with a model based on deep learning may be effective to reduce some errors during the inspection in the manufacturing process. In this paper, YOLO models were used due to their high speed and good accuracy in classification and target detection. A SMD detection and classification method using YOLO networks based on robust data preprocessing and augmentation techniques to deal with various types of variation such as illumination and geometric changes is proposed. For 9 different components of data provided from a PCB manufacturer company, the experiment results show that YOLOv4 is better with fast detection and classification than YOLOv3.

Application of tubular membrane to thickening process as a pre-treatment of anaerobic digester (관형막을 이용한 혐기소화조의 전처리 농축공정으로써 적용가능성 연구)

  • Kang, Hee-Seok;Park, Ki-Tae;Park, Jung-Woo;Kim, Hyung Soo
    • Journal of Korean Society of Water and Wastewater
    • /
    • v.29 no.2
    • /
    • pp.203-209
    • /
    • 2015
  • The purpose of this study is to estimate the applicability of a stable anaerobic digester using a separator membrane to the preprocessing thickening process. The results of the experiments showed about a 47.16% weight loss rate for the sludge under anaerobic condition, and about 41.17% under intermittent aeration condition. The concentrations of rejection water were $SCOD_{Cr}$ 25 mg/L, T-N 16.6 mg/L, and T-P 1.4 mg/L on the average under the intermittent aeration condition, which were lower than the concentrations of rejection water under an anaerobic condition. As for the factors affecting the reduction of the flux, correlation analyses of TTF, MLSS, $SCOD_{Cr}$, and $EPS_{Protein}$, $EPS_{Polysacchride}$ resulted in -0.97, -0.95, -0.84 and -0.86, -0.95, respectively, which showed that TTF had the highest correlation to the reduction of the flux. In addition, it was concluded that MLSS, $SCOD_{Cr}$ and $EPS_{Protein}$, $EPS_{Polysacchride}$ also have close correlations. The results are considered to show that, in the case of the process using a tubular membrane in the preprocessing process of an anaerobic digester, an intermittent aeration condition of the thickener considering the contamination of the membrane and load of rejection water is appropriate for the stable preprocessing process.

Identifying Causes of Industrial Process Faults Using Nonlinear Statistical Approach (공정 이상원인의 비선형 통계적 방법을 통한 진단)

  • Cho, Hyun-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.8
    • /
    • pp.3779-3784
    • /
    • 2012
  • Real-time process monitoring and diagnosis of industrial processes is one of important operational tasks for quality and safety reasons. The objective of fault diagnosis or identification is to find process variables responsible for causing a specific fault in the process. This helps process operators to investigate root causes more effectively. This work assesses the applicability of combining a nonlinear statistical technique of kernel Fisher discriminant analysis with a preprocessing method as a tool of on-line fault identification. To compare its performance to existing linear principal component analysis (PCA) identification scheme, a case study on a benchmark process was performed to show that the fault identification scheme produced more reliable diagnosis results than linear method.

Active Contour Model Based Object Contour Detection Using Genetic Algorithm with Wavelet Based Image Preprocessing

  • Mun, Kyeong-Jun;Kang, Hyeon-Tae;Lee, Hwa-Seok;Yoon, Yoo-Sool;Lee, Chang-Moon;Park, June-Ho
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.1
    • /
    • pp.100-106
    • /
    • 2004
  • In this paper, we present a novel, rapid approach for the detection of brain tumors and deformity boundaries in medical images using a genetic algorithm with wavelet based preprocessing. The contour detection problem is formulated as an optimization process that seeks the contour of the object in a manner of minimizing an energy function based on an active contour model. The brain tumor segmentation contour, however, cannot be detected in case that a higher gradient intensity exists other than the interested brain tumor and deformities. Our method for discerning brain tumors and deformities from unwanted adjacent tissues is proposed. The proposed method can be used in medical image analysis because the exact contour of the brain tumor and deformities is followed by precise diagnosis of the deformities.

A Selection of the Optimal Working Condition for an Outer-hull Preprocessing Robot Using a Taguchi Method (다구찌 방법을 이용한 선체 외판 전처리 로봇의 최적 작업 조건 선정)

  • Chung Won-Jee;Kim Ki-Jung;Kim Hyo-Gon;Kim Jung-Hyun;Kim Ho-Kyung;Lee Hun-Dong
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.15 no.4
    • /
    • pp.69-73
    • /
    • 2006
  • This paper present the optimal cleaning condition of the out-hull preprocessing robot by Taguchi method in design of experiments. A $L_8(2^4)$ orthogonal array is adopted to study the effect of adjustment parameters. The adjustment parameters consist of robot speed, motor torque, motor speed and tool angle. And the quality feature is selected as surface roughness of sheet metal. Taguchi analysis is performed in order to evaluate the effect of adjustment parameters of the quality feature of cleaning process by $Minitab^{(R)}$.

Research on Data Preprocessing Techniques for Efficient Decision-Making in Food Import Procedures (식품 수입 절차에서의 효율적 의사결정을 위한 데이터 전처리 기술에 관한 연구)

  • Jae-Hyeong Park;Yong-Uk Song;Ju-Young Kang
    • The Journal of Bigdata
    • /
    • v.8 no.1
    • /
    • pp.61-71
    • /
    • 2023
  • With the development of data-driven decision-making and sophisticated big data processing technique, there is a growing demand for information on how to process data. However, recent studies with data preprocessing mentioned only as a means to achieve a result. Therefore, in this study, we aimed to write in detail about the data processing pipeline, include preprocessing data. In particular, we shares the context and domain knowledge to aid fluent understand of the research.

Development of Checker-Switch Error Detection System using CNN Algorithm (CNN 알고리즘을 이용한 체커스위치 불량 검출 시스템 개발)

  • Suh, Sang-Won;Ko, Yo-Han;Yoo, Sung-Goo;Chong, Kil-To
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.18 no.12
    • /
    • pp.38-44
    • /
    • 2019
  • Various automation studies have been conducted to detect defective products based on product images. In the case of machine vision-based studies, size and color error are detected through a preprocessing process. A situation may arise in which the main features are removed during the preprocessing process, thereby decreasing the accuracy. In addition, complex systems are required to detect various kinds of defects. In this study, we designed and developed a system to detect errors by analyzing various conditions of defective products. We designed the deep learning algorithm to detect the defective features from the product images during the automation process using a convolution neural network (CNN) and verified the performance by applying the algorithm to the checker-switch failure detection system. It was confirmed that all seven error characteristics were detected accurately, and it is expected that it will show excellent performance when applied to automation systems for error detection.

A Study on the Preprocessing Method Using Construction of Watershed for Character Image segmentation

  • Nam Sang Yep;Choi Young Kyoo;Kwon Yun Jung;Lee Sung Chang
    • Proceedings of the IEEK Conference
    • /
    • 2004.08c
    • /
    • pp.814-818
    • /
    • 2004
  • Off-line handwritten character recognition is in difficulty of incomplete preprocessing because it has not dynamic and timing information besides has various handwriting, extreme overlap of the consonant and vowel and many error image of stroke. Consequently off-line handwritten character recognition needs to study about preprocessing of various methods such as binarization and thinning. This paper considers running time of watershed algorithm and the quality of resulting image as preprocessing For off-line handwritten Korean character recognition. So it proposes application of effective watershed algorithm for segmentation of character region and background region in gray level character image and segmentation function for binarization image and segmentation function for binarization by extracted watershed image. Besides it proposes thinning methods which effectively extracts skeleton through conditional test mask considering running time and quality. of skeleton, estimates efficiency of existing methods and this paper's methods as running time and quality. Watershed image conversion uses prewitt operator for gradient image conversion, extracts local minima considering 8-neighborhood pixel. And methods by using difference of mean value is used in region merging step, Converted watershed image by means of this methods separates effectively character region and background region applying to segmentation function. Average execution time on the previous method was 2.16 second and on this paper method was 1.72 second. We prove that this paper's method removed noise effectively with overlap stroke as compared with the previous method.

  • PDF