• Title/Summary/Keyword: Preprocessing method

Search Result 1,081, Processing Time 0.03 seconds

A Concordance Study of the Preprocessing Orders in Microarray Data (마이크로어레이 자료의 사전 처리 순서에 따른 검색의 일치도 분석)

  • Kim, Sang-Cheol;Lee, Jae-Hwi;Kim, Byung-Soo
    • The Korean Journal of Applied Statistics
    • /
    • v.22 no.3
    • /
    • pp.585-594
    • /
    • 2009
  • Researchers of microarray experiment transpose processed images of raw data to possible data of statistical analysis: it is preprocessing. Preprocessing of microarray has image filtering, imputation and normalization. There have been studied about several different methods of normalization and imputation, but there was not further study on the order of the procedures. We have no further study about which things put first on our procedure between normalization and imputation. This study is about the identification of differentially expressed genes(DEG) on the order of the preprocessing steps using two-dye cDNA microarray in colon cancer and gastric cancer. That is, we check for compare which combination of imputation and normalization steps can detect the DEG. We used imputation methods(K-nearly neighbor, Baysian principle comparison analysis) and normalization methods(global, within-print tip group, variance stabilization). Therefore, preprocessing steps have 12 methods. We identified concordance measure of DEG using the datasets to which the 12 different preprocessing orders were applied. When we applied preprocessing using variance stabilization of normalization method, there was a little variance in a sensitive way for detecting DEG.

A Study on Segmentation of Uterine Cervical Pap-Smears Images Using Neural Networks (신경 회로망을 이용한 자궁 경부 세포진 영상의 영역 분할에 관한 연구)

  • 김선아;김백섭
    • Journal of Biomedical Engineering Research
    • /
    • v.22 no.3
    • /
    • pp.231-239
    • /
    • 2001
  • This paper proposes a region segmenting method for the Pap-smear image. The proposed method uses a pixel classifier based on neural network, which consists of four stages : preprocessing, feature extraction, region segmentation and postprocessing. In the preprocessing stage, brightness value is normalized by histogram stretching. In the feature extraction stage, total 36 features are extracted from $3{\times}3$ or $5{\times}5$ window. In the region segmentation stage, each pixel which is associated with 36 features, is classified into 3 groups : nucleus, cytoplasm and background. The backpropagation network is used for classification. In the postprocessing stage, the pixel, which have been rejected by the above classifier, are re-classified by the relaxation algorithm. It has been shown experimentally that the proposed method finds the nucleus region accurately and it can find the cytoplasm region too.

  • PDF

A Study on the Contour-Preserving Image Filtering for Noise Removal (잡음 제거를 위한 윤곽선 보존 기법에 관한 연구)

  • Yoo, Choong-Woong;Ryu, Dae-Hyun;Bae, Kang-Yeul
    • Journal of the Korean Institute of Telematics and Electronics T
    • /
    • v.36T no.4
    • /
    • pp.24-29
    • /
    • 1999
  • In this paper, a simple contour-preserving filtering algorithm is proposed. The goal of the contour-preserving filtering method is to remove noise ad granularity as the preprocessing for the image segmentation procedure. Our method finds edge map and separates the image into the edge region and the non-edge region using this edge map. For the non-edge region, typical smoothing filters could be used to remove the noise and the small areas during the segmentation procedure. The result of simulation shows that our method is slightly better than the typical methods such as the median filtering and gradient inverse weighted filtering in the point of view of analysis of variance (ANOVA).

  • PDF

A Study of the Use of step by preprocessing and Graph Cut for the exact depth map (깊이맵 향상을 위한 전처리 과정과 그래프 컷에 관한 연구)

  • Kim, Young-Seop;Song, Eung-Yeol
    • Journal of the Semiconductor & Display Technology
    • /
    • v.10 no.3
    • /
    • pp.99-103
    • /
    • 2011
  • The stereoscopic vision system is the algorithm to obtain the depth of target object of stereo vision image. This paper presents an efficient disparity matching method using blue edge filter and graph cut algorithm. We do recommend the use of the simple sobel edge operator. The application of B band sobel edge operator over image demonstrates result with somewhat noisy (distinct border). The basic technique is to construct a specialized graph for the energy function to be minimized such that the minimum cut on the graph also minimizes the energy (either globally or locally). This method has the advantage of saving a lot of data. We propose a preprocessing effective stereo matching method based on sobel algorithm which uses blue edge information and the graph cut, we could obtain effective depth map.

A PROPOSAL OF ENHANSED NEURAL NETWORK CONTROLLERS FOR MULTIPLE CONTROL SYSTEMS

  • Nakagawa, Tomoyuki;Inaba, Masaaki;Sugawara, Ken;Yoshihara, Ikuo;Abe, Kenichi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1998.10a
    • /
    • pp.201-204
    • /
    • 1998
  • This paper presents a new construction method of candidate controllers using Multi-modal Neural Network(MNN). To improve a control performance of multiple controller, we construct, candidate controllers which consist of MNN. MNN can learn more complicated function than multilayer neural network. MNN consists of preprocessing module and neural network module. The preprocessing module transforms input signals into spectra which are used as input of the following neural network module. We apply the proposed method to multiple control system which controls the cart-pole balancing system and show the effectiveness of the proposed method.

  • PDF

A Study of the Use of Step by Preprocessing and Dynamic Programming for the Exact Depth Map (정확한 깊이 맵을 위한 전처리 과정과 다이나믹 프로그래밍에 관한 연구)

  • Kim, Young-Seop;Song, Eung-Yeol
    • Journal of the Semiconductor & Display Technology
    • /
    • v.9 no.3
    • /
    • pp.65-69
    • /
    • 2010
  • The stereoscopic vision system is the algorithm to obtain the depth of target object of stereo vision image. This paper presents an efficient disparity matching method using nagao filter, octree color quantization and dynamic programming algorithm. we describe methods for performing color quantization on full color RGB images, using an octree data structure. This method has the advantage of saving a lot of data. We propose a preprocessing stereo matching method based on Nagao-filter algorithm using color information. using the nagao filter, we could obtain effective depth map and using the octree color quantization, we could reduce the time of computation.

A New Algorithm of Reducing Candidate Haplotypes for Haplotype Inference (일배체형 추론을 위한 후보군 간소화 알고리즘)

  • Choi, Mun-Ho;Kang, Seung-Ho;Lim, Hyeong-Seok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.7
    • /
    • pp.1732-1739
    • /
    • 2013
  • The identification of haplotypes, which encode SNPs in a single chromosome, makes it possible to perform a haplotype-based association test with diseases. Given a set of genotypes from a population, the process of recovering the haplotypes that explain the genotypes is called haplotype inference. We propose a new preprocessing algorithm for the haplotype inference by pure parsimony (HIPP). The proposed algorithm excludes a large amount of redundant candidate haplotypes by detecting some groups of haplotypes that are dispensable for optimal solutions. For the well-known synthetic and biological data, the experimental results of our method show that our method run much faster than other preprocessing methods. After applying our preprocessing results, the numbers of haplotypes of HIPP solvers are equal to or slightly larger than that of optimal solutions.

New Pre-processing Method for Second-Order CPA on the IT Convergence Device (IT융합 디바이스에 대한 물리적 2차 CPA 공격을 위한 새로운 전처리 기법)

  • Lee, Chul-Hee;Hwang, Ah-Reum;Lee, Dong-Geon;Kim, Hyoung-Nam;Kim, Ho-Won
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.9B
    • /
    • pp.1369-1380
    • /
    • 2010
  • In this paper, we propose the efficient Second-Order Differential Power Analysis attack, which has ability to find significant information such as secret key in the devices consisting IT convergence environment such as Smartgrid, Advanced Metering Infrastructure(AMI) and ZigBee-based home networking service. This method helps to find the secret key easily at a device, even though it uses a countermeasure like masking which makes First-Order DPA attack harder. First, we present the performance results of our implementation which implements practical Second-Order DPA attack using the existing preprocessing function, and analyze it. Then we propose a stronger preprocessing function which overcomes countermeasures like masking. Finally, we analyze the results of the Second-Order CPA attack using proposed preprocessing function and verify that proposed scheme is very threatening to the security fields of IT convergence technology through the experimental results.

A study on Data Preprocessing for Developing Remaining Useful Life Predictions based on Stochastic Degradation Models Using Air Craft Engine Data (항공엔진 열화데이터 기반 잔여수명 예측력 향상을 위한 데이터 전처리 방법 연구)

  • Yoon, Yeon Ah;Jung, Jin Hyeong;Lim, Jun Hyoung;Chang, Tai-Woo;Kim, Yong Soo
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.43 no.2
    • /
    • pp.48-55
    • /
    • 2020
  • Recently, a study of prognosis and health management (PHM) was conducted to diagnose failure and predict the life of air craft engine parts using sensor data. PHM is a framework that provides individualized solutions for managing system health. This study predicted the remaining useful life (RUL) of aeroengine using degradation data collected by sensors provided by the IEEE 2008 PHM Conference Challenge. There are 218 engine sensor data that has initial wear and production deviations. It was difficult to determine the characteristics of the engine parts since the system and domain-specific information was not provided. Each engine has a different cycle, making it difficult to use time series models. Therefore, this analysis was performed using machine learning algorithms rather than statistical time series models. The machine learning algorithms used were a random forest, gradient boost tree analysis and XG boost. A sliding window was applied to develop RUL predictions. We compared model performance before and after applying the sliding window, and proposed a data preprocessing method to develop RUL predictions. The model was evaluated by R-square scores and root mean squares error (RMSE). It was shown that the XG boost model of the random split method using the sliding window preprocessing approach has the best predictive performance.

Evaluating Spectral Preprocessing Methods for Visible and Near Infrared Reflectance Spectroscopy to Predict Soil Carbon and Nitrogen in Mountainous Areas (산지토양의 탄소와 질소 예측을 위한 가시 근적외선 분광반사특성 분석의 전처리 방법 비교)

  • Jeong, Gwanyong
    • Journal of the Korean Geographical Society
    • /
    • v.51 no.4
    • /
    • pp.509-523
    • /
    • 2016
  • The soil prediction can provide quantitative soil information for sustainable mountainous ecosystem management. Visible near infrared spectroscopy, one of soil prediction methods, has been applied to predict several soil properties with effective costs, rapid and nondesctructive analysis, and satisfactory accuracy. Spectral preprocessing is a essential procedure to correct noisy spectra for visible near infrared spectroscopy. However, there are no attempts to evaluate various spectral preprocessing methods. We tested 5 different pretreatments, namely continuum removal, Savitzky-Golay filter, discrete wavelet transform, 1st derivative, and 2nd derivative to predict soil carbon(C) and nitrogen(N). Partial least squares regression was used for the prediction method. The total of 153 soil samples was split into 122 samples for calibration and 31 samples for validation. In the all range, absorption was increased with increasing C contents. Specifically, the visible region (650nm and 700nm) showed high values of the correlation coefficient with soil C and N contents. For spectral preprocessing methods, continuum removal had the highest prediction accuracy(Root Mean Square Error) for C(9.53mg/g) and N(0.79mg/g). Therefore, continuum removal was selected as the best preprocessing method. Additionally, there were no distinct differences between Savitzky-Golay filter and discrete wavelet transform for visual assessment and the methods showed similar validation results. According to the results, we also recommended Savitzky-Golay filter that is a simple pre-treatment with continuum removal.

  • PDF