• 제목/요약/키워드: Preprocessing method

검색결과 1,070건 처리시간 0.026초

Comparison of Performance According to Preprocessing Methods in Estimating %IMF of Hanwoo Using CNN in Ultrasound Images

  • Kim, Sang Hyun
    • International journal of advanced smart convergence
    • /
    • 제11권2호
    • /
    • pp.185-193
    • /
    • 2022
  • There have been various studies in Korea to develop a %IMF(Intramuscular Fat Percentage) estimation method suitable for Hanwoo. Recently, a %IMF estimation method using a convolutional neural network (CNN), a kind of deep learning method among artificial intelligence methods, has been studied. In this study, we performed a performance comparison when various preprocessing methods were applied to the %IMF estimation of ultrasound images using CNN as mentioned above. The preprocessing methods used in this study are normalization, histogram equalization, edge enhancement, and a method combining normalization and edge enhancement. When estimating the %IMF of Hanwoo by the conventional method that did not apply preprocessing in the experiment, the accuracy was 98.2%. The other hand, we found that the accuracy improved to 99.5% when using preprocessing with histogram equalization alone or combined regularization and edge enhancement.

단체법을 위한 사전처리의 구현 (An Implementation of Preprocessing for the Simplex Method)

  • 임성묵;성명기;박순달
    • 대한산업공학회지
    • /
    • 제25권2호
    • /
    • pp.217-225
    • /
    • 1999
  • Preprocessing is the essential technique in the implementation of the simplex method for large scale linear programming problems. In this research, we explained the effect of preprocessing in the simplex method, classified the techniques into four categories, and compared our results with those of HOPDM, CPLEX and Soplex by computational experiments. We also noted some implementing issues of preprocessing for the simplex method and the recovery of the optimal basis of the original problem from that of the preprocessed problem.

  • PDF

Underwater Image Preprocessing and Compression for Efficient Underwater Searches and Ultrasonic Communications

  • Kim, Dong-Hoon;Song, Jun-Yeob
    • International Journal of Precision Engineering and Manufacturing
    • /
    • 제8권1호
    • /
    • pp.38-45
    • /
    • 2007
  • We propose a preprocessing method for removing floating particles from underwater images based on an analysis of the image features. We compared baseline JPEG and wavelet codec methods to determine the method best suited for underwater images. The proposed preprocessing method enhanced the compression ratio and resolution, and provided an efficient means of compressing the images. The wavelet codec method yielded better compression ratios and image resolutions. The results suggest that the wavelet codec method linked with the proposed preprocess method provides an efficient codec processor and transmission system for underwater images that are used for searches and transmitted via ultrasonic communications.

딥러닝 모델에서 포트홀 데이터셋의 성능 향상을 위한 전처리 방법 제안과 YOLO 모델을 통한 검증 (Proposed Pre-Processing Method for Improving Pothole Dataset Performance in Deep Learning Model and Verification by YOLO Model)

  • 이한진;양지웅;홍정희
    • 융합신호처리학회논문지
    • /
    • 제23권4호
    • /
    • pp.249-255
    • /
    • 2022
  • 포트홀은 아스팔트 포장도로의 구조적 결함을 나타내는 중요한 단서임과 동시에 많은 인명 피해와 재산 피해를 일으킨다. 따라서 정확한 포트홀 탐지는 도로 표면의 유지보수에 있어서 중요한 과제이다. 포트홀 탐지를 위해 많은 머신러닝 기술이 도입되고 있으며 딥러닝 모델의 효율성을 높이기 위해 데이터 전처리가 필요하다. 본 논문에서는 포트홀 데이터셋에서 중요한 질감과 형태를 강조하는 전처리 방법을 제안한다. 제안된 전처리 방법은 Intensity transformation을 사용해 도로의 불필요한 요소를 줄이고 포트홀의 질감과 형태를 부각한다. 또한 Superpixel, Sobel edge detection을 사용해 포트홀의 특징을 검출한다. 제안된 전처리 방법과 기존의 전처리 방법의 성능 비교를 통해 포트홀 검출에서 제안된 전처리 방법이 기존 방법보다 더 효과적인 방법이라는 것을 보여준다.

Effects of Preprocessing on Text Classification in Balanced and Imbalanced Datasets

  • Mehmet F. Karaca
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제18권3호
    • /
    • pp.591-609
    • /
    • 2024
  • In this study, preprocessings with all combinations were examined in terms of the effects on decreasing word number, shortening the duration of the process and the classification success in balanced and imbalanced datasets which were unbalanced in different ratios. The decreases in the word number and the processing time provided by preprocessings were interrelated. It was seen that more successful classifications were made with Turkish datasets and English datasets were affected more from the situation of whether the dataset is balanced or not. It was found out that the incorrect classifications, which are in the classes having few documents in highly imbalanced datasets, were made by assigning to the class close to the related class in terms of topic in Turkish datasets and to the class which have many documents in English datasets. In terms of average scores, the highest classification was obtained in Turkish datasets as follows: with not applying lowercase, applying stemming and removing stop words, and in English datasets as follows: with applying lowercase and stemming, removing stop words. Applying stemming was the most important preprocessing method which increases the success in Turkish datasets, whereas removing stop words in English datasets. The maximum scores revealed that feature selection, feature size and classifier are more effective than preprocessing in classification success. It was concluded that preprocessing is necessary for text classification because it shortens the processing time and can achieve high classification success, a preprocessing method does not have the same effect in all languages, and different preprocessing methods are more successful for different languages.

영상 클러스터링과 HSV 컬러 모델을 이용한 차선 검출 전처리 기법 (Preprocessing Technique for Lane Detection Using Image Clustering and HSV Color Model)

  • 최나래;최상일
    • 한국멀티미디어학회논문지
    • /
    • 제20권2호
    • /
    • pp.144-152
    • /
    • 2017
  • Among the technologies for implementing autonomous vehicles, advanced driver assistance system is a key technology to support driver's safe driving. In the technology using the vision sensor having a high utility, various preprocessing methods are used prior to feature extraction for lane detection. However, in the existing methods, the unnecessary lane candidates such as cars, lawns, and road separator in the road area are false positive. In addition, there are cases where the lane candidate itself can not be extracted in the area under the overpass, the lane within the dark shadow, the center lane of yellow, and weak lane. In this paper, we propose an efficient preprocessing method using k-means clustering for image division and the HSV color model. When the proposed preprocessing method is applied, the true positive region is maximally maintained during the lane detection and many false positive regions are removed.

얼굴 인식을 위한 Anisotropic smoothing 기반 조명 전처리 (Anisotropic based illumination Preprocessing for Face Recognition)

  • 김상훈;정선태;정수환;오두식;조성원
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2007년도 하계종합학술대회 논문집
    • /
    • pp.275-276
    • /
    • 2007
  • In this paper, we propose an efficient illumination preprocessing algorithm for face recognition. One of the best known illumination preprocessing method, based on anisotropic smoothing, enhances the edge information, but instead deteriorates the contrast of the original image. Our proposed method reduces the deterioration of the contrast while enhancing the edge information, and thus the preprocessed image does not lose features like Gabor features of the original images much.. The effectiveness of the proposed illumination preprocessing method is verified through experiments of face recognition.

  • PDF

Prediction of the price for stock index futures using integrated artificial intelligence techniques with categorical preprocessing

  • Kim, Kyoung-jae;Han, Ingoo
    • 한국경영과학회:학술대회논문집
    • /
    • 한국경영과학회 1997년도 추계학술대회발표논문집; 홍익대학교, 서울; 1 Nov. 1997
    • /
    • pp.105-108
    • /
    • 1997
  • Previous studies in stock market predictions using artificial intelligence techniques such as artificial neural networks and case-based reasoning, have focused mainly on spot market prediction. Korea launched trading in index futures market (KOSPI 200) on May 3, 1996, then more people became attracted to this market. Thus, this research intends to predict the daily up/down fluctuant direction of the price for KOSPI 200 index futures to meet this recent surge of interest. The forecasting methodologies employed in this research are the integration of genetic algorithm and artificial neural network (GAANN) and the integration of genetic algorithm and case-based reasoning (GACBR). Genetic algorithm was mainly used to select relevant input variables. This study adopts the categorical data preprocessing based on expert's knowledge as well as traditional data preprocessing. The experimental results of each forecasting method with each data preprocessing method are compared and statistically tested. Artificial neural network and case-based reasoning methods with best performance are integrated. Out-of-the Model Integration and In-Model Integration are presented as the integration methodology. The research outcomes are as follows; First, genetic algorithms are useful and effective method to select input variables for Al techniques. Second, the results of the experiment with categorical data preprocessing significantly outperform that with traditional data preprocessing in forecasting up/down fluctuant direction of index futures price. Third, the integration of genetic algorithm and case-based reasoning (GACBR) outperforms the integration of genetic algorithm and artificial neural network (GAANN). Forth, the integration of genetic algorithm, case-based reasoning and artificial neural network (GAANN-GACBR, GACBRNN and GANNCBR) provide worse results than GACBR.

  • PDF

대형선형계획문제의 사전처리 (Preprocessing in large scale linear programming problems)

  • 성명기;박순달
    • 한국경영과학회:학술대회논문집
    • /
    • 한국경영과학회 1996년도 추계학술대회발표논문집; 고려대학교, 서울; 26 Oct. 1996
    • /
    • pp.285-288
    • /
    • 1996
  • Generally MPS, standardized by IBM, is the input type of large scale linear programming problems, and there may be unnecessary variables or constraints. These can be discarded by preprocessing. As the size of a problem is reduced by preprocessing, the running time is reduced. And more, the infeasibility of a problem may be detected before using solution methods. When the preprocessing implemented by this paper is used in NETLIB problems, it removes unnecessary variables and constraints by 21%, 15%, respectively. The use of preprocessing gives in the average 21% reduction in running time by applying the interior point method. Preprocessing can detect 10 out of 30 infeasible NETLIB problems.

  • PDF

A Nonparametric Approach for Noisy Point Data Preprocessing

  • Xi, Yongjian;Duan, Ye;Zhao, Hongkai
    • International Journal of CAD/CAM
    • /
    • 제9권1호
    • /
    • pp.31-36
    • /
    • 2010
  • 3D point data acquired from laser scan or stereo vision can be quite noisy. A preprocessing step is often needed before a surface reconstruction algorithm can be applied. In this paper, we propose a nonparametric approach for noisy point data preprocessing. In particular, we proposed an anisotropic kernel based nonparametric density estimation method for outlier removal, and a hill-climbing line search approach for projecting data points onto the real surface boundary. Our approach is simple, robust and efficient. We demonstrate our method on both real and synthetic point datasets.