• 제목/요약/키워드: Data Preprocessing

검색결과 967건 처리시간 0.026초

A multi-modal neural network using Chebyschev polynomials

  • Ikuo Yoshihara;Tomoyuki Nakagawa;Moritoshi Yasunaga;Abe, Ken-ichi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1998년도 제13차 학술회의논문집
    • /
    • pp.250-253
    • /
    • 1998
  • This paper presents a multi-modal neural network composed of a preprocessing module and a multi-layer neural network module in order to enhance the nonlinear characteristics of neural network. The former module is based on spectral method using Chebyschev polynomials and transforms input data into spectra. The latter module identifies the system using the spectra generated by the preprocessing module. The omnibus numerical experiments show that the method is applicable to many a nonlinear dynamic system in the real world, and that preprocessing using Chebyschev polynomials reduces the number of neurons required for the multi-layer neural network.

  • PDF

전문가 시스템 접근법을 이용한 기계가공용 셋업계획 (Setup Planning for Machining processes Using Expert System Approach)

  • 정영득
    • 산업공학
    • /
    • 제6권1호
    • /
    • pp.31-45
    • /
    • 1993
  • Setup planning for machining processes is a part of fixture planning which is also a part of process planning. A setup of a part is defined as a group of features which are machined while the part is fixtured in one single fixture. Setup planning includes a number of tasks such as the selection of setup, sequence of setups and datum frame for each setup. Setup planning is an important function in fixture planning which must be able to support and to clamp a workpiece to prevent deflections caused by machining and clamping loads. This paper presents setup planning system using expert system approach(SPES) for prismatic parts which can be machined on vertical milling machine. SPES consists of preprocessing module and main processing module. Preprocessing module executes the conversion of feature data to frame type data and the determination of setups, and main processing module executes the determination of datum frame of each setup and sequance of setups. Preprocessing module is coded by C language and main processing module is a rule-based expert system using EXSYS pro. The performance of SPES is evaluated through case studies and the results show successful work except for operation sequence of machining holes. This is due to the limited rules for machining holes.

  • PDF

A Regularity-Based Preprocessing Method for Collaborative Recommender Systems

  • Toledo, Raciel Yera;Mota, Yaile Caballero;Borroto, Milton Garcia
    • Journal of Information Processing Systems
    • /
    • 제9권3호
    • /
    • pp.435-460
    • /
    • 2013
  • Recommender systems are popular applications that help users to identify items that they could be interested in. A recent research area on recommender systems focuses on detecting several kinds of inconsistencies associated with the user preferences. However, the majority of previous works in this direction just process anomalies that are intentionally introduced by users. In contrast, this paper is centered on finding the way to remove non-malicious anomalies, specifically in collaborative filtering systems. A review of the state-of-the-art in this field shows that no previous work has been carried out for recommendation systems and general data mining scenarios, to exactly perform this preprocessing task. More specifically, in this paper we propose a method that is based on the extraction of knowledge from the dataset in the form of rating regularities (similar to frequent patterns), and their use in order to remove anomalous preferences provided by users. Experiments show that the application of the procedure as a preprocessing step improves the performance of a data-mining task associated with the recommendation and also effectively detects the anomalous preferences.

이미지-텍스트 쌍을 활용한 이미지 분류 정확도 향상에 관한 연구 (A Study on Improvement of Image Classification Accuracy Using Image-Text Pairs)

  • 김미희;이주혁
    • 전기전자학회논문지
    • /
    • 제27권4호
    • /
    • pp.561-566
    • /
    • 2023
  • 딥러닝의 발전으로 다양한 컴퓨터 비전 연구를 수행할 수 있게 됐다. 딥러닝은 컴퓨터 비전 연구 중 이미지 처리에서 높은 정확도와 성능을 보여줬다. 하지만 대부분의 이미지 처리 방식은 이미지의 시각 정보만을 이용해 이미지를 처리하는 경우가 대부분이다. 이미지-텍스트 쌍을 활용할 경우 이미지와 관련된 설명, 주석 등의 텍스트 데이터가 이미지 자체에서는 얻기 힘든 추가적인 맥락과 시각 정보를 제공할 수 있다. 본 논문에서는 이미지-텍스트 쌍을 활용하여 이미지와 텍스트를 분석하는 딥러닝 모델 제안한다. 제안 모델은 이미지 정보만을 사용한 딥러닝 모델보다 약 11% 향상된 분류 정확도 결과를 보였다.

Recognition of Car Manufacturers using Faster R-CNN and Perspective Transformation

  • Ansari, Israfil;Lee, Yeunghak;Jeong, Yunju;Shim, Jaechang
    • 한국멀티미디어학회논문지
    • /
    • 제21권8호
    • /
    • pp.888-896
    • /
    • 2018
  • In this paper, we report detection and recognition of vehicle logo from images captured from street CCTV. Image data includes both the front and rear view of the vehicles. The proposed method is a two-step process which combines image preprocessing and faster region-based convolutional neural network (R-CNN) for logo recognition. Without preprocessing, faster R-CNN accuracy is high only if the image quality is good. The proposed system is focusing on street CCTV camera where image quality is different from a front facing camera. Using perspective transformation the top view images are transformed into front view images. In this system, the detection and accuracy are much higher as compared to the existing algorithm. As a result of the experiment, on day data the detection and recognition rate is improved by 2% and night data, detection rate improved by 14%.

$\rho$-Version 유한요소 프로그램을 위한 자동절점생성 알고리즘 및 전처리 기법 개발 (Development of Automatic Node Generation Algorithm and Preprocessing Technique for $\rho$-Version Finite Element Program)

  • 조준형;홍종현;우광성
    • 한국전산구조공학회:학술대회논문집
    • /
    • 한국전산구조공학회 1998년도 가을 학술발표회 논문집
    • /
    • pp.69-76
    • /
    • 1998
  • Due to the drastic improvement of computer hardware and operating system, it is easy to break through the main defects of limited computer memory and processing time, etc. To keep up with this situation, this paper is focused on developing the preprocessor program with the input method based on vector graphic editor and the preprocessing technique including automatic node generation algorithm for the $\rho$-version finite element program. To develop this preprocessor program, the special data structure and the OOP(Object Oriented Programming) have been used by the Visual Basic 4.0. The Special data structure is proposed to describe the geometric data of node numberings and coordinates suitable for the $\rho$-version finite element program, which are quite different from the comvential h-version finite element program.

  • PDF

데이터 전처리기법을 적용한 신경망 알고리즘의 냉방기 부분고장 검출 (Partial Fault Detection of Air-conditioning System by Neural Network Algorithm using Data Preprocessing Method)

  • 한도영;이한홍;윤태훈
    • 설비공학논문집
    • /
    • 제14권7호
    • /
    • pp.560-566
    • /
    • 2002
  • The fault detection and diagnosis technology may be applied in order to decrease the energy consumption and the maintenance cost of the air-conditioning system. In this study, two different types of faults in the air-conditioning system, such as the condenser fouling and the evaporator fan slowdown, were considered. The neural network algorithm combined with data preprocessor was developed and applied to detect the faults of the real system. Test results show that this method is very effective to detect the faults in the air-conditioning system. Therefore, this developed method can be used for the development of the air-conditioner fault detection system.

SMD Detection and Classification Using YOLO Network Based on Robust Data Preprocessing and Augmentation Techniques

  • NDAYISHIMIYE, Fabrice;Lee, Joon Jae
    • Journal of Multimedia Information System
    • /
    • 제8권4호
    • /
    • pp.211-220
    • /
    • 2021
  • The process of inspecting SMDs on the PCB boards improves the product quality, performance and reduces frequent issues in this field. However, undesirable scenarios such as assembly failure and device breakdown can occur sometime during the assembly process and result in costly losses and time-consuming. The detection of these components with a model based on deep learning may be effective to reduce some errors during the inspection in the manufacturing process. In this paper, YOLO models were used due to their high speed and good accuracy in classification and target detection. A SMD detection and classification method using YOLO networks based on robust data preprocessing and augmentation techniques to deal with various types of variation such as illumination and geometric changes is proposed. For 9 different components of data provided from a PCB manufacturer company, the experiment results show that YOLOv4 is better with fast detection and classification than YOLOv3.

회귀 모델을 활용한 철강 기업의 에너지 소비 예측 (Forecasting Energy Consumption of Steel Industry Using Regression Model)

  • Sung-Ho KANG;Hyun-Ki KIM
    • Journal of Korea Artificial Intelligence Association
    • /
    • 제1권2호
    • /
    • pp.21-25
    • /
    • 2023
  • The purpose of this study was to compare the performance using multiple regression models to predict the energy consumption of steel industry. Specific independent variables were selected in consideration of correlation among various attributes such as CO2 concentration, NSM, Week Status, Day of week, and Load Type, and preprocessing was performed to solve the multicollinearity problem. In data preprocessing, we evaluated linear and nonlinear relationships between each attribute through correlation analysis. In particular, we decided to select variables with high correlation and include appropriate variables in the final model to prevent multicollinearity problems. Among the many regression models learned, Boosted Decision Tree Regression showed the best predictive performance. Ensemble learning in this model was able to effectively learn complex patterns while preventing overfitting by combining multiple decision trees. Consequently, these predictive models are expected to provide important information for improving energy efficiency and management decision-making at steel industry. In the future, we plan to improve the performance of the model by collecting more data and extending variables, and the application of the model considering interactions with external factors will also be considered.

A Filter Lining Scheme for Efficient Skyline Computation

  • Kim, Ji-Hyun;Kim, Myung
    • 한국멀티미디어학회논문지
    • /
    • 제14권12호
    • /
    • pp.1591-1600
    • /
    • 2011
  • The skyline of a multidimensional data set is the maximal subset whose elements are not dominated by other elements of the set. Skyline computation is considered to be very useful for a decision making system that deals with multidimensional data analyses. Recently, a great deal of interests has been shown to improve the performance of skyline computation algorithms. In order to speedup, the number of comparisons between data elements should be reduced. In this paper, we propose a filter lining scheme to accomplish such objectives. The scheme divides the multidimensional data space into angle-based partitions, and places a filter for each partition, and then connects them together in order to establish the final filter line. The filter line can be used to eliminate data, that are not part of the skyline, from the original data set in the preprocessing stage. The filter line is adaptively improved during the data scanning stage. In addition, skylines are computed for each remaining data partition, and are then merged to form the final skyline. Our scheme is an improvement of the previously reported simple preprocessing scheme using simple filters. The performance of the scheme is shown by experiments.