• Title/Summary/Keyword: preprocessing

Search Result 2,096, Processing Time 0.027 seconds

Image Classification Model using web crawling and transfer learning (웹 크롤링과 전이학습을 활용한 이미지 분류 모델)

  • Lee, JuHyeok;Kim, Mi Hui
    • Journal of IKEEE
    • /
    • v.26 no.4
    • /
    • pp.639-646
    • /
    • 2022
  • In this paper, to solve the large dataset problem, we collect images through an image collection method called web crawling and build datasets for use in image classification models through a data preprocessing process. We also propose a lightweight model that can automatically classify images by adding category values by incorporating transfer learning into the image classification model and an image classification model that reduces training time and achieves high accuracy.

Identifying research trends in the emergency medical technician field using topic modeling (토픽모델링을 활용한 응급구조사 관련 연구동향)

  • Lee, Jung Eun;Kim, Moo-Hyun
    • The Korean Journal of Emergency Medical Services
    • /
    • v.26 no.2
    • /
    • pp.19-35
    • /
    • 2022
  • Purpose: This study aimed to identify research topics in the emergency medical technician (EMT) field and examine research trends. Methods: In this study, 261 research papers published between January 2000 and May 2022 were collected, and EMT research topics and trends were analyzed using topic modeling techniques. This study used a text mining technique and was conducted using data collection flow, keyword preprocessing, and analysis. Keyword preprocessing and data analysis were done with the RStudio Version 4.0.0 program. Results: Keywords were derived through topic modeling analysis, and eight topics were ultimately identified: patient treatment, various roles, the performance of duties, cardiopulmonary resuscitation, triage systems, job stress, disaster management, and education programs. Conclusion: Based on the research results, it is believed that a study on the development and application of education programs that can successfully increase the emergency care capabilities of EMTs is needed.

Faculty Number Guidance Chat-Bot System Based on Data Preprocessing and Natural Language Processing (데이터 전처리와 자연어처리를 기반으로 한 교직원 번호안내 챗봇 시스템)

  • Hur, Tai-Sung;Baek, Jae-Won
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.07a
    • /
    • pp.243-244
    • /
    • 2021
  • 대학교에 민원, 문의 등 업무용 전화가 많이 오가는 상황에서 사용자가 원하는 부서, 교직원의 전화번호를 알아내기 위해 직접 검색하는 과정에 대한 솔루션을 제공하기 위해 본 논문에서는 대학 교직원들의 전화번호와 부서의 정보를 저장하고 있는 CSV 파일을 챗봇 시스템에서 요구하는 모양과 특성에 맞게 데이터를 가공하고 알맞은 정보를 제공하기 위해 사용자의 질의 문장을 해체 분석하여 필요 정보에 대하여 답변을 해주는 대학 교직원 번호 안내 챗봇 시스템을 개발하였다.

  • PDF

A Study on the Energy Data Preprocessing Process for Industrial Complex Microgrid Thermal Energy Trading Platform (산업단지 마이크로그리드 열거래 플랫폼을 위한 에너지 데이터 전처리 프로세스에 관한 연구)

  • Lim, Jeongtaek;Kim, Taehyoung;Ham, Kyung Sun
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2020.07a
    • /
    • pp.355-357
    • /
    • 2020
  • 최근 에너지 효율의 중요성이 높아지고 에너지 공급 형태가 다변화하면서 다양한 에너지원을 효율적으로 관리할 수 있는 마이크로그리드 개념이 중요해지고 있다. 본 연구의 산업단지 마이크로그리드 열거래 플랫폼은 실증사이트의 전기 및 열에너지 모니터링 기능과 열에너지 거래 정산 기능을 가지며, 이를 위해 정확하고 안정적인 실증사이트 데이터가 필요하다. 하지만 실증사이트 데이터는 에너지 단위의 불일치, 센서 및 현장 운영상태에 따른 불안정성 등의 문제가 있어 수집 직후 열거래 플랫폼에서 활용할 수 없다. 따라서 수집된 데이터를 활용하기 위해 엔진 최대 출력량, 최대 전력 사용량 등의 변수별 특성을 고려하여 데이터 전처리 프로세스를 설계 및 적용하였다.

  • PDF

A CycleGAN-Based Image Preprocessing for Detailed Flame Detection (디테일한 화염 감지를 위한 CycleGAN 기반의 이미지 전처리 기법)

  • Subin Yu;Jong-Hyun Kim
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2023.07a
    • /
    • pp.573-574
    • /
    • 2023
  • 화염 영역 검출을 위해 이전 기법에서는 화재 이미지에서 연기제거 및 색상보정을 통해 이미지를 전처리하였다. 그러나 이 기법은 임계값에 영향을 많이 받고, 밝기채널을 이용하여 검출하기 때문에 밤에 일어난 화재 이미지에서는 평균이상의 퍼포먼스를 수행하지만, 주변이 밝은 대낮의 화재 이미지에서는 퍼포먼스가 줄어드는 문제가 있다. 이를 보완하고자 본 논문에서는 CycleGAN을 이용하여 낮 이미지를 밤 이미지로 바꾸어 이미지 전처리를 진행하는 기법을 제안함으로써 화염 감지의 정확도가 개선되었음을 실험을 통해 보여준다.

  • PDF

Forecasting Energy Consumption of Steel Industry Using Regression Model (회귀 모델을 활용한 철강 기업의 에너지 소비 예측)

  • Sung-Ho KANG;Hyun-Ki KIM
    • Journal of Korea Artificial Intelligence Association
    • /
    • v.1 no.2
    • /
    • pp.21-25
    • /
    • 2023
  • The purpose of this study was to compare the performance using multiple regression models to predict the energy consumption of steel industry. Specific independent variables were selected in consideration of correlation among various attributes such as CO2 concentration, NSM, Week Status, Day of week, and Load Type, and preprocessing was performed to solve the multicollinearity problem. In data preprocessing, we evaluated linear and nonlinear relationships between each attribute through correlation analysis. In particular, we decided to select variables with high correlation and include appropriate variables in the final model to prevent multicollinearity problems. Among the many regression models learned, Boosted Decision Tree Regression showed the best predictive performance. Ensemble learning in this model was able to effectively learn complex patterns while preventing overfitting by combining multiple decision trees. Consequently, these predictive models are expected to provide important information for improving energy efficiency and management decision-making at steel industry. In the future, we plan to improve the performance of the model by collecting more data and extending variables, and the application of the model considering interactions with external factors will also be considered.

Preprocessing and Calibration of Optical Diffuse Reflectance Signal for Estimation of Soil Physical and Chemical Properties in the Central USA (미국 중부 토양의 이화학적 특성 추정을 위한 광 확산 반사 신호 전처리 및 캘리브레이션)

  • La, Woo-Jung;Sudduth, Kenneth A.;Chung, Sun-Ok;Kim, Hak-Jin
    • Journal of Biosystems Engineering
    • /
    • v.33 no.6
    • /
    • pp.430-437
    • /
    • 2008
  • Optical diffuse reflectance sensing in visible and near-infrared wavelength ranges is one approach to rapidly quantify soil properties for site-specific management. The objectives of this study were to investigate effects of preprocessing of reflectance data and determine the accuracy of the reflectance approach for estimating physical and chemical properties of selected Missouri and Illinois, USA surface soils encompassing a wide range of soil types and textures. Diffuse reflectance spectra of air-dried, sieved samples were obtained in the laboratory. Calibrations relating spectra to soil properties determined by standard methods were developed using partial least squares (PLS) regression. The best data preprocessing, consisting of absorbance transformation and mean centering, reduced estimation errors by up to 20% compared to raw reflectance data. Good estimates ($R^2=0.83$ to 0.92) were obtained using spectral data for soil texture fractions, organic matter, and CEC. Estimates of pH, P, and K were not good ($R^2$ < 0.7), and other approaches to estimating these soil chemical properties should be investigated. Overall, the ability of diffuse reflectance spectroscopy to accurately estimate multiple soil properties across a wide range of soils makes it a good candidate technology for providing at least a portion of the data needed in site-specific management of agriculture.

Sign Language recognition Using Sequential Ram-based Cumulative Neural Networks (순차 램 기반 누적 신경망을 이용한 수화 인식)

  • Lee, Dong-Hyung;Kang, Man-Mo;Kim, Young-Kee;Lee, Soo-Dong
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.9 no.5
    • /
    • pp.205-211
    • /
    • 2009
  • The Weightless Neural Network(WNN) has the advantage of the processing speed, less computability than weighted neural network which readjusts the weight. Especially, The behavior information such as sequential gesture has many serial correlation. So, It is required the high computability and processing time to recognize. To solve these problem, Many algorithms used that added preprocessing and hardware interface device to reduce the computability and speed. In this paper, we proposed the Ram based Sequential Cumulative Neural Network(SCNN) model which is sign language recognition system without preprocessing and hardware interface. We experimented with using compound words in continuous korean sign language which was input binary image with edge detection from camera. The recognition system of sign language without preprocessing got 93% recognition rate.

  • PDF

A Preprocessing Scheme of Thinning Capable of Lines' Thickness Recognition for the Automated Vectorizing of Maps (도면 자동 벡터화를 위한 선의 굵기 인식이 가능한 세선화의 전처리 기법)

  • Jeon, Ilsoo;Won, Namsik;Bu, Kidong
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.2 no.2
    • /
    • pp.1-8
    • /
    • 1999
  • Information representing the thickness of the original lines from the thinning results can be used efficiently in order to implement the automated vectorizing system. This paper proposes a preprocessing scheme of thinning which can show the information of the original lines' thickness from the thinning result. In the proposed scheme, the depth of each pixel constructing the lines was calculated, which was represented by the number of layers composed of neighboring pixels surrounding the original pixel. And then the original lines' thickness could be recognized through the depth information of the skeleton from the thinning results. We implemented the proposed scheme and experimented on a contour map. Using the depth information of the skeleton, we could easily distinguish each line of the contour either an intermediate or an index contour.

  • PDF