• Title/Summary/Keyword: Preprocess Data

Search Result 64, Processing Time 0.028 seconds

USING MODIS DATA TO ESTIMATE THE SURFACE HEAT FLUXES OVER TAIWAN'S CHIAYI PLAIN

  • Ho, Han-Chieh;Liou, Yuei-An;Wang, Chuan-Sheng
    • Proceedings of the KSRS Conference
    • /
    • 2008.10a
    • /
    • pp.317-319
    • /
    • 2008
  • Traditionally, it is measured by using basin or empirical formula with meteorology data, while it does not represent the evaportransporation over a regional area. With the advent of improved remote sensing technology, it becomes feasible to assess the ET over a regional scale. Firstly, the IMAGINE ATCOR atmospheric module is used to preprocess for the MODIS imagery. Then MODIS satellite images which have been corrected by radiation and geometry in conjunction with the in-situ surface meteorological measurement are used to estimate the surface heat fluxes such as soil heat flux, sensible heat flux, and latent heat flux. In addition, the correlation coefficient between the derived latent heat and the in-situ measurement is found to be over 0.76. In the future, we will continue to monitor the surface heat fluxes of paddy rice field in Chiayi area.

  • PDF

Performance Evaluation of Concrete Drying Shrinkage Prediction Using DNN and LSTM (DNN과 LSTM을 활용한 콘크리트의 건조수축량 예측성능 평가)

  • Han, Jun-Hui;Lim, Gun-Su;Lee, Hyeon-Jik;Park, Jae-Woong;Kim, Jong;Han, Min-Cheol
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2023.05a
    • /
    • pp.179-180
    • /
    • 2023
  • In this study, the performance of the prediction model was compared and analyzed using DNN and LSTM learning models to predict the amount of dry shrinkage of the concrete. As a result of the analysis, DNN model had a high error rate of about 51%, indicating overfitting to the training data. But, the LSTM learning model showed a relatively higher accuracy with an error rate of 12% compared to the DNN model. Also, the Pre_LSTM model which preprocess data, showed the performance with an error rate of 9% and a coefficient of determination of 0.887 in the LSTM learning model.

  • PDF

Estimation of Collapse Moment for Wall Thinned Elbows Using Fuzzy Neural Networks

  • Na, Man-Gyun;Kim, Jin-Weon;Shin, Sun-Ho;Kim, Koung-Suk;Kang, Ki-Soo
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.24 no.4
    • /
    • pp.362-370
    • /
    • 2004
  • In this work, the collapse moment due to wall-thinning defects is estimated by using fuzzy neural networks. The developed fuzzy neural networks have been applied to the numerical data obtained from the finite element analysis. Principal component analysis is used to preprocess the input signals into the fuzzy neural network to reduce the sensitivity to the input change and the fuzzy neural networks are trained by using the data set prepared for training (training data) and verified by using another data set different (independent) from the training data. Also, two fuzzy neural networks are trained for two data sets divided into the two classes of extrados and intrados defects, which is because they have different characteristics. The relative 2-sigma errors of the estimated collapse moment are 3.07% for the training data and 4.12% for the test data. It is known from this result that the fuzzy neural networks are sufficiently accurate to be used in the wall-thinning monitoring of elbows.

TLF: Two-level Filter for Querying Extreme Values in Sensor Networks

  • Meng, Min;Yang, Jie;Niu, Yu;Lee, Young-Koo;Jeong, Byeong-Soo;Lee, Sung-Young
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2007.05a
    • /
    • pp.870-872
    • /
    • 2007
  • Sensor networks have been widely applied for data collection. Due to the energy limitation of the sensor nodes and the most energy consuming data transmission, we should allocate as much work as possible to the sensors, such as data compression and aggregation, to reduce data transmission and save energy. Querying extreme values is a general query type in wireless sensor networks. In this paper, we propose a novel querying method called Two-Level Filter (TLF) for querying extreme values in wireless sensor networks. We first divide the whole sensor network into domains using the Distributed Data Aggregation Model (DDAM). The sensor nodes report their data to the cluster heads using push method. The advantages of two-level filter lie in two aspects. When querying extreme values, the number of pull operations has the lower boundary. And the query results are less affected by the topology changes of the wireless sensor network. Through this method, the sensors preprocess the data to share the burden of the base station and it combines push and pull to be more energy efficient.

  • PDF

Unsupervised Outpatients Clustering: A Case Study in Avissawella Base Hospital, Sri Lanka

  • Hoang, Huu-Trung;Pham, Quoc-Viet;Kim, Jung Eon;Kim, Hoon;Park, Junseok;Hwang, Won-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.4
    • /
    • pp.480-490
    • /
    • 2019
  • Nowadays, Electronic Medical Record (EMR) has just implemented at few hospitals for Outpatient Department (OPD). OPD is the diversified data, it includes demographic and diseases of patient, so it need to be clustered in order to explore the hidden rules and the relationship of data types of patient's information. In this paper, we propose a novel approach for unsupervised clustering of patient's demographic and diseases in OPD. Firstly, we collect data from a hospital at OPD. Then, we preprocess and transform data by using powerful techniques such as standardization, label encoder, and categorical encoder. After obtaining transformed data, we use some strong experiments, techniques, and evaluation to select the best number of clusters and best clustering algorithm. In addition, we use some tests and measurements to analyze and evaluate cluster tendency, models, and algorithms. Finally, we obtain the results to analyze and discover new knowledge, meanings, and rules. Clusters that are found out in this research provide knowledge to medical managers and doctors. From these information, they can improve the patient management methods, patient arrangement methods, and doctor's ability. In addition, it is a reference for medical data scientist to mine OPD dataset.

Quality Control of Two Dimensions Using Digital Image Processing and Neural Networks (디지털 영상처리와 신경망을 이용한 2차원 평면 물체 품질 제어)

  • Kim, Jin-Hwan;Seo, Bo-Hyeok;Park, Seong-Wook
    • Proceedings of the KIEE Conference
    • /
    • 2004.07d
    • /
    • pp.2580-2582
    • /
    • 2004
  • In this paper, a Neural Network(NN) based approach for classification of two dimensions images. The proposed algorithm is able to apply in the actual industry. The described diagnostic algorithm is presented to defect surface failures on tiles. A way to get data for a digital image process is several kinds of it. The tiles are scanned and the digital images are preprocessed and classified using neural networks. It is important to reduce the amount of input data with problem specific preprocessing. The auto-associative neural network is used for feature generation and selection while the probabilistic neural network is used for classification. The proposed algorithm is evaluated experimentally using one hundred of the real tile images. Sample image data to preprocess have histogram. The histogram is used as input value of probabilistic neural network. Auto-associative neural network compress input data and compressed data is classified using probabilistic neural network. Classified sample images are determined by human state. So it is intervened human subjectivity. But digital image processing and neural network are better than human classification ability. Therefore it is very useful of quality control improvement.

  • PDF

Research Trend Analysis for Sustainable QR code use - Focus on Big Data Analysis

  • Lee, Eunji;Jang, Jikyung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.9
    • /
    • pp.3221-3242
    • /
    • 2021
  • The purpose of the study is to examine the current study trend of 'QR code' and suggest a direction for the future study of big data analysis: (1) Background: study trend of 'QR code' and analysis of the text by subject field and year; (2) Methodology: data scraping and collection, EXCEL summary, and preprocess and big data analysis by R x 64 4.0.2 program package; (3) the findings: first, the trend showed a continuous increase in 'QR code' studies in general and the findings were applied in various fields. Second, the analysis of frequent keywords showed somewhat different results by subject field and year, but the overall results were similar. Third, the visualization of the frequent keywords also showed similar results as that of frequent keyword analysis; and (4) the conclusions: in general, 'QR code' studies are used in various fields, and the trend is likely to increase in the future as well. And the findings of this study are a reflection that 'QR code' is an aspect of our social and cultural phenomena, so that it is necessary to think that 'QR code' is a tool and an application of information. An expansion of the scope of the analysis is expected to show us more meaningful indications on 'QR code' study trends and development potential.

Utilizing LiDAR Data to Vehicle Recognition on the Road (도로의 차량 인식을 위한 LiDAR 자료 적용연구)

  • Choi, Yun-Woong;Lee, Geun-Sang;Cho, Gi-Sung
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.10 no.4
    • /
    • pp.179-188
    • /
    • 2007
  • Vehicle recognition is very important preprocess to get vehicle information for traffic management. This is a basic study to apply LiDAR data for extracting traffic information. Hence, this study presents two algorithms, one of them is for extracting road points from LiDAR data and then extracting vehicle points on the road, the other is for estimating the size of extracted vehicle. As a result, in the wide area, the number of vehicles on the road and the size of the vehicles were recognized from the LiDAR data.

  • PDF

[Retracted]Design and Implementation of Optimized Profile through analysis of Navigation Data Analysis of Unmanned Aerial Vehicle ([논문철회]무인비행기의 항행 데이터 분석을 통한 최적화된 프로파일 설계 및 구현)

  • Lee, Won Jin
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.2
    • /
    • pp.237-246
    • /
    • 2022
  • Among the technologies of the 4th industrial revolution, drones that have grown rapidly and are being used in various industries can be operated by the pilot directly or can be operated automatically through programming. In order to be controlled by a pilot or to operate automatically, it is essential to predict and analyze the optimal path for the drone to move without obstacles. In this paper, after securing and analyzing the pilot training dataset through the unmanned aerial vehicle piloting training platform designed through prior research, the profile of the dataset that should be preceded to search and derive the optimal route of the unmanned aerial vehicle was designed. The drone pilot training data includes the speed, movement distance, and angle of the drone, and the data set is visualized to unify the properties showing the same pattern into one and preprocess the properties showing the outliers. It is expected that the proposed big data-based profile can be used to predict and analyze the optimal movement path of an unmanned aerial vehicle.

Development of Intelligent Robot Process Automation Tool (지능형 업무 자동화(RPA) 도구 개발)

  • Kim, Ki-Tae;Park, Mi-Ran;Kim, Tae-Young;Bae, Seo-Hyun;Lee, Se-Hoon
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.07a
    • /
    • pp.433-434
    • /
    • 2021
  • 본 논문에서는 RPA 도구 개발 과정 중 자동화 및 데이터 전처리 기능을 이용한 양질의 데이터 추출 과정을 기술한다. 개발된 RPA 도구에서는 녹화 기능으로 자동화 기능을 향상시켰으며, 비대칭 데이터 변환 기능과 이상치 처리 기능을 통해 업무 생산효율 증가 및 휴먼에러 방지를 제공한다.

  • PDF