Browse > Article
http://dx.doi.org/10.6109/jicce.2022.20.2.125

Filtering Correction Method and Performance Comparison for Time Series Data  

Baek, Jongwoo (Department of Computer Engineering, PaiChai University)
Choi, Jiyoung (Department of Computer Engineering, PaiChai University)
Jung, Hoekyung (Department of Computer Engineering, PaiChai University)
Abstract
In modern society, as many data are used for research or commercial purposes, the value of data is gradually increasing. In related fields, research is being actively conducted to collect valuable data, but it is difficult to collect proper data because the value of collection is determined according to the performance of existing sensors. To solve this problem, a method to effectively reduce noise has been proposed, but there is a point in which performance is degraded due to damage caused by noise. In this paper, a device capable of collecting time series data was designed to correct such data noise, and a correction technique was performed by giving an error value based on the representatively collected ultrafine dust data, and then comparing before and after Compare performance. For the correction method, Kalman, LPF, Savitzky-Golay, and Moving Average filter were used. Savitzky-Golay filter and Moving Average Filter showed excellent correction rate as an experiment. Through this, the performance of the sensor can be supplemented and it is expected that data can be effectively collected.
Keywords
Acquisition; Correction; Comparative analysis; Noise; Time series data;
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 C. H. Hwang, H. Kim, and H. Jung, "Detection and correction method of erroneous data using quantile pattern and LSTM," Journal of information and communication convergence engineering, vol. 16, no. 4, pp. 242-247, Dec. 2018. DOI: 10.6109/jicce.2018.16.4.242.   DOI
2 B. Lim, H. Lim, S. Hong, and H. Jung, "Air pollution monitoring based on Bonferroni Multi-analysis," Journal of the Korea Institute of Information and Communication Engineering, vol. 24, no. 8, pp. 963-969, Aug. 2020. DOI: 10.6109/jkiice.2020.24.8.963.   DOI
3 A. Chowdhury, O. Frieder, D. Grossman, and M. C. McCabe, "Collection statistics for fast duplicate document detection," ACM Transactions on Information Systems, vol. 20, no. 2, pp. 171-191, Apr. 2002. DOI: 10.1145/506309.506311.   DOI
4 S. Lee, S. Park, and H. Jung, "Web monitoring based encryption web traffic attack detection system," Journal of the Korea Institute of Information and Communication Engineering, vol. 25, no. 3, pp. 449-455, Mar. 2021. DOI: 10.6109/jkiice.2021.25.3.449.   DOI
5 J. W. Lee, G. Wu, and H. Jung, "Deep learning document analysis system based on keyword frequency and section centrality analysis," Journal of Information and Communication Convergence Engineering, vol. 19, no. 1, pp. 48-53, Mar. 2021. DOI: 10.6109/jicce.2021.19.1.48.   DOI
6 S. W. Byeon and S. -Y. Kim, "Has air pollution concentration increased over the past 17 years in Seoul, South Korea? : The gap between public perception and measurement data," Journal of Korean Society for Atmospheric Environment, vol. 36, no. 2, pp. 240-248, Apr. 2020. DOI: http://doi.org/10.5572/KOSAE.2020.36.2.240.   DOI
7 C. -J. Lee, M. -S. Hong, "Spatiotemporal variations of fine particulates in and around the Korean Peninsula," Journal of Korean Society for Atmospheric Environment, vol. 35, no. 6, pp. 675-682, Dec. 2019. DOI: 10.5572/KOSAE.2019.35.6.675.   DOI
8 J. -Y. Choi, "A study on a effective information compressor algorithm for the variable environment variation using the Kalman Filter," Journal of the Korean Society Of Computer And Information, vol. 23, no. 4, pp. 65-70. Apr. 2018. DOI: 10.9708/jksci.2018.23.04.065.   DOI
9 J. Bang, D. Hwang, and H. Jung, "Product recommendation system based on user purchase priority," Journal of Information and Communication Convergence Engineering, vol. 18, no. 1, pp. 55-60, Mar. 2020. DOI: 10.6109/jicce.2020.18.1.55.   DOI