Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Filtering Correction Method and Performance Comparison for Time Series Data

  • Baek, Jongwoo (Department of Computer Engineering, PaiChai University) ;
  • Choi, Jiyoung (Department of Computer Engineering, PaiChai University) ;
  • Jung, Hoekyung (Department of Computer Engineering, PaiChai University)
  • Received : 2021.07.21
  • Accepted : 2021.08.09
  • Published : 2022.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In modern society, as many data are used for research or commercial purposes, the value of data is gradually increasing. In related fields, research is being actively conducted to collect valuable data, but it is difficult to collect proper data because the value of collection is determined according to the performance of existing sensors. To solve this problem, a method to effectively reduce noise has been proposed, but there is a point in which performance is degraded due to damage caused by noise. In this paper, a device capable of collecting time series data was designed to correct such data noise, and a correction technique was performed by giving an error value based on the representatively collected ultrafine dust data, and then comparing before and after Compare performance. For the correction method, Kalman, LPF, Savitzky-Golay, and Moving Average filter were used. Savitzky-Golay filter and Moving Average Filter showed excellent correction rate as an experiment. Through this, the performance of the sensor can be supplemented and it is expected that data can be effectively collected.

Keywords

Acknowledgement

This work was supported by the PaiChai University research grantin 2022.

References

  1. J. W. Lee, G. Wu, and H. Jung, "Deep learning document analysis system based on keyword frequency and section centrality analysis," Journal of Information and Communication Convergence Engineering, vol. 19, no. 1, pp. 48-53, Mar. 2021. DOI: 10.6109/jicce.2021.19.1.48.
  2. C. H. Hwang, H. Kim, and H. Jung, "Detection and correction method of erroneous data using quantile pattern and LSTM," Journal of information and communication convergence engineering, vol. 16, no. 4, pp. 242-247, Dec. 2018. DOI: 10.6109/jicce.2018.16.4.242.
  3. B. Lim, H. Lim, S. Hong, and H. Jung, "Air pollution monitoring based on Bonferroni Multi-analysis," Journal of the Korea Institute of Information and Communication Engineering, vol. 24, no. 8, pp. 963-969, Aug. 2020. DOI: 10.6109/jkiice.2020.24.8.963.
  4. S. W. Byeon and S. -Y. Kim, "Has air pollution concentration increased over the past 17 years in Seoul, South Korea? : The gap between public perception and measurement data," Journal of Korean Society for Atmospheric Environment, vol. 36, no. 2, pp. 240-248, Apr. 2020. DOI: http://doi.org/10.5572/KOSAE.2020.36.2.240.
  5. C. -J. Lee, M. -S. Hong, "Spatiotemporal variations of fine particulates in and around the Korean Peninsula," Journal of Korean Society for Atmospheric Environment, vol. 35, no. 6, pp. 675-682, Dec. 2019. DOI: 10.5572/KOSAE.2019.35.6.675.
  6. S. Lee, S. Park, and H. Jung, "Web monitoring based encryption web traffic attack detection system," Journal of the Korea Institute of Information and Communication Engineering, vol. 25, no. 3, pp. 449-455, Mar. 2021. DOI: 10.6109/jkiice.2021.25.3.449.
  7. A. Chowdhury, O. Frieder, D. Grossman, and M. C. McCabe, "Collection statistics for fast duplicate document detection," ACM Transactions on Information Systems, vol. 20, no. 2, pp. 171-191, Apr. 2002. DOI: 10.1145/506309.506311.
  8. J. -Y. Choi, "A study on a effective information compressor algorithm for the variable environment variation using the Kalman Filter," Journal of the Korean Society Of Computer And Information, vol. 23, no. 4, pp. 65-70. Apr. 2018. DOI: 10.9708/jksci.2018.23.04.065.
  9. J. Bang, D. Hwang, and H. Jung, "Product recommendation system based on user purchase priority," Journal of Information and Communication Convergence Engineering, vol. 18, no. 1, pp. 55-60, Mar. 2020. DOI: 10.6109/jicce.2020.18.1.55.