Browse > Article
http://dx.doi.org/10.4217/OPR.2021.43.4.229

Evaluation of International Quality Control Procedures for Detecting Outliers in Water Temperature Time-series at Ieodo Ocean Research Station  

Min, Yongchim (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Jun, Hyunjung (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Jeong, Jin-Yong (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Park, Sung-Hwan (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Lee, Jaeik (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Jeong, Jeongmin (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Min, Inki (Marine Disaster Research Center, Korea Institute of Ocean Science & Technology)
Kim, Yong Sun (Ocean Circulation Research Center, Korea Institute of Ocean Science & Technology)
Publication Information
Ocean and Polar Research / v.43, no.4, 2021 , pp. 229-243 More about this Journal
Abstract
Quality control (QC) to process observed time series has become more critical as the types and amount of observed data have increased along with the development of ocean observing sensors and communication technology. International ocean observing institutions have developed and operated automatic QC procedures for these observed time series. In this study, the performance of automated QC procedures proposed by U.S. IOOS (Integrated Ocean Observing System), NDBC (National Data Buy Center), and OOI (Ocean Observatory Initiative) were evaluated for observed time-series particularly from the Yellow and East China Seas by taking advantage of a confusion matrix. We focused on detecting additive outliers (AO) and temporary change outliers (TCO) based on ocean temperature observation from the Ieodo Ocean Research Station (I-ORS) in 2013. Our results present that the IOOS variability check procedure tends to classify normal data as AO or TCO. The NDBC variability check tracks outliers well but also tends to classify a lot of normal data as abnormal, particularly in the case of rapidly fluctuating time-series. The OOI procedure seems to detect the AO and TCO most effectively and the rate of classifying normal data as abnormal is also the lowest among the international checks. However, all three checks need additional scrutiny because they often fail to classify outliers when intermittent observations are performed or as a result of systematic errors, as well as tending to classify normal data as outliers in the case where there is abrupt change in the observed data due to a sensor being located within a sharp boundary between two water masses, which is a common feature in shallow water observations. Therefore, this study underlines the necessity of developing a new QC algorithm for time-series occurring in a shallow sea.
Keywords
Korea Ocean Research Stations (KORS); U.S. IOOS; NDBC; OOI; outliers;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Ha K-J, Nam S, Jeong J-Y, Moon I-J, Lee M, Yun J, Jang CJ, Kim YS, Byun D-S, Heo K-Y, Shim J-S (2019) Observations utilizing Korea ocean research stations and their applications for process studies. B Am Meteorol Soc 100(10):2061-2075. doi:10.1175/BAMS-D-18-0305.1   DOI
2 Hawkins DM (1980) Identification of outliers. Springer, Amsterdam, 188 p
3 IOOS (2014) Manual for real-time quality control of in-situ temperature and salinity data Version 1.0. Integrated Ocean Observing System, Silver Spring, 55 p
4 NDBC (2009) Handbook of automated data quality control checks and procedures. National Data Buoy Center, Mississippi, 78 p
5 OOI (2012a) Data product specification for gradient test, version 1-01. Consortium for Ocean Leadership. https://oceanobservatories.org/wp-content/uploads/2015/09/1341-10004_Data_Product_SPEC_GLBLRNG_OOI.pdf Accesssed 30 Sep 2019
6 OOI (2013) Protocols and procedures for OOI data products: QA, QC, calibration, physical samples, version 1-22. Consortium for Ocean Leadership, 1102-00300 https://oceanobservatories.org/wp-content/uploads/2015/09/1102-00300_Protocols_Procedures_Data_Products_QAQC_Cal_Physical_Samples_OOI Accessed 30 Sep 2019
7 OOI (2021) Automated QC Algorithms. https://github.com/ooici/ion-functions/tree/master/ion_functions/qcAccessed 1 Mar 2021
8 Chae J-H, Park M-S, Choi Y-J (2014) The WISE quality control system for integrated meteorological sensor data. Kor Meteorol Soc 24(3):445-456. doi:10.14191/Atmos.2014.24.3.445   DOI
9 Weller RA, Baker DJ, Glackin MM, Roberts SJ, Schmitt RW, Twigg ES and Vimont DJ (2019) The challenge of sustaining ocean observations. Front Mar Sci 6:105. doi:10.3389/fmars.2019.00105   DOI
10 WMO (2010) Guide to the global observing system, WMO-NO. 488. World Meteorological Organization. https://community.wmo.int/wmo-no-488-guide-global-observing-system Accesssed 1 Mar 2021
11 Lee J, Lee S, Jeong J, Min Y, Jeong J-Y, Kim YS ( 2021) Salinity drift prevention experiments in the Korea ocean research stations and suggestions for high quality salinity observation. J Coast Prev 8(4):323-333. doi:10.20481/kscdp.2021.8.4.323   DOI
12 KHOA (2019) A report on the improvement of the national ocean observation network to advance the ocean forecast decision-making system, Korea Hydrographic and Oceanographic Agency, Busan, 11-1192136-00507-01, 522 p
13 KMA (2019) Quality control of Meteorological Observations, KMA National Climate Data Center, 11-1360000-001637-01, Seoul, 62 p
14 Min Y, Jeong J-Y, Jang CJ, Lee J, Jeong J, Min I-K, Shim J-S, Kim YS (2020) Quality control of observed temperature time series from the Korea ocean research stations: preliminary application of ocean observation initiative's approach and its limitation. Ocean Polar Res 42(3):195-210. doi:10.4217/OPR.2020.42.3.195   DOI
15 Yoo J, Choo J (2019) A study on the test and visualization of change in structures associated with the occurrence of non-stationary of long-term time series data based on unit root test. KIPS Trans Soft Data Eng 8(7):289-302. doi:10.3745/KTSDE.2019.8.7.289   DOI
16 Lee SH (2015) Outlier detection and treatment using R. Freeacademi, Paju, 383p
17 OOI (2012b) Data product specification for spike test, version 1-01. Consortium for Ocean Leadership. https://oceanobservatories.org/wp-content/uploads/2015/09/1341-10006_Data_Product_SPEC_SPKETST_OOI.pdf Accesssed 30Sep 2019
18 Cho H-Y, Lee K-S, Ahn S-M (2016) Impact of outliers on the statistical measures of the environmental monitoring. Ocean Polar Res 38(2):149-159. doi:10.4217/OPR.2016.38.2.149   DOI
19 IOOS (2021) IOOS QC. https://github.com/ioos/qartod Accessed 1 Mar 2021
20 Kim YS, Jang CJ, Noh J-H, Kim K-T, Kown J-I, Min Y, Jeong J, Lee J, Min I-K, Shim J-S, Byun D-S, Jeong J-Y (2019) A Yellow Sea monitoring system and its scientific applications. Front Mar Sci 6:601. doi:10.3389/fmars.2019.00601   DOI
21 UNESCO (1993) Manual of quality control procedures for validation of oceanographic data. IOC, Paris, 25 p
22 Zhou Y, Qin R, Xu H, Sadiq S, Yu Y (2018) A data quality control method for seafloor observatories: the application of observed time series data in the East China Sea. Sensors 18(8):2628. doi:10.3390/s18082628   DOI