• Title/Summary/Keyword: Data Quality Check

Search Result 331, Processing Time 0.026 seconds

Development of a Quality Check Algorithm for the WISE Pulsed Doppler Wind Lidar (WISE 펄스 도플러 윈드라이다 품질관리 알고리즘 개발)

  • Park, Moon-Soo;Choi, Min-Hyeok
    • Atmosphere
    • /
    • v.26 no.3
    • /
    • pp.461-471
    • /
    • 2016
  • A quality check algorithm for the Weather Information Service Engine pulsed Doppler wind lidar is developed from a view point of spatial and temporal consistencies of observed wind speed. Threshold values for quality check are determined by statistical analysis on the standard deviation of 3-component of wind speed obtained by a wind lidar, and the vertical gradient of horizontal wind speed obtained by a radiosonde system. The algorithm includes carrier-to-noise ratio (CNR) check, data availability check, and vertical gradient of horizontal wind speed check. That is, data sets whose CNR is less than -29 dB, data availability is less than 90%, or vertical gradient of horizontal wind speed is less than $-0.028s^{-1}$ or larger than $0.032s^{-1}$ are classified as 'doubtful', and flagged. The developed quality check algorithm is applied to data obtained at Bucheon station for the period from 1 to 30 September 2015. It is found that the number of 'doubtful' data shows maxima around 2000 m high, but the ratio of 'doubtful' to height-total data increases with increasing height due to atmospheric boundary height, cloud, or rainfall, etc. It is also found that the quality check by data availability is more effective than those by carrier to noise ratio or vertical gradient of horizontal wind speed to remove an erroneous noise data.

Validation of Quality Control Algorithms for Temperature Data of the Republic of Korea (한국의 기온자료 품질관리 알고리즘의 검증)

  • Park, Changyong;Choi, Youngeun
    • Atmosphere
    • /
    • v.22 no.3
    • /
    • pp.299-307
    • /
    • 2012
  • This study is aimed to validate errors for detected suspicious temperature data using various quality control procedures for 61 weather stations in the Republic of Korea. The quality control algorithms for temperature data consist of four main procedures (high-low extreme check, internal consistency check, temporal outlier check, and spatial outlier check). Errors of detected suspicious temperature data are judged by examining temperature data of nearby stations, surface weather charts, hourly temperature data, daily precipitation, and daily maximum wind direction. The number of detected errors in internal consistency check and spatial outlier check showed 4 days (3 stations) and 7 days (5 stations), respectively. Effective and objective methods for validation errors through this study will help to reduce manpower and time for conduct of quality management for temperature data.

Development of Check-list for BIM Based Architectural Design Quality Check (BIM 기반 건축설계 품질검토를 위한 체크리스트 개발 연구)

  • Choi, Jungsik;Kim, Inhan
    • Korean Journal of Computational Design and Engineering
    • /
    • v.18 no.3
    • /
    • pp.177-188
    • /
    • 2013
  • The construction industry consists of various and massive architectural information as an architectural process includes a variety of design stages with cooperation of many disciplines. Particularly, architectural information is generated and managed through the life cycle of a building, from conceptual design stage to the construction and maintenance. A Building Information Model (BIM) serves as a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life-cycle from inception onward. BIM technology accomplished quantitative development being utilized in various disciplines. However, it is necessary to develop environment and requirement for qualitative improvement of BIM based project. Particularly, requirement is very important for architectural design evaluations. The purpose of this study is to develop and apply of quality control check-list for improving the quality of architectural design in BIM environments. To achieve this purpose, the authors have investigated case study for open BIM data quality control (software, guideline and application case) and classified quality control targets according to physical/logical quality control and data quality. In addition, the authors have defined open BIM based quality control process and developed quality control check-list. Finally, the authors have developed automatic quality check system using requirements for efficient quality control based on open BIM.

Development and Assessment of Real-Time Quality Control Algorithm for PM10 Data Observed by Continuous Ambient Particulate Monitor (부유분진측정기(PM10) 관측 자료 실시간 품질관리 알고리즘 개발 및 평가)

  • Kim, Sunyoung;Lee, Hee Choon;Ryoo, Sang-Boom
    • Atmosphere
    • /
    • v.26 no.4
    • /
    • pp.541-551
    • /
    • 2016
  • A real-time quality control algorithm for $PM_{10}$ concentration measured by Continuous Ambient Particulate Monitor (FH62C14, Thermo Fisher Scientific Inc.) has been developed. The quality control algorithm for $PM_{10}$ data consists of five main procedures. The first step is valid value check. The values should be within the acceptable range limit. Upper ($5,000{\mu}g\;m^{-3}$) and lower ($0{\mu}g\;m^{-3}$) values of instrument detectable limit have to be eliminated as being unrealistic. The second step is valid error check. Whenever unusual condition occurs, the instrument will save error code. Value having an error code is eliminated. The third step is persistence check. This step checks on a minimum required variability of data during a certain period. If the $PM_{10}$ data do not vary over the past 60 minutes by more than the specific limit ($0{\mu}g\;m^{-3}$) then the current 5-minute value fails the check. The fourth step is time continuity check, which is checked to eliminate gross outlier. The last step is spike check. The spikes in the time series are checked. The outlier detection is based on the double-difference time series, using the median. Flags indicating normal and abnormal are added to the raw data after quality control procedure. The quality control algorithm is applied to $PM_{10}$ data for Asian dust and non-Asian dust case at Seoul site and dataset for the period 2013~2014 at 26 sites in Korea.

Improvement and Evaluation of Automatic Quality Check Algorithm for Particulate Matter (PM10) by Analysis of Instrument Status Code (부유분진(PM10) 측정기 상태 코드 분석을 통한 자동 품질검사 알고리즘 개선 및 평가)

  • Kim, Mi-Gyeong;Park, Young-San;Ryoo, Sang-Boom;Cho, Jeong Hoon
    • Atmosphere
    • /
    • v.29 no.4
    • /
    • pp.501-509
    • /
    • 2019
  • Asian Dust is a meteorological phenomenon that sand particles are raised from the arid and semi-arid regions-Taklamakan Desert, Gobi Desert and Inner Mongolia in China-and transported by westerlies and deposited on the surface. Asian dust results in a negative effect on human health as well as environmental, social and economic aspects. For monitoring of Asian Dust, Korea Meteorological Administration operates 29 stations using a continuous ambient particulate monitor. Kim et al. (2016) developed an automatic quality check (AQC) algorithm for objective and systematic quality check of observed PM10 concentration and evaluated AQC with results of a manual quality check (MQC). The results showed the AQC algorithm could detect abnormal observations efficiently but it also presented a large number of false alarms which result from valid error check. To complement the deficiency of AQC and to develop an AQC system which can be applied in real-time, AQC has been modulated. Based on the analysis of instrument status codes, valid error check process was revised and 6 status codes were further considered as normal. Also, time continuity check and spike check were modified so that posterior data was not referred at inspection time. Two-year observed PM10 concentration data and corresponding MQC results were used to evaluate the modulated AQC compared to the original AQC algorithm. The results showed a false alarm ratio decreased from 0.44 to 0.09 and the accuracy and the probability of detection were conserved well in spite of the exclusion of posterior data at inspection time.

Proposal for application of spatial data and quality check criteria for estimating damage from storm and flood (풍수해 피해 추정을 위한 공간정보 DB의 활용방안 및 품질 점검 기준 제안)

  • Won, Seok-Hwan;Kim, Hyeon-Deok;Kim, Sang-Min
    • Journal of Cadastre & Land InformatiX
    • /
    • v.50 no.2
    • /
    • pp.81-100
    • /
    • 2020
  • The purpose of this study was to propose applicability of spatial data and quality check criteria for estimating damage from storm and flood. Using the data from the National Disaster Management System and National Spatial Data Infrastructure, spatial database for estimation of storm and flood damage has been mapped to each type of damage. This was proposed as the quality check criteria for damage analysis. Through this study, it is possible to utilize the spatial database for estimating storm and flood damage. The reliability of analysis results are ensured through the quality check criteria.

A Study on Methods of Quality Check for Digital Basemaps using Statistical Methods for the Quality Control (통계적 품질관리기법을 도입한 수치지도의 검수방법에 관한 연구)

  • 김병국;서현덕
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.17 no.1
    • /
    • pp.79-86
    • /
    • 1999
  • In this study, we investigated methods of quality check for digital basemaps and proposed effective methods of quality check. We used new statistical methods for quality control in order to carry out quality check for digital basemaps. We proposed 2-stage complete sampling and 2-stage cluster sampling method to improve present statistical methods of quality check(1-stage complete sampling method). We estimated error rate and number of omitted objects using simulated data about all delivered digital basemaps and estimated variances about it. We could determine confidence interval about error rate and number of omitted objects.

  • PDF

Data Quality Analysis of Korean GPS Reference Stations Using Comprehensive Quality Check Algorithm (종합적 품질평가 기법을 이용한 국내 GPS 상시관측소의 데이터 품질 분석)

  • Kim, Minchan;Lee, Jiyun
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.41 no.9
    • /
    • pp.689-699
    • /
    • 2013
  • During extreme ionospheric storms, anomalous ionospheric delays and gradients could cause potential integrity threats to users of GNSS (Global Navigation Satellite System) augmentation systems. GNSS augmentation ground facilities must monitor these ionospheric anomalies defined by a threat model and alarm the users of safely-of-life applications within time-to-alerts. Because the ionospheric anomaly threat model is developed using data collected from GNSS reference stations, the use of poor-quality data can degrade the performance of the threat model. As the total number of stations increases, the number of station with poor GNSS data quality also increases. This paper analyzes the quality of data collected from Korean GPS reference stations using comprehensive GNSS data quality check algorithms. The results show that the range of good and poor qualities varies noticeably for each quality parameter. Especially erroneous ionospheric delay and gradients estimates are produced due to poor quality data. The results obtained in this study should be a basis for determining GPS data quality criteria in the development of ionospheric threat models.

A study on the Development of BIM-based Quality Pre-checking System in Architecture Design Phase

  • Shin, Jihye;Choi, Jungsik;Kim, Inhan
    • International conference on construction engineering and project management
    • /
    • 2015.10a
    • /
    • pp.284-288
    • /
    • 2015
  • Recently, the mandate on utilizing BIM implemented by public institutions of many countries has great impact on the significantly increasing practices of BIM. The improvement of work efficiency and productivity, which is occurred by BIM adoption, depends on the consistency and accuracy of data. To maximize the benefit of BIM, the interests in BIM data quality have been enlarging all over the world. The BIM data quality pre-check, which is conducted by designer in the design phase, offers opportunities for quality improvement by continuously assessing BIM data. However, BIM quality pre-check is being conducted under arbitrary interpretation of users because of the absence of specific review factors and assessment methods for checking BIM quality. The purpose of this study is to establish an automated BIM quality pre-checking system to improve BIM design quality effectively and efficiently. It could be expected to meet the owner's requirements and to minimize the cost and time occurred additionally from revising and reproducing data by constructing consistency and accuracy of it.

  • PDF

Examining User Perception about Airline Untact Service Quality (항공사 비대면 서비스 품질에 대한 이용자 인식 연구)

  • Lee, Sojeong;An, Jaeyoung;Yun, Haejung
    • Journal of Korean Society for Quality Management
    • /
    • v.50 no.3
    • /
    • pp.545-570
    • /
    • 2022
  • Purpose: The purpose of this study was to explore dimensions to improve airline non-face-to-face(untact) service quality and identify shadow work dimensions in the digital environment among them. Methods: This study conducted mixed method. First of all, For finding out the dimensions of airline untact service quality, in-depth interviews were conducted from passengers. The collected data through the survey were analyzed using improved importance-performance analysis(IPA). Second, An online survey was conducted to quantitatively analyze user perception about airline untact service quality, and the importance performance of service quality at each dimension was identified through the revised IPA method. Results: The results of this study are as follows; Through in-depth interviews, 11 dimensions found out and 32 measurement items were developed. and then, through the revised IPA analysis, passengers were highly satisfied with "Cleanliness of in-flight service" and "Reliability of self check-in". Also, We found 3 shadow work dimensions such as "Ease of use of self check-in", "Usefulness of self check-in", and "Responsiveness of self check-in". Conclusion: Airline service providers have to keep high-satisfaction services and urgently improve less satisfied services. In particular, the dimensions related to shadow work have to be improved.