• Title/Summary/Keyword: Data Quality Validation

Search Result 379, Processing Time 0.029 seconds

Effect of Sample Preparation on Prediction of Fermentation Quality of Maize Silages by Near Infrared Reflectance Spectroscopy

  • Park, H.S.;Lee, J.K.;Fike, J.H.;Kim, D.A.;Ko, M.S.;Ha, Jong Kyu
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.18 no.5
    • /
    • pp.643-648
    • /
    • 2005
  • Near infrared reflectance spectroscopy (NIRS) has become increasingly used as a rapid, accurate method of evaluating some chemical constituents in cereal grains and forages. If samples could be analyzed without drying and grinding, then sample preparation time and costs may be reduced. This study was conducted to develop robust NIRS equations to predict fermentation quality of corn (Zea mays) silage and to select acceptable sample preparation methods for prediction of fermentation products in corn silage by NIRS. Prior to analysis, samples (n = 112) were either oven-dried and ground (OD), frozen in liquid nitrogen and ground (LN) and intact fresh (IF). Samples were scanned from 400 to 2,500 nm with an NIRS 6,500 monochromator. The samples were divided into calibration and validation sets. The spectral data were regressed on a range of dry matter (DM), pH and short chain organic acids using modified multivariate partial least squares (MPLS) analysis that used first and second order derivatives. All chemical analyses were conducted with fresh samples. From these treatments, calibration equations were developed successfully for concentrations of all constituents except butyric acid. Prediction accuracy, represented by standard error of prediction (SEP) and $R^2_{v}$ (variance accounted for in validation set), was slightly better with the LN treatment ($R^2$ 0.75-0.90) than for OD ($R^2$ 0.43-0.81) or IF ($R^2$ 0.62-0.79) treatments. Fermentation characteristics could be successfully predicted by NIRS analysis either with dry or fresh silage. Although statistical results for the OD and IF treatments were the lower than those of LN treatment, intact fresh (IF) treatment may be acceptable when processing is costly or when possible component alterations are expected.

A Study on DEA-based Stepwise Benchmarking Target Selection Considering Resource Improvement Preferences (DEA 기반의 자원 개선 선호도를 고려한 단계적 벤치마킹 대상 탐색 연구)

  • Park, Jaehun;Sung, Si-Il
    • Journal of Korean Society for Quality Management
    • /
    • v.47 no.1
    • /
    • pp.33-46
    • /
    • 2019
  • Purpose: This study proposed a DEA (Data Envelopment Analysis)-based stepwise benchmarking target selection for inefficient DMU (Decision Making Unit) to improve its efficiency gradually to reach most efficient frontier considering resource (DEA inputs and outputs) improvement preferences. Methods: The proposed method proceeded in two steps. First step evaluates efficiency of DMUs by using DEA, and an evaluated DMU selects benchmarking targets of HCU (Hypothesis Composit Unit) or RU (Real Unit) considering resource improvement preferences. Second step selects stepwise benchmarking targets of the inefficient DMU. To achieve this, this study developed a new DEA model, which can select a benchmarking target of an inefficient DMU in considering inputs or outputs improvement preference, and suggested an algorithm, which can select stepwise benchmarking targets of the inefficient DMU. Results: The proposed method was applied to 34 international ports for validation. In efficiency evaluation, five ports was evaluated as most efficient port, and the remaining 29 ports was evaluated as relative inefficient port. When port 34 was supposed as evaluated DMU, its can select its four stepwise benchmarking targets in assigning the preference weight to inputs (berth length, total area of pier, CFS, number of loading machine) as (0.82, 1.00, 0.41, 0.00). Conclusion: For the validation of the proposed method, it applied to the 34 major ports around the world and selected stepwise benchmarking targets for an inefficient port to improve its efficiency gradually. We can say that the proposed method enables for inefficient DMU to establish more effective and practical benchmarking strategy than the conventional DEA because it considers the resource (inputs or outputs) improvement preference in selecting benchmarking targets gradually.

A Study on Registration Data Analysis of National Immunization Registry Information System (예방접종등록 정보시스템의 등록자료 분석에 관한 연구)

  • Kim, Chang-su;Park, Ok;Kim, Mi-young;Kim, Myung-jin;Lee, Sok-goo;Jung, Hoe-kyung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.19 no.5
    • /
    • pp.1151-1156
    • /
    • 2015
  • In this study, the accuracy duplication and register rate of the vaccination registration data in National Immunization Registry Information System were evaluated and analyzed. Through which undocumented vaccination status data, duplicate data, missing data, errors data into the vaccination registration data were analyzed. In addition, the quality control for the vaccination registration database quality improvement, were proposed for standard error checking. In this paper, we propose an efficient validation of a quality management system of the database.

Assessments of the GEMS NO2 Products Using Ground-Based Pandora and In-Situ Instruments over Busan, South Korea

  • Serin Kim;Ukkyo Jeong;Hanlim Lee;Yeonjin Jung;Jae Hwan Kim
    • Korean Journal of Remote Sensing
    • /
    • v.40 no.1
    • /
    • pp.1-8
    • /
    • 2024
  • Busan is the 6th largest port city in the world, where nitrogen dioxide (NO2) emissions from transportation and port industries are significant. This study aims to assess the NO2 products of the Geostationary Environment Monitoring Spectrometer (GEMS) over Busan using ground-based instruments (i.e., surface in-situ network and Pandora). The GEMS vertical column densities of NO2 showed reasonable consistency in the spatiotemporal variations, comparable to the previous studies. The GEMS data showed a consistent seasonal trend of NO2 with the Korea Ministry of Environment network and Pandora in 2022, which is higher in winter and lower in summer. These agreements prove the capability of the GEMS data to monitor the air quality in Busan. The correlation coefficient and the mean bias error between the GEMS and Pandora NO2 over Busan in 2022 were 0.53 and 0.023 DU, respectively. The GEMS NO2 data were also positively correlated with the ground-based in-situ network with a correlation coefficient of 0.42. However, due to the significant spatiotemporal variabilities of the NO2, the GEMS footprint size can hardly resolve small-scale variabilities such as the emissions from the road and point sources. In addition, relative biases of the GEMS NO2 retrievals to the Pandora data showed seasonal variabilities, which is attributable to the air mass factor estimation of the GEMS. Further studies with more measurement locations for longer periods of data can better contribute to assessing the GEMS NO2 data. Reliable GEMS data can further help us understand the Asian air quality with the diurnal variabilities.

Structural health monitoring response reconstruction based on UAGAN under structural condition variations with few-shot learning

  • Jun, Li;Zhengyan, He;Gao, Fan
    • Smart Structures and Systems
    • /
    • v.30 no.6
    • /
    • pp.687-701
    • /
    • 2022
  • Inevitable response loss under complex operational conditions significantly affects the integrity and quality of measured data, leading the structural health monitoring (SHM) ineffective. To remedy the impact of data loss, a common way is to transfer the recorded response of available measure point to where the data loss occurred by establishing the response mapping from measured data. However, the current research has yet addressed the structural condition changes afterward and response mapping learning from a small sample. So, this paper proposes a novel data driven structural response reconstruction method based on a sophisticated designed generating adversarial network (UAGAN). Advanced deep learning techniques including U-shaped dense blocks, self-attention and a customized loss function are specialized and embedded in UAGAN to improve the universal and representative features extraction and generalized responses mapping establishment. In numerical validation, UAGAN efficiently and accurately captures the distinguished features of structural response from only 40 training samples of the intact structure. Besides, the established response mapping is universal, which effectively reconstructs responses of the structure suffered up to 10% random stiffness reduction or structural damage. In the experimental validation, UAGAN is trained with ambient response and applied to reconstruct response measured under earthquake. The reconstruction losses of response in the time and frequency domains reached 16% and 17%, that is better than the previous research, demonstrating the leading performance of the sophisticated designed network. In addition, the identified modal parameters from reconstructed and the corresponding true responses are highly consistent indicates that the proposed UAGAN is very potential to be applied to practical civil engineering.

Watershed Modeling for Assessing Climate Change Impact on Stream Water Quality of Chungju Dam Watershed (<2009 SWAT-KOREA 컨퍼런스 특별호 논문> 기후변화가 충주댐 유역의 하천수질에 미치는 영향평가를 위한 유역 모델링)

  • Park, Jong-Yoon;Park, Min-Ji;Ahn, So-Ra;Kim, Seong-Joon
    • Journal of Korea Water Resources Association
    • /
    • v.42 no.10
    • /
    • pp.877-889
    • /
    • 2009
  • This study is to assess the future potential impact of climate change on stream water quality for a 6,581.1 km$^2$ dam watershed using SWAT (Soil and Water Assessment Tool) model. The ECHAM5-OM climate data of IPCC (The Intergovernmental Panel on Climate Change) A2, A1B, and B1 emission scenarios were adopted and the future data (2007-2099) were corrected using 30 years (1977-2006, baseline period) weather data and downscaled by Change Factor (CF) method. After model calibration and validation using 6 years (1998-2003) observed daily streamflow and monthly water quality (SS, T-N, and T-P) data, the future (2020s, 2050s and 2080s) hydrological behavior and stream water quality were projected.

Development of Prediction Model of Groundwater Pollution based on Food Available Water and Validation in Small Watersheds (식품용수 수질자료를 이용한 지하수 오염 예측 모델 개발 및 소규모 유역에서의 검증)

  • Nam, Sungwoo;Park, Eungyu;Yi, Myeong-jae;Jeon, Seonkeum;Jung, Hyemin;Kim, Jeongwoo
    • Journal of Soil and Groundwater Environment
    • /
    • v.26 no.6
    • /
    • pp.165-175
    • /
    • 2021
  • Groundwater is used in many areas in food industry such as food manufacturing, food processing, cooking, and liquor industry etc. in Korea. As groundwater occupies a large portion of food industry, it is necessary to predict deterioration of water quality to ensure the safety of food water since using undrinkable groundwater has a ripple effect that can cause great harm or anxiety to food users. In this study, spatiotemporal data aggregation method was used in order to obtain spatially representative data, which enable prediction of groundwater quality change in a small watershed. In addition, a highly reliable predictive model was developed to estimate long-term changes in groundwater quality by applying a non-parametric segmented regression technique. Two pilot watersheds were selected where a large number of companies use groundwater for food water, and the appropriateness of the model was assessed by comparing the model-produced values with those obtained by actual measurements. The result of this study can contribute to establishing a customized food water management system utilizing big data that respond quickly, accurately, and preemptively to changes in groundwater quality and pollution. It is also expected to contribute to the improvement of food safety management.

Infrared Rainfall Estimates Using the Probability Matching Method Applied to Coincident SSM/I and GMS-5 Data

  • Oh, Hyun-Jong;Sohn, Byung-Ju;Chung, Hyo-Sang
    • Proceedings of the KSRS Conference
    • /
    • 1999.11a
    • /
    • pp.117-121
    • /
    • 1999
  • Relations between GMS-5 infrared brightness temperature with SSM/I retrieved rain rate are determined by a probability matching method similar to Atlas et al. and Crosson et al. For this study, coincident data sets of the GMS-5 infrared measurements and SSM/I data during two summer seasons of 1997 and 1998 are constructed. The cumulative density functions (CDFs) of infrared brightness temperature and rain rate are matched at pairs of two variables which give the same percentile contribution. The method was applied for estimating rain rate on 31 July 1998, examining heavy rainfall estimation of a flash flood event over Mt. Jiri. Results were compared with surface gauge observations run by Korean Meteorological Administration. It was noted that the method produced reasonably good quality of rain estimate, however, there was large area giving false rain due to the anvil type clouds surrounding deep convective clouds. Extensive validation against surface rain observation is currently under investigation.

  • PDF

A Comparison of Classification Methods for Credit Card Approval Using R (R의 분류방법을 이용한 신용카드 승인 분석 비교)

  • Song, Jong-Woo
    • Journal of Korean Society for Quality Management
    • /
    • v.36 no.1
    • /
    • pp.72-79
    • /
    • 2008
  • The policy for credit card approval/disapproval is based on the applier's personal and financial information. In this paper, we will analyze 2 credit card approval data with several classification methods. We identify which variables are important factors to decide the approval of credit card. Our main tool is an open-source statistical programming environment R which is freely available from http://www.r-project.org. It is getting popular recently because of its flexibility and a lot of packages (libraries) made by R-users in the world. We will use most widely used methods, LDNQDA, Logistic Regression, CART (Classification and Regression Trees), neural network, and SVM (Support Vector Machines) for comparisons.

Validation of Adsorption Efficiency of Activated Carbons through Surface Morphological Characterization Using Scanning Electron Microscopy Technique

  • Malik, Ruchi;Mukherjee, Manisha;Swami, Aditya;Ramteke, Dilip S.;Sarin, Rajkamal
    • Carbon letters
    • /
    • v.5 no.2
    • /
    • pp.75-80
    • /
    • 2004
  • The studies on activated carbon prepared from walnut shell and groundnut shell were undertaken to ascertain the effect of initial state of precursor and activation process on the development of porosity in the resulting activated carbon. Walnut shell based carbon shows the presence of cellular pores while Groundnut shell based carbon shows fibrillar pore structure. The adsorption parameters, characterization of product and scanning electron microscopic studies carried out showed the presence of mainly Micro, Meso and Macro porosity in carbon prepared from Walnut shell while mainly micro porosity was observed in Groundnut shell based activated carbon. An interrelationship between the adsorption efficiency and porosity in terms of quality control parameters, for before and after activation, was validated through the scanning electron microscopic data.

  • PDF