• 제목/요약/키워드: research data quality

검색결과 8,075건 처리시간 0.037초

소청초 종합해양과학기지 Radar 파랑 관측 데이터의 신뢰도 향상 (Quality Enhancement of Wave Data Observed by Radar at the Socheongcho Ocean Research Station)

  • 민용침;정진용;심재설;도기덕
    • 한국연안방재학회지
    • /
    • 제4권4호
    • /
    • pp.189-196
    • /
    • 2017
  • Ocean Research Stations (ORSs) is the ocean platform type observation towers and measured oceanic, atmospheric and environmental data. These station located on the offshore area far from the coast, so they can produce the data without land effect. This study focused to improve the wave data quality of ORS station. The wave observations at ORSs are used by the C-band (5.8 GHz, 5.17 cm) MIROS Wave and Current Radar (MWR). MWR is convenient to maintenance and produce reliability wave data under bad weather conditions. MWR measured significant wave height, peak wave period, peak wave direction and 2D wave spectrum, so it's can provide wave information for researchers and engineers. In order to improve the reliability of MWR wave data, Datawell Waverider Buoy was installed near the one ORS (Socheoncho station) during 7 months and validate the wave data of MWR. This study found that the wave radar tend to be overestimate the low wave height under wind condition. Firstly, this study carried out the wave Quality Control (QC) using wind data, however the quality of wave data was limited. So, this study applied the four filters (Correlation Check, Direction Filter, Reduce White Noise and Phillips Check) of MWR operating software and find that the filters effectively improve the wave data quality. After applying 3 effective filters in combination, the RMSE of significant wave height decreased from 0.81m to 0.23m, by 0.58m and Correlation increased from 0.66 to 0.96, by 0.32, so the reliability of MWR significant wave height was significantly improved.

텍스트 감정분석을 이용한 IT 서비스 품질요소 분석 (Analysis of IT Service Quality Elements Using Text Sentiment Analysis)

  • 김홍삼;김종수
    • 산업경영시스템학회지
    • /
    • 제43권4호
    • /
    • pp.33-40
    • /
    • 2020
  • In order to satisfy customers, it is important to identify the quality elements that affect customers' satisfaction. The Kano model has been widely used in identifying multi-dimensional quality attributes in this purpose. However, the model suffers from various shortcomings and limitations, especially those related to survey practices such as the data amount, reply attitude and cost. In this research, a model based on the text sentiment analysis is proposed, which aims to substitute the survey-based data gathering process of Kano models with sentiment analysis. In this model, from the set of opinion text, quality elements for the research are extracted using the morpheme analysis. The opinions' polarity attributes are evaluated using text sentiment analysis, and those polarity text items are transformed into equivalent Kano survey questions. Replies for the transformed survey questions are generated based on the total score of the original data. Then, the question-reply set is analyzed using both the original Kano evaluation method and the satisfaction index method. The proposed research model has been tested using a large amount of data of public IT service project evaluations. The result shows that it can replace the existing practice and it promises advantages in terms of quality and cost of data gathering. The authors hope that the proposed model of this research may serve as a new quality analysis model for a wide range of areas.

기상 모델의 초기장 및 자료동화 차이에 따른 수도권 지역의 CMAQ 오존 예측 결과 - 2007년 6월 수도권 고농도 오존 사례 연구 - (An impact of meteorological Initial field and data assimilation on CMAQ ozone prediction in the Seoul Metropolitan Area during June, 2007)

  • 이대균;이미향;이용미;유철;홍성철;장기원;홍지형
    • 환경영향평가
    • /
    • 제22권6호
    • /
    • pp.609-626
    • /
    • 2013
  • Air quality models have been widely used to study and simulate many air quality issues. In the simulation, it is important to raise the accuracy of meteorological predicted data because the results of air quality modeling is deeply connected with meteorological fields. Therefore in this study, we analyzed the effects of meteorological fields on the air quality simulation. This study was designed to evaluate MM5 predictions by using different initial condition data and different observations utilized in the data assimilation. Among meteorological scenarios according to these input data, the results of meteorological simulation using National Centers for Environmental Prediction (Final) Operational Global Analysis data were in closer agreement with the observations and resulted in better prediction on ozone concentration. And in Seoul, observations from Regional Meteorological Office for data assimilations of MM5 were suitable to predict ozone concentration. In other areas, data assimilation using both observations from Regional Meteorological Office and Automatical Weather System provided valid method to simulate the trends of meteorological fields and ozone concentrations. However, it is necessary to vertify the accuracy of AWS data in advance because slightly overestimated wind speed used in the data assimilation with AWS data could result in underestimation of high ozone concentrations.

GPS Research Group, Korea Astronomy Observatory

  • Park, Kwan-Dong;Kim, Ki-Nam;Park, Pil-Ho;Lim, Hyung-Chul
    • 한국우주과학회:학술대회논문집(한국우주과학회보)
    • /
    • 한국우주과학회 2002년도 한국우주과학회보 제11권2호
    • /
    • pp.35.2-35
    • /
    • 2002
  • PDF

데이터 마이닝 기반의 품질설계지원시스템 (Quality Design Support System based on Data Mining Approach)

  • 지원철
    • 한국경영과학회지
    • /
    • 제28권3호
    • /
    • pp.31-47
    • /
    • 2003
  • Quality design in practice highly depends on human designer's intuition and past experiences due to lack of formal knowledge about the relationship among 10 variables. This paper represents an data mining approach for developing quality design support system that integrates Case Based Reasoning (CBR) and Artificial Neural Networks (ANN) to effectively support all the steps in quality design process. CBR stores design cases in a systematic way and retrieve them quickly and accurately. ANN predicts the resulting quality attributes of design alternatives that are generated from CBR's adaptation process. When the predicted attributes fail to meet the target values, quality design simulation starts to further adapt the alternatives to the customer's new orders. To implement the quality design simulation, this paper suggests (1) the data screening method based on ξ-$\delta$ Ball to obtain the robust ANN models from the large production data bases, (2) the procedure of quality design simulation using ANN and (3) model management system that helps users find the appropriate one from the ANN model base. The integration of CBR and ANN provides quality design engineers the way that produces consistent and reliable design solutions in the remarkably reduced time.

2차원 관로형 지하시설물 정보 품질검증기술 개발 (Development of 2D Data Quality Validation Techniques for Pipe-type Underground Facilities)

  • 배상근;김상민;유은진;임거배;정다운
    • 산업경영시스템학회지
    • /
    • 제46권3호
    • /
    • pp.285-292
    • /
    • 2023
  • As various accidents have occurred in underground spaces, we aim to improve the quality validation standards and methods as specified in the Regulations on Producing Integrated Map of Underground Spaces devised by the Ministry of Land, Infrastructure and Transport of the Republic of Korea for a high-quality integrated map of underground spaces. Specifically, we propose measures to improve the quality assurance of pipeline-type underground facilities, the so-called life lines given their importance for citizens' daily activities and their highest risk of accident among the 16 types of underground facilities. After implementing quality validation software based on the developed quality validation standards, the adequacy of the validation standards was demonstrated by testing using data from two-dimensional water supply facilities in some areas of Busan, Korea. This paper has great significance in that it has laid the foundation for reducing the time and manpower required for data quality inspection and improving data quality reliability by improving current quality validation standards and developing technologies that can automatically extract errors through software.

품질관리시스템을 활용한 태양에너지자원 신뢰성 향상에 관한 연구 (The Study on the Reliability Enhancement for Solar Energy Resources Using the Data quality Management System in Korea (Focused on Data Error Analysis))

  • 조덕기;강용혁
    • 한국태양에너지학회 논문집
    • /
    • 제27권1호
    • /
    • pp.19-27
    • /
    • 2007
  • The Data quality management system(DQMS) organizes and helps manage and process time sequence data usually collected in monitoring networks and programs. DQMS places particular emphasis on data qualify while maintaining a highly organized and convenient structure for data. It operates with in a flexible and powerful commercial relational data base environment which can readily link to other software platforms from local spreadsheets to network server. The Korea Institute of Energy Research(KIER) has been solar radiation data since May, 1991 for 16 different locations. KIER's new data is expected to be extensively used by designer and researchers of solar systems in lieu of unreliable old ones. Unfortunately, the quality of the data has not always been properly mentioned. The purpose of this study is to systematically identify errors in such data set using DQMS in an effort to rehabilitate error-ridden old data. DET successfully uncovered solar radiation data that had questionable quality.

국내 수평면 전일사량 데이터의 정확도 평가에 관한 연구 (A Study on Accuracy Evaluation of Horizontal Global Radiation Data in Korea)

  • 조덕기;전일수;이태규
    • 태양에너지
    • /
    • 제20권1호
    • /
    • pp.31-43
    • /
    • 2000
  • The Korea Institute of Energy Research(KIER) has been collecting horizontal global radiation data since May, 1982 for 16 different locations. KIER's new data is expected to be extensively used by designer and researchers of solar systems in lieu of unreliable old ones. Unfortunately, the quality of the data has not always been properly mentioned. Some of them were taken at temporary field stations where the primary goal of the measurement was quick estimation of local solar radiation. The purpose of this study is to systematically identify errors in such data set using clear-day analysis in an effort to rehabilitate error-ridden old data. Clear-day analysis successfully uncovered solar radiation data that had questionable quality. Even through the rehabilitation process not necessarily improves the quality of data for daily or monthly mean, it can be used to improve the quality of data for monthly means of several years and the processed data can be used in various applications of solar energy with more confidence. A average ETR value of 0.63 obtained in this study is in good agreement with previous results obtained by other researchers.

  • PDF

머신러닝을 이용한 빅데이터 품질진단 자동화에 관한 연구 (A Study on Automation of Big Data Quality Diagnosis Using Machine Learning)

  • 이진형
    • 한국빅데이터학회지
    • /
    • 제2권2호
    • /
    • pp.75-86
    • /
    • 2017
  • 본 연구에서는 빅데이터의 품질을 진단하는 방법을 자동화하는 방법을 제안하고 있다. 빅데이터의 품질진단을 자동화해야 하는 이유는 4차 산업혁명이 이슈화 되면서 과거보다 더 많은 볼륨의 데이터를 발생시키고 이 데이터들을 활용 하려는 요구가 증가하기 때문이다. 데이터는 급증하지만 데이터의 품질을 진단하기 위해 많은 시간이 소비된다면 데이터를 활용하기 위해 많은 시간이 걸리거나 데이터의 품질이 낮아질 수 있다. 그러면 이러한 낮은 품질의 데이터로부터 의사결정이나 예측을 한다면 그 결과 또한 잘못된 방향을 제시할 것이다. 이러한 문제를 해결하기 위해 많은 데이터를 신속하게 진단하고 개선할 수 있는 머신러닝 이용한 빅데이터 품질 향상을 위한 진단을 자동화 할 수 있는 모델을 개발하였다. 머신러닝을 이용하여 도메인 분류 작업을 자동화하여 도메인 분류 작업 시 발생할 수 있는 오류를 예방하고 작업 시간을 단축시켰다. 연구 결과를 토대로 데이터 변환의 중요성, 학습되지 않은 데이터에 대한 학습 시킬 수 있는 방안 모색, 도메인별 분류 모델을 개발에 대한 연구를 지속적으로 진행한다면 빅데이터를 활용하기 위한 데이터 품질 향상에 기여할 수 있을 것이다.

  • PDF

DEVELOPMENT OF ARTIFICIAL NEURAL NETWORK MODELS SUPPORTING RESERVOIR OPERATION FOR THE CONTROL OF DOWNSTREAM WATER QUALITY

  • Chung, Se-Woong;Kim, Ju-Hwan
    • Water Engineering Research
    • /
    • 제3권2호
    • /
    • pp.143-153
    • /
    • 2002
  • As the natural flows in rivers dramatically decrease during drought season in Korea, a deterioration of river water quality is accelerated. Thus, consideration of downstream water quality responding to changes in reservoir release is essential for an integrated watershed management with regards to water quantity and quality. In this study, water quality models based on artificial neural networks (ANNs) method were developed using historical downstream water quality (rm $\NH_3$-N) data obtained from a water treatment plant in Geum river and reservoir release data from Daechung dam. A nonlinear multiple regression model was developed and compared with the ANN models. In the models, the rm NH$_3$-N concentration for next time step is dependent on dam outflow, river water quality data such as pH, alkalinity, temperature, and rm $\NH_3$-N of previous time step. The model parameters were estimated using monthly data from Jan. 1993 to Dec. 1998, then another set of monthly data between Jan. 1999 and Dec. 2000 were used for verification. The predictive performance of the models was evaluated by comparing the statistical characteristics of predicted data with those of observed data. According to the results, the ANN models showed a better performance than the regression model in the applied cases.

  • PDF