• Title/Summary/Keyword: Data Quality Evaluation

Search Result 2,615, Processing Time 0.03 seconds

STUDY ON THE OPTIMAL DESIGN OF A VEHICLE INTAKE SYSTEM USING THE BOOMING NOISE AND THE SOUND QUALITY EVALUATION INDEX

  • LEE J. K.;PARK Y. W.;CHAI J. B.
    • International Journal of Automotive Technology
    • /
    • v.7 no.1
    • /
    • pp.43-49
    • /
    • 2006
  • In this paper, an index for the evaluation of a vehicle intake booming noise and intake sound quality were developed through a correlation analysis and a multiple factor regression analysis of objective measurement and subjective evaluation data. At first, an intake orifice noise was measured at the wide-open throttle test condition. And then, an acoustic transfer function between intake orifice noise and interior noise at the steady state condition was estimated. Simultaneously, subjective evaluation was carried out with a 10-scale score by 8 intake noise and vibration expert evaluators. Next, the correlation analysis between the psychoacoustic parameters derived from the measured data and the subjective evaluation was performed. The most critical factor was determined and the corresponding index for intake booming noise and sound quality are obtained from the multiple factor regression method. And, the optimal design of intake system was studied using the booming noise and the sound quality evaluation index for expectation performance of intake system. Conclusively, the optimal designing parameters of intake system from noise level and sound quality whose point of view were extracted by adapting comparative weighting between the booming noise and sound quality evaluation index, which optimized the process. These work could be represented guideline to system engineers, designers and test engineers about optimization procedure of system performance by considering both of noise level and sound quality.

A Proposal of Evaluation of Large Language Models Built Based on Research Data (연구데이터 관점에서 본 거대언어모델 품질 평가 기준 제언)

  • Na-eun Han;Sujeong Seo;Jung-ho Um
    • Journal of the Korean Society for information Management
    • /
    • v.40 no.3
    • /
    • pp.77-98
    • /
    • 2023
  • Large Language Models (LLMs) are becoming the major trend in the natural language processing field. These models were built based on research data, but information such as types, limitations, and risks of using research data are unknown. This research would present how to analyze and evaluate the LLMs that were built with research data: LLaMA or LLaMA base models such as Alpaca of Stanford, Vicuna of the large model systems organization, and ChatGPT from OpenAI from the perspective of research data. This quality evaluation focuses on the validity, functionality, and reliability of Data Quality Management (DQM). Furthermore, we adopted the Holistic Evaluation of Language Models (HELM) to understand its evaluation criteria and then discussed its limitations. This study presents quality evaluation criteria for LLMs using research data and future development directions.

A Study on the Evaluation for the Public Opinion Survey Data Quality Used in Theses (학위논문에 사용된 여론조사 자료의 품질평가에 관한 연구)

  • Lee, Hae-Yong;Lee, In-Kyeng
    • Survey Research
    • /
    • v.11 no.2
    • /
    • pp.161-176
    • /
    • 2010
  • The purpose of this study is to evaluate the opinion survey data quality used in theses and to suggest the data quality evaluation model. We used 16 items which were suggested by KASR(Korean Association for Survey Research) as a standard of survey data quality evaluation in thesis. According to the result, the data quality used in the theses is very poor level not to be accepted. And we tried difference tests between two proportions in order to find there were significant differences among stochastical variables. The result showed that there were some significant differences in sampling error and number of analyzing method between doctor and master. we suggested a model that was weighted by 9 special items for a survey data quality evaluation in a thesis by observing them from KASR's principles.

  • PDF

Quality Evaluation of the Open Standard Data (공공데이터 개방표준 데이터의 품질평가)

  • Kim, Haklae
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.9
    • /
    • pp.439-447
    • /
    • 2020
  • Public data refers to all data or information created by public institutions, and public information that leads to communication and cooperation among all people. Public data is an important method to lead the next generation of new industries such as artificial intelligence and smart cities, Korea is continuously ranked high in the international evaluation related to public data. However, despite the continuous efforts, the use of public data or industrial influence is insufficient. Quality issues are continuously discussed in the use of public data, but the criteria for quantitatively evaluating data are insufficient. This paper reviews indicators for public data quality evaluation and performs quantitative evaluation on selected public data. In particular, the quality of open standard data constructed and opened based on public data management guidelines is examined to determine whether government guidelines are appropriate. The data quality assessment includes the metadata and data values of open standard data, and is reviewed based on completeness and accuracy indicators. Based on the data analysis results, this paper proposes policy and technical measures for quality improvement.

A Case Study on Database Quality and Quality Factors (데이터베이스 품질 평가에 관한 사례 연구)

  • Lee Cheen Yeul;Park Hyun Jee
    • Journal of Information Technology Applications and Management
    • /
    • v.11 no.4
    • /
    • pp.209-225
    • /
    • 2004
  • This paper presents case studies on database Quality uSing an extended database Quality model developed by Korea Database Promotion Center, which shall be called KDPC2003. The model is applied to evaluate two kinds of databases ; one is an operational database, the other is an information service database. The purpose of this research is two-folded. One is to evaluate database quality and assess current status of database quality management; the other is to assess usefulness of KDPC2003 and to propose ideas for its augmentation. The findings in this study will provide basic facts to test database quality evaluation models.

  • PDF

Verification of the Suitability of Fine Dust and Air Quality Management Systems Based on Artificial Intelligence Evaluation Models

  • Heungsup Sim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.8
    • /
    • pp.165-170
    • /
    • 2024
  • This study aims to verify the accuracy of the air quality management system in Yangju City using an artificial intelligence (AI) evaluation model. The consistency and reliability of fine dust data were assessed by comparing public data from the Ministry of Environment with data from Yangju City's air quality management system. To this end, we analyzed the completeness, uniqueness, validity, consistency, accuracy, and integrity of the data. Exploratory statistical analysis was employed to compare data consistency. The results of the AI-based data quality index evaluation revealed no statistically significant differences between the two datasets. Among AI-based algorithms, the random forest model demonstrated the highest predictive accuracy, with its performance evaluated through ROC curves and AUC. Notably, the random forest model was identified as a valuable tool for optimizing the air quality management system. This study confirms that the reliability and suitability of fine dust data can be effectively assessed using AI-based model performance evaluation, contributing to the advancement of air quality management strategies.

Proposal of Public Data Quality Management Level Evaluation Domain Rule Mapping Model

  • Jeong, Ha-Na;Kim, Jae-Woong;Chung, Young-Suk
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.12
    • /
    • pp.189-195
    • /
    • 2022
  • The Korean government has made it a major national task to contribute to the revitalization of the creative economy, such as creating new industries and jobs, by encouraging the private opening and utilization of public data. The Korean government is promoting public data quality improvement through activities such as conducting public data quality management level evaluation for high-quality public data retention. However, there is a difference in diagnosis results depending on the understanding and data expertise of users of the public data quality diagnosis tool. Therefore, it is difficult to ensure the accuracy of the diagnosis results. This paper proposes a public data quality management level evaluation domain rule mapping model applicable to validation diagnosis among the data quality diagnosis standards. This increases the stability and accuracy of public data quality diagnosis.

Assessment of tributary water quality using integrated Water Quality Index (통합수질지수를 이용한 지류지천 수질평가)

  • Kal, Byungseok;Park, Jaebeom;Kim, Sanghun;Im, Taehyo
    • Journal of Wetlands Research
    • /
    • v.19 no.3
    • /
    • pp.311-317
    • /
    • 2017
  • In this study, the water quality index was calculated using the water quality monitoring data in the Nakdong River water system and the water quality status was compared with the living standard. The water quality index was selected by the RWQI method CCME-WQI currently used by the Ministry of Environment. The water quality items were selected as 7 items for pH, DO, EC, water temperature, TOC, T-N and T-P. The evaluation period was selected from the last three years (2013~2015) and water quality monitoring data measured within the period were used. As a result of the evaluation, the results of the previous evaluation showed similar tendency to the index of living environment, but the monthly evaluation showed different BOD and T-P results. Therefore, it is concluded that it is more reliable that more complex evaluation than single water quality evaluation is needed for efficient river management.

Development of QI Activity Evaluation Framework Based on PDCA and Case Study on Quality Improvement Activities (PDCA 모형에 기초한 QI활동 평가틀 개발 및 사례분석)

  • Park, Yeon-Hwa;Lee, Myung-Ha;Jeong, Seok-Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.18 no.2
    • /
    • pp.222-233
    • /
    • 2012
  • Purpose: This study was conducted to develop an evaluation framework for QI activity in medical institutions and to analyze QI activity cases by applying the developed evaluation framework. Method: A four-phase process was employed to develop the evaluation framework, and a descriptive survey was used for the QI case study. Data were collected in April, 2010 by examining 157 QI activity cases presented at conferences and published in Journal of Korean Society of Quality Assurance in Health Care over the past three years. Developed QI activity evaluation instruments were used for data collection. Data were analyzed using the SPSS 18.0 for Windows program. Result: A QI Activity Evaluation Framework was developed. This framework consisted of 45 items. The department with the highest level of QI participation was the nursing department. The most frequent QI activity theme was patient safety. QI activity levels in Korean medical institutions are relatively equalized without significant differences according to institution characteristics. Conclusions: From the quality aspect of QI activity, more systematic and scientific approaches are required to upgrade QI activity. This study could provide methodological guidelines for QI activity and be useful in setting goals and directions for QI activity in medical institutions in Korea.

Assessment and Validation of the Reliability of Quality Measurement System for Wireless Data Services (무선데이터 서비스 품질 측정 시스템의 신뢰성 검증 및 평가)

  • Choi, Dong-Hwan;Park, Seok-Cheon
    • Journal of Information Technology Services
    • /
    • v.11 no.1
    • /
    • pp.239-246
    • /
    • 2012
  • The user increases around the WiBro and in which the mobile broad band service is the wireless internet base technology HSDPA, that is the cellular phone foundation technique, and moreover the issue about the user effective quality guarantee emerges but the quality control of the wireless network is the incomplete actual condition. Therefore, the reliability verification according to the development of the system for the performance measure for the continued wireless data service and it and evaluation are needed for the quality control. In this paper, the wireless data service quality measurement system was implemented with the design. The same test environment as the existing network performance measurement program was built for the reliability verification of the embodied device for measuring quality and evaluation and the cost performance was performed. It could confirm that design and embodied wireless data service quality measurement system operated accurately in this paper through the quality measure result value analysis.