• Title/Summary/Keyword: Quality Evaluation Tool

Search Result 642, Processing Time 0.025 seconds

An Evaluation of Translation Quality by Homograph Disambiguation in Korean-X Neural Machine Translation Systems (한-X 신경기계번역시스템에서 동형이의어 분별에 따른 변역질 평가)

  • Nguyen, Quang-Phuoc;Shin, Joon-Choul;Ock, Cheol-Young
    • Annual Conference on Human and Language Technology
    • /
    • 2018.10a
    • /
    • pp.504-509
    • /
    • 2018
  • Neural machine translation (NMT) has recently achieved the state-of-the-art performance. However, it is reported failing in the word sense disambiguation (WSD) for several popular language pairs. In this paper, we explore the extent to which NMT systems are able to disambiguate the Korean homographs. Homographs, words with different meanings but the same written form, cause the word choice problems for NMT systems. Consistent with the popular language pairs, we discover that NMT systems fail to translate Korean homographs correctly. We provide a Korean word sense disambiguation tool-UTagger to use for improvement of NMT's translation quality. We conducted translation experiments using Korean-English and Korean-Vietnamese language pairs. The experimental results show that UTagger can significantly improve the translation quality of NMT in terms of the BLEU, TER, and DLRATIO evaluation metrics.

  • PDF

An Internet Shopping Mall Evaluation Model based on Malcolm Baldrige Model (말콤 볼드리지 기반한 인터넷 쇼핑몰 평가모형)

  • Kim, Hee-Ohl;Baek, Dong-Hyun
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.33 no.3
    • /
    • pp.102-113
    • /
    • 2010
  • In this research, we proposed a quality evaluation standard model which is suitable for the internet shopping mall based on the Malcolm Baldrige National Quality Award model. A 7-Point Likert Scale was used based on the seven categories within the 2008 Malcolm Baldrige Criteria : Leadership, Strategic Planning, Customer and Market Focus, Measurement Analysis and Knowledge Management, Workforce Focus, Process Management, and Result. Furthermore, we analysed the validity and causal relationship among the factors within the model. The goal of this research is to find a rational standard to evaluate internet shopping malls nationwide and help the structuring and the operation of these malls. The results may be used not only as a tool to evaluate internet shopping mall sites but also as a guideline to improve the quality of a internet shopping mall site that is under development.

A Study on the Quality Evaluation of Scholarly Web Databases Focused on NDSL, PubMed, Scopus, and Web of Science (학술 웹 데이터베이스의 품질 비교 평가 : NDSL, P ubMed, Scopus와 Web of Science를 중심으로)

  • Kim, Sang-Jun
    • Journal of Information Management
    • /
    • v.36 no.3
    • /
    • pp.127-165
    • /
    • 2005
  • This study is focused on the quality of the Web databases which has been produced in science. For the quality evaluation of NDSL, PubMed, Scopus, and WoS, 10 evaluating criteria are developed on the basis of literature review. The evaluation results show that NDSL and PubMed are superior in the currentness and cost. Scopus and WoS are superior in the information of citing and the analysis tool. It is needed for purchasing, user training, and library service based on the above evaluation results.

Development of Performance Evaluation Protocols for Physicians in a University Hospital (한 대학병원의 진료과별 업무성과 평가 도구 개발 과정)

  • Kim, Chang-Yup;Kim, Sunmean
    • Quality Improvement in Health Care
    • /
    • v.5 no.2
    • /
    • pp.296-310
    • /
    • 1998
  • Background : Performance evaluation of medical care providers has become more important than before in Korea. Especially in university hospitals, job contents of medical staffs are so complicated that evaluation is not easily performed. In addition, in order that the feedback of evaluation be successful, acceptance of staffs to be evaluated is essential. This study is aimed at the development of items for evaluation and weighting of each item in one university hospital, and clustering departments by different weight given by medical staffs. Methods : Through resource group meeting. performance items were listed up by categories of education, research, medical services, and other activities in and out of the hospital. For each item, all the medical staffs were asked how important they thought, compared with publishing one original article. By factor analysis, the items in each category were grouped into a few subgroups. In turn, cluster analysis was done for the purpose of grouping departments by priority the medical staffs gave. Results and Conclusion : Among five major categories, medical staffs regard education, research, and medical services more important than other activities in and out of the hospital. Five categories consisted of two or three components. Departments in hospital were grouped into three. However, characteristics of each group was not clearly delineated. This result suggests that more comprehensive tool should be developed and applied in the process of performance evaluation in university hospitals.

  • PDF

Product Quality Index for Concept Design Evaluation (개념 설계 평가를 위한 제품 품질지수)

  • Jeong, Jin-Ha;Park, Young-Won
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.19 no.4
    • /
    • pp.521-528
    • /
    • 2010
  • A product system will be improved continually until requirements are satisfied. It is true that considering alternative designs to improve product system is hard work; it is also true that selecting an adequate design idea that represents the needs of stakeholders concerned and meets effectiveness factors properly is not an easy work, either. In the process of driv-ing an idea and designing, which is called Design Phase, there are lots of existing tools for testing the driven idea in DFSS. But, those kinds of tools do not offer the function that helps to select the technically better design idea among alternative design ideas that have the same evaluation level. Moreover it is inappropriate to select adequate alternative design ideas by just verifying only the evaluation table in pugh matrix, since satisfied deviation val-ues are low when there is a too competitive mass product system in a market. Also, for the IT product with short life cycle, faster and more effective testing tool is needed. Therefore, the 'roduct quality index' is suggested in order to select an appropriate candidate design concept for system development that meets requirements by using 'deality concept' pro-vided by TRIZ. According to the result of this research, it is possible to select technically better idea fast and effectively; it is confirmed by applying the approach to the case of LCD BLU (Back Light Unit).

Quality Evaluation of Engineering Computer Programs Using Software Quality Metrics (Software Quality Metrics를 이용한 공학용 전산 프로그램의 품질특성 측정)

  • 조문성;남지희
    • Journal of Korean Society for Quality Management
    • /
    • v.25 no.4
    • /
    • pp.115-130
    • /
    • 1997
  • SQM (Software Quality Metrics) is a methodology whose primary objective is the measurement of compliances to requirements using a set of software life cycle properties called quality factors, which is based on the hierachical relationshiips between factors, criteria and elements. For this study, two factors (Correctness, Maintainability) and five criteria were selected. In addition, several tens of quality elements were developed to su, pp.rt them. Qualities of three computer programs which are being used for engineering purpose were measured. As a result, it is concluded that SQM is a valuable method for continuously monitoring the pulse of software quality development and that it can be used as a tool for software quality assurance.

  • PDF

State Monitoring using AE Signal in Micro Endmilling (마이크로 엔드밀링에서 음향방출 신호를 이용한 상태감시)

  • 정연식;강익수;김전하;강명창;김정석;안중환
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2004.10a
    • /
    • pp.334-339
    • /
    • 2004
  • Ultraprecision machining and MEMS technology have been taken more and more important position in machining of microparts. Micro endmilling is one of the prominent technology that has wide spectrum of application field ranging from macro parts to micro products. Also, the method of micro-grooving using micro endmilling is used widely owing to many merit, but has problems of precision and quality of products due to tool wear and tool fracture. This investigation deals with state monitoring using acoustic emission(AE) signal in the micro-grooving. Characteristic evaluation of AE raw signal, AE hit and frequency analysis for state monitoring is also presented in the paper.

  • PDF

The Correlation between GRBAS Scales and MDVP Parameters on the Pathologic Voices of the Patients with Vocal Polyps (성대 폴립 환자를 대상으로 한 GRBAS 척도와 MDVP 측정치 간의 상관관계 연구)

  • 표화영;최성희;임성은;심현섭;최홍식;김광문
    • Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
    • /
    • v.10 no.2
    • /
    • pp.154-163
    • /
    • 1999
  • GRBAS scale, the tool fir the perceptual evaluation of voice, demands the experience of judges, and MDVP parameters of CSL, the tool for the objective measurements of voice quality demands the exact interpretation of the analyzed results. The two tools should be used as compensatory evaluation methods, so the experimental study was performed to investigate the correlation between GRBAS scales and MDVP parameters by using the pathologic voice of the 30 patients with vocal polyps, and to know the significant MDVP parameters which the inexperienced GRBAS scale judges should attend to. The 30 subjects voices, saved in MDVP of CSL were analyzed by its own analysis program, and three experienced voice therapists judged the same voices by using GRBAS scales. The correlations between them were analyzed by Spearman Rank Correlation Coefficient. As results, among the 29 MDVP parameters, 22 parameters showed statistically significant correlation with Grade(G) scale(p<0.05). And it was found that Roughness(R) scale showed significant correlation with 18 parameters, Breathiness(B) scale with 17 parameters, Strain(S) scale with 12 parameters. In Asthenicity(A) scale, no parameter showed significant correlation. On the whole, significantly high correlation were found in the parameters related with pitch ind amplitude perturbation, especially, the amplitude perturbation.

  • PDF

Proposal of Public Data Quality Management Level Evaluation Domain Rule Mapping Model

  • Jeong, Ha-Na;Kim, Jae-Woong;Chung, Young-Suk
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.12
    • /
    • pp.189-195
    • /
    • 2022
  • The Korean government has made it a major national task to contribute to the revitalization of the creative economy, such as creating new industries and jobs, by encouraging the private opening and utilization of public data. The Korean government is promoting public data quality improvement through activities such as conducting public data quality management level evaluation for high-quality public data retention. However, there is a difference in diagnosis results depending on the understanding and data expertise of users of the public data quality diagnosis tool. Therefore, it is difficult to ensure the accuracy of the diagnosis results. This paper proposes a public data quality management level evaluation domain rule mapping model applicable to validation diagnosis among the data quality diagnosis standards. This increases the stability and accuracy of public data quality diagnosis.

Objective and Quantitative Evaluation of Image Quality Using Fuzzy Integral: Phantom Study (퍼지적분을 이용한 영상품질의 객관적이고 정량적 평가: 팬톰 연구)

  • Kim, Sung-Hyun;Suh, Tae-Suk;Choe, Bo-Young;Lee, Hyoung-Koo
    • Progress in Medical Physics
    • /
    • v.19 no.4
    • /
    • pp.201-208
    • /
    • 2008
  • Physical evaluations provide the basis for an objective and quantitative analysis of the image quality. Nonetheless, there are limitations in using physical evaluations to judge the utility of the image quality if the observer's subjectivity plays a key role despite its imprecise and variable nature. This study proposes a new method for objective and quantitative evaluation of image quality to compensate for the demerits of both physical and subjective image quality and combine the merits of them. The images of chest phantom were acquired from four digital radiography systems on clinic sites. The physical image quality was derived from an image analysis algorithm in terms of the contrast-to-noise ratio (CNR) of the low-contrast objects in three regions (lung, heart, and diaphragm) of a digital chest phantom radiograph. For image analysis, various image processing techniques were used such as segmentation, and registration, etc. The subjective image quality was assessed by the ability of the human observer to detect low-contrast objects. Fuzzy integral was used to integrate them. The findings of this study showed that the physical evaluation did not agree with the subjective evaluation. The system with the better performance in physical measurement showed the worse result in subjective evaluation compared to the other system. The proposed protocol is an integral evaluation method of image quality, which includes the properties of both physical and subjective measurement. It may be used as a useful tool in image evaluation of various modalities.

  • PDF