• Title/Summary/Keyword: Quality evaluation metrics

Search Result 200, Processing Time 0.028 seconds

Tonality Design for Sound Quality Evaluation for Gear Whine Sound (승합차량의 액슬기어 음질의 평가를 위한 새로운 순음도 모델 개발과 응용)

  • Kim, Eui-Youl;Jang, Ji-Uk;Lee, Sang-Kwon
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.22 no.12
    • /
    • pp.1172-1183
    • /
    • 2012
  • Aure's tonality was considered as the sound metrics for the expression of the tonality of gear whine sound in a previous research. It was failed to use the Aure's tonality as a sound metric for the tonal impression. Thus Aures's tonality, was developed for tonal impression in previous research. However, this metric did not express well the tonality of gear whine sound since the whine sound is a non-stationary signal with frequency modulation and amplitude modulation. In this study, the new method for the tonality evaluation for a non-stationary signal is presented. It is developed based on the prominence ratio, tonality impression function, and lower threshold level. It improves the accuracy and reliability of the sound quality index being used for the sound quality evaluation of the axle-gear whine sound.

Metrics for Low-Light Image Quality Assessment

  • Sangmin Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.8
    • /
    • pp.11-19
    • /
    • 2023
  • In this paper, it is confirmed that the metrics used to evaluate image quality can be applied to low-light images. Due to the nature of low-illumination images, factors related to light create various noise patterns, and the smaller the amount of light, the more severe the noise. Therefore, in situations where it is difficult to obtain a clean image without noise, the quality of a low-illuminance image from which noise has been removed is often judged by the human eye. In this paper, noise in low-illuminance images for which ground truth cannot be obtained is removed using Noise2Noise, and spatial resolution and radial resolution are evaluated using ISO 12233 charts and colorchecker as metrics such as MTF and SNR. It can be shown that the quality of the low-illuminance image, which has been evaluated mainly for qualitative evaluation, can also be evaluated quantitatively.

Development of a Quality Evaluation Standard for Educational Serious Games

  • Yoon, Seon-Jeong;Park, Hee-Sook
    • Journal of information and communication convergence engineering
    • /
    • v.11 no.2
    • /
    • pp.103-111
    • /
    • 2013
  • Given the lack of suitable quality evaluation standards for educational serious games (designed for both entertainment and instruction), we designed a development framework for evaluation standards of educational serious games and proceeded to develop standards in accordance with our proposed procedure. Our standards were designed to evaluate the quality of both technical and non-technical elements of educational serious game software products. We conducted a survey on the need for individual elements of the standard. Participants rated the need for each element on a five-point Likert scale. We then performed a reliability analysis of the survey results. Based on the survey results, we established a final standard for quality evaluation composed of 9 main elements and 31 sub-elements. The results of our research will contribute useful information to users as well as to the developers of educational serious games.

A Study on Quality Evaluation Model of Mobile Device Management for BYOD (BYOD 환경의 MDM 보안솔루션의 품질평가모델에 관한 연구)

  • Rha, HyeonDae;Kang, SuKyoung;Kim, ChangJae;Lee, NamYong
    • The Journal of Korean Association of Computer Education
    • /
    • v.17 no.6
    • /
    • pp.93-102
    • /
    • 2014
  • A mobile office environment using mobile devices, such as tablet PC, mobile phone is gradually increased in enterprises, banking and public institutions etc which is no limitation on places. It occurs advanced and persist security threats that are required effective security management policy and technical solution to be secure. For BYOD (Bring Your Own Device) environment, technical security management solutions of network control based, MDM (Mobile Device Management), MAM (Mobile Application Management), MCM (Mobile Contents Management) were released, evolved and mixed used. In perspective of integrated security management solution, mobile security product should be selected to consider user experience and environment and correct quality evaluation model of product is needed which is provided standards and guidance on the selection criteria when it was introduced. In this paper, the most widely used MDM solution is selected to take a look at its features and it was reviewed the product attributes with related international standard ISO/IEC25010 software quality attributes. And then it was derived evaluation elements and calculated the related metrics based on the quality analysis model. For the verification of quality evaluation model, security checks list and testing procedures were established; it applied metrics and analyzed the testing result through scenario based case study.

  • PDF

Artificial Intelligence software evaluation plan (인공지능 소프트웨어 평가방안)

  • Jung, Hye Jung
    • Advanced Industrial SCIence
    • /
    • v.1 no.1
    • /
    • pp.28-34
    • /
    • 2022
  • Many studies have been conducted on software quality evaluation. Recently, as artificial intelligence-related software has been developed a lot, research on methods for evaluating artificial intelligence functions in existing software is being conducted. Software evaluation has been based on eight quality characteristics: functional suitability, reliability, usability, maintainability, performance efficiency, portability, compatibility, and security. Research on the part that needs to be confirmed through evaluation of the function of the intelligence part is in progress. This study intends to introduce the contents of the evaluation method in this part. We are going to propose a quality evaluation method for artificial intelligence software by presenting the existing software quality evaluation method and the part to be considered in the AI part.

Analyzing Machine Learning Techniques for Fault Prediction Using Web Applications

  • Malhotra, Ruchika;Sharma, Anjali
    • Journal of Information Processing Systems
    • /
    • v.14 no.3
    • /
    • pp.751-770
    • /
    • 2018
  • Web applications are indispensable in the software industry and continuously evolve either meeting a newer criteria and/or including new functionalities. However, despite assuring quality via testing, what hinders a straightforward development is the presence of defects. Several factors contribute to defects and are often minimized at high expense in terms of man-hours. Thus, detection of fault proneness in early phases of software development is important. Therefore, a fault prediction model for identifying fault-prone classes in a web application is highly desired. In this work, we compare 14 machine learning techniques to analyse the relationship between object oriented metrics and fault prediction in web applications. The study is carried out using various releases of Apache Click and Apache Rave datasets. En-route to the predictive analysis, the input basis set for each release is first optimized using filter based correlation feature selection (CFS) method. It is found that the LCOM3, WMC, NPM and DAM metrics are the most significant predictors. The statistical analysis of these metrics also finds good conformity with the CFS evaluation and affirms the role of these metrics in the defect prediction of web applications. The overall predictive ability of different fault prediction models is first ranked using Friedman technique and then statistically compared using Nemenyi post-hoc analysis. The results not only upholds the predictive capability of machine learning models for faulty classes using web applications, but also finds that ensemble algorithms are most appropriate for defect prediction in Apache datasets. Further, we also derive a consensus between the metrics selected by the CFS technique and the statistical analysis of the datasets.

A Study on the Audit Model of Outsourcing Operation based on Availability Metrics in perspective of Service Level Agreenment (서비스 수준협약 관점에서 가용성 지표 중심의 아웃소싱 운영감리 모델에 관한 연구)

  • Kim, Dong-Soo;Kim, Hee-Wan
    • Journal of Digital Convergence
    • /
    • v.13 no.7
    • /
    • pp.183-196
    • /
    • 2015
  • In order to perform a successful outsourcing, we needs the SLA through improving the quality of IT services. In particular SLA metrics and evaluation criteria is an important factor as to substitute the IT viability of the company to promote IT Outsourcing. SLA metrics consist of technical, managerial, user perspective items, and has been managed to aim to provide reliable and continuous quality improvement of IT services. This study focuses on the HW availability metrics of SLA indicators of IT outsourcing. We propose the Infra availability criteria for the HW configuration level to meet the SLA contract and evaluation. We offer the Infra configuration standards of SLA contract, and propose criteria to determine the suitability of the target levels in IT operations audit environment. The proposed model was verified the necessity and effectiveness of the Infra configuration standards and operation audit check items through the surveys of experts and users.

An Empirical Study of Software Size Estimation Techniques by Use Case (Use Case에 의한 소프트웨어 규모 예측 방법에 대한 실증적 연구)

  • 서예영;이남용
    • The Journal of Society for e-Business Studies
    • /
    • v.6 no.2
    • /
    • pp.143-157
    • /
    • 2001
  • There has been a need for predicting development efforts and costs of the system during the early stage of the software process and hundreds of metrics have been proposed for computer software, but not all provide practical support to the software engineer. Some demand measurement that is too complex, others are so esoteric that few real-world professionals have any hope of understanding them, and others violate the basic intuitive notions of what high-quality software really is. It is worthwhile that metrics should be tailored to best accommodate specific products and processes after grasping their good and no good point. This paper describes two size estimation techniques, the Karner technique and the Marchesi technique, and compares and analyzes them with proposed evaluation criteria. Both techniques are to estimate software size analyzed by use case that is mainly described during the object-oriented analysis phase. We also present an empirical comparison of them, both are applied in the Internet Medicine Prescription System. We also propose some guidance for experiments based on our analysis. We believe that it should be facilitating project management more effective by adjusting software metrics properly.

  • PDF

A Study on BSR Noise and Sound Quality Property for Vehicle Interior Module (자동차 인테리어 모듈의 BSR 소음과 음질 특성 연구)

  • Shin, Su-Hyun;Cheong, Cheol-Ung;Jung, Sung-Soo;Kang, Dae-Hwan
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.22 no.6
    • /
    • pp.550-555
    • /
    • 2012
  • Among the various elements affecting a customer's evaluation of automobile quality, buzz, squeak and rattle(BSR) have been considered to be major factors. In most vehicle manufacturers, the BSR problems are solved by find-fix method with the vehicle road test, mainly due to various excitation sources, complex generation mechanism and subjective response. To systematically tackle the BSR problems in early stage of the vehicle development cycle, these difficulties should be resolved. The aim of the present paper is to characterize the sound quality property of BSR noise that can be used to assess the subjective responses to BSR. The four sound metrics from Zwicker's sound quality parameter are computed for the signals recorded for eight BSR noise source regions localized by using the acoustic-field visualized results. Then, the jury test of BSR noise are performed. On the basis of the computed sound metrics and jury test result is evaluated to represent the harshness of BSR noise. It is expected that the developed BSR measuring system and sound quality properties can be used to reduce the automotive interior BSR noise in terms of subjective levels as well as objective levels.

The Quality Evaluation Model for Mobile RPG (모바일 RPG의 품질평가모델)

  • Kim, Giuhyoung;Lee, Nam-yong
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2014.10a
    • /
    • pp.457-460
    • /
    • 2014
  • As to the rapid development of mobile technology, the era of 1-person 1-smart phone has come. Also, the application of smart phone became the part of our life. Especially mobile RPG(Role Playing Game) has the biggest market and the largest number of users. There could be no precise quality assessment result, if quality evaluation model of PC RPG game were applied to the mobile RPG. Thus, it is time to focus on new quality evaluation model for mobile RPG with the great reflection of smart phone attributes. In this paper, based on ISO/IEC 9126, the international standard of software quality, quality evaluation elements for mobile RPG were deducted. Then metrics for validation of elements were redefined and new quality evaluation model was proposed.

  • PDF