• Title/Summary/Keyword: validation metric

Search Result 24, Processing Time 0.022 seconds

(A Study on Software Quality Metric Methodology and Application for Software Quality Measurement) (소프트웨어 품질측정을 위한 소프트웨어 품질매트릭 방법론과 적용 연구)

  • 이성기
    • Journal of the military operations research society of Korea
    • /
    • v.22 no.2
    • /
    • pp.90-112
    • /
    • 1996
  • Research issues in software engineering in recent may be object oriented methodology and software quality. Since Halstead has proposed metric-software science in 1977, software quality area has been studied in steady but inactively until 1980s. As international standards such as ISO 9000-3, 9126 were enacted in 1990s early, interest in software quality is increased but many problems such as how to validate metric, measure quality or apply metric are remained. This paper proposes software quality metric methodology which software developer or project manager can use in measuring quality and validating metric during software development. The methodology is classified by several phases: establishment of quality requirement, identification of quality metric, data collection, metric implementation, metric validation. In order to show its applicability, test program, metrics and data are applied to each phase of the methodology. Consideration of this methodology as a methodology for software quality measurement similar to development methodology for software development is needed.

  • PDF

Theoretical Validation of Inheritance Metric in QMOOD against Weyuker's Properties

  • Alharthi, Mariam;Aljedaibi, Wajdi
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.7
    • /
    • pp.284-296
    • /
    • 2021
  • Quality Models are important element of the software industry to develop and implement the best quality product in the market. This type of model provides aid in describing quality measures, which directly enhance the user satisfaction and software quality. In software development, the inheritance technique is an important mechanism used in object-oriented programming that allows the developers to define new classes having all the properties of super class. This technique supports the hierarchy design for classes and makes an "is-a" association among the super and subclasses. This paper describes a standard procedure for validating the inheritance metric in Quality Model for Object-Oriented Design (QMOOD) by using a set of nine properties established by Weyuker. These properties commonly using for investigating the effectiveness of the metric. The integration of two measuring methods (i.e. QMOOD and Weyuker) will provide new way for evaluating the software quality based on the inheritance context. The output of this research shows the extent of satisfaction of the inheritance metric in QMOOD against Weyuker nine properties. Further results proved that Weyker's property number nine could not fulfilled by any inheritance metrics. This research introduces a way for measuring software that developed using object-oriented approach. The theoretical validation of the inheritance metric presented in this paper is a small step taken towards producing quality software and in providing assistance to the software industry.

A Usability Assessment Metric for Ubiquitous Services: Quantification of the Interactivity Attribute in Inter-personal Services

  • Lee, Joo-Hwan;Song, Joo-Bong;Yun, Myung-Hwan
    • Journal of the Ergonomics Society of Korea
    • /
    • v.31 no.1
    • /
    • pp.63-76
    • /
    • 2012
  • Objective: The main objective of this study is to propose a user-centered assessment metric for ubiquitous services. Background: As the ubiquitous era took off, the interactions between ubiquitous services and users have come to take an important position. It is essential to conceptualize a new assessment model that considers human-system interaction capability with a user-centered design perspective. Method: The evaluation model for the interactivity of ubiquitous service was approached from the concept of usability and inter-personality of services. As a validation study, suggested assessment metric was utilized to evaluate the u-Home service. Priority weighting of each assessment metric was derived using the quantification type-I analysis. Results: To evaluate interactivity, this study suggested a quantitative metric for user testing performed after classifying the interactivity characteristics to contextualization; ubiquity; user experience; and service capability. Conclusion: This study suggest the metric for the ubiquitous service that are experienced in real life, and introduced the concept of ubiquitous service interactivity. Application: The suggested evaluation metric can be used to evaluate interactivity level of ubiquitous service and identify the potential problem and usability requirements at the early stage of service development.

Validation of Lightscape as Outdoor Lighting Simulation with ProMetric (ProMetric을 이용한 Lightscape의 경관조명 시뮬레이션 유효성 검증)

  • Yi, So-Mi;Choi, Yoon-Seok;Kim, Jeong-Tai
    • Proceedings of the Korean Institute of IIIuminating and Electrical Installation Engineers Conference
    • /
    • 2004.11a
    • /
    • pp.43-48
    • /
    • 2004
  • 야간 경관조명을 계획 및 평가하는데 필요한 물리량의 측정기법이나 컴퓨터 시뮬레이션의 유효성에 대한 검증이 미흡한 상황이다. 이에 본 연구 경관조명에 많이 사용되는 대표적 프로그램인 Lightscape 3.2의 유효성을 Radiant Imaging ProMetric 1400을 이용하여 검증한 것이다. 교량의 7개 부분에 대한 평균 휘도값을 비교한 결과 Radiant Imaging ProMetric 1400에 의한 물리량 측정값과 Lightscape 3.2의 컴퓨터 시뮬레이션 값 사이에는 상대오차율이 평균 8.3%로 나타나, Lightscape 3.2가 경관조명의 사전 시뮬레이션 도구로써 매우 유효한 것으로 나타났다.

  • PDF

Assessing the Metric to Measuring Land-Use Change Suitability (토지 이용 변화 예측 모형의 정확도 검정을 위한 통계량 연구)

  • Kim, Oh Seok
    • Journal of the Economic Geographical Society of Korea
    • /
    • v.16 no.3
    • /
    • pp.458-471
    • /
    • 2013
  • This paper addresses the limitation of a map comparison metric entitled Figure of Merit through employing a simple land change model. The metric was originally designed to overcome limitations of other existing statistics, such as Kappa, when assessing predictive accuracy of land change models. A series of comparisons between null and predicted outcomes at multiple resolutions as well as a multi-resolution Figure of Merit analysis techniques of validation are compared for spatially segregated calibration and validation datasets. The Figure of Merit at the null resolution in this paper was 57%, although future research must be done to determine if this was simply a coincidence. A Figure of Merit greater than 50% would seem to represent a "Resolution of Merit" in that the Figure of Merit at that resolution becomes greater than the error. Thus, these two metrics should be used in tandem to assess predictive accuracy of a land change model.

  • PDF

A Metrics Set for Measuring Software Module Severity (소프트웨어 모듈 심각도 측정을 위한 메트릭 집합)

  • Hong, Euy-Seok
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.1
    • /
    • pp.197-206
    • /
    • 2015
  • Defect severity that is a measure of the impact caused by the defect plays an important role in software quality activities because not all software defects are equal. Earlier studies have concentrated on defining defect severity levels, but there have almost never been trials of measuring module severity. In this paper, first, we define a defect severity metric in the form of an exponential function using the characteristics that defect severity values increase much faster than severity levels. Then we define a new metrics set for software module severity using the number of defects in a module and their defect severity metric values. In order to show the applicability of the proposed metrics, we performed an analytical validation using Weyuker's properties and experimental validation using NASA open data sets. The results show that ms is very useful for measuring the module severity and msd can be used to compare different systems in terms of module severity.

A Study on Crowd Evacuation Simulation Validation Method using The Safeguard Validation Data Set (SGVDS) 1 and 2 (The Safeguard Validation Data Set (SGVDS) 1과 2를 활용한 군중 대피 시뮬레이션 검증 방안에 관한 연구)

  • Seunghyun Lee;Jae Min Lee;Hyuncheol Kim
    • Journal of the Korean Society of Safety
    • /
    • v.39 no.3
    • /
    • pp.50-59
    • /
    • 2024
  • In recent years, building architecture has become increasingly complex and larger in scale to accommodate many people. In densely populated facilities, the interiors are becoming more intricate and high-rise, with narrow corridors, hallways, and stairs. This poses challenges for evacuating occupants in case of emergencies such as fires, making it crucial to assess the evacuation safety in advance. In evacuation safety research, there are significant limitations to theoretical studies owing to their association with crowd behavior and human evacuation characteristics, as well as the risks associated with experiments involving human participants. Consequently, evacuation experiments conducted using simulation-based methodologies are gaining recognition worldwide. However, crowd simulations face validation difficulties because of variations in crowd movement and evacuation characteristics across different cases and scenarios, as well as the challenge of accurately reflecting human characteristics during evacuations. In this study, we investigated validation methods for evacuation simulations using the SAFEGUARD validation data set (SGVDS) provided by the University of Greenwich, UK. The SGVDS collects data on crowd evacuations through actual evacuation tests conducted on ColorLine's large RO-PAX ferry and Royal Caribbean International's cruise ships. The accuracy of the crowd simulations can be validated by comparing SGVDS and crowd simulation results. This study will contribute to the development of highly accurate crowd simulations by verifying various crowd simulations.

Validation Technique of Trace-Driven Simulation Model Using Weighted F-measure (가중 F 척도를 이용한 Trace-Driven 시뮬레이션 모델의 검증 방법)

  • HwangBo, Hoon;Cheon, Hyeon-Jae;Lee, Hong-Chul
    • Journal of the Korea Society for Simulation
    • /
    • v.18 no.4
    • /
    • pp.185-195
    • /
    • 2009
  • As most systems get more complicated, system analysis using simulation has been taken notice of. One of the core parts of simulation analysis is validation of a simulation model, and we can identify how well the simulation model represents the real system with this validation process. The difference between input data of two systems has an effect on the comparison between a simulation model and a real system at validation stage, and the result with such difference is not enough to ensure high credibility of the model. Accordingly, in this paper, we construct a model based on Trace-driven simulation which uses identical input data with the real system. On the other hand, to validate a model by each class, not by an unique statistic, we validate the model using a metric transformed from F-measure which estimates performance of a classifier in data mining field. Finally, this procedure enables precise validation process of a model, and it helps modification by offering feedback at the validation phase.

Development of an Optimal Convolutional Neural Network Backbone Model for Personalized Rice Consumption Monitoring in Institutional Food Service using Feature Extraction

  • Young Hoon Park;Eun Young Choi
    • The Korean Journal of Food And Nutrition
    • /
    • v.37 no.4
    • /
    • pp.197-210
    • /
    • 2024
  • This study aims to develop a deep learning model to monitor rice serving amounts in institutional foodservice, enhancing personalized nutrition management. The goal is to identify the best convolutional neural network (CNN) for detecting rice quantities on serving trays, addressing balanced dietary intake challenges. Both a vanilla CNN and 12 pre-trained CNNs were tested, using features extracted from images of varying rice quantities on white trays. Configurations included optimizers, image generation, dropout, feature extraction, and fine-tuning, with top-1 validation accuracy as the evaluation metric. The vanilla CNN achieved 60% top-1 validation accuracy, while pre-trained CNNs significantly improved performance, reaching up to 90% accuracy. MobileNetV2, suitable for mobile devices, achieved a minimum 76% accuracy. These results suggest the model can effectively monitor rice servings, with potential for improvement through ongoing data collection and training. This development represents a significant advancement in personalized nutrition management, with high validation accuracy indicating its potential utility in dietary management. Continuous improvement based on expanding datasets promises enhanced precision and reliability, contributing to better health outcomes.

Detecting Abnormal Human Movements Based on Variational Autoencoder

  • Doi Thi Lan;Seokhoon Yoon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.15 no.3
    • /
    • pp.94-102
    • /
    • 2023
  • Anomaly detection in human movements can improve safety in indoor workplaces. In this paper, we design a framework for detecting anomalous trajectories of humans in indoor spaces based on a variational autoencoder (VAE) with Bi-LSTM layers. First, the VAE is trained to capture the latent representation of normal trajectories. Then the abnormality of a new trajectory is checked using the trained VAE. In this step, the anomaly score of the trajectory is determined using the trajectory reconstruction error through the VAE. If the anomaly score exceeds a threshold, the trajectory is detected as an anomaly. To select the anomaly threshold, a new metric called D-score is proposed, which measures the difference between recall and precision. The anomaly threshold is selected according to the minimum value of the D-score on the validation set. The MIT Badge dataset, which is a real trajectory dataset of workers in indoor space, is used to evaluate the proposed framework. The experiment results show that our framework effectively identifies abnormal trajectories with 81.22% in terms of the F1-score.