• Journal of the Korea Society for Simulation
• /
• v.1 no.1
• /
• pp.77-86
• /
• 1992

In this paper, we study validation test methods of DEVSA(Descrete Event system Specification) models using SPN(Stochastic Petri Net) models. We discuss conventional validation test methods, by which DEVS models can be transformed to SPN models, by reviewing the features of DEVS model. Based on the model transformation method, we define a new homogeneous function for validation test and suggest a new validation test method of DEVS models using the property of SPN models and the new homogeneous function.

• Journal of the Korea Society for Simulation
• /
• v.18 no.4
• /
• pp.185-195
• /
• 2009

As most systems get more complicated, system analysis using simulation has been taken notice of. One of the core parts of simulation analysis is validation of a simulation model, and we can identify how well the simulation model represents the real system with this validation process. The difference between input data of two systems has an effect on the comparison between a simulation model and a real system at validation stage, and the result with such difference is not enough to ensure high credibility of the model. Accordingly, in this paper, we construct a model based on Trace-driven simulation which uses identical input data with the real system. On the other hand, to validate a model by each class, not by an unique statistic, we validate the model using a metric transformed from F-measure which estimates performance of a classifier in data mining field. Finally, this procedure enables precise validation process of a model, and it helps modification by offering feedback at the validation phase.

• KEPCO Journal on Electric Power and Energy
• /
• v.3 no.2
• /
• pp.89-97
• /
• 2017

The substation is a critical node in the power network where power is transformed in the power generation, transmission and distribution system. The IEC 61850 is a global standard which proposes efficient substation automation by defining interoperable communication and data modelling techniques. In order to achieve this level of interoperability and automation, the IEC 61850 (Part 6) defines System Configuration description Language (SCL). The SCL is an XML based file format for defining the abstract model of primary and secondary substation equipment, communications systems and also the relationship between them. It enables the interoperable exchange of data during substation engineering by standardizing the description of applications at different stages of the engineering process. To achieve the seamless interoperability, multi-vendor devices are required to adhere completely to the IEC 61850. This paper proposes an efficient algorithm required for verifying the interoperability of multi-vendor devices by checking the adherence of the SCL file to specifications of the standard. Our proposed SCL validation algorithm consists of schema validation and other functionalities including information model validation using UML data model, the Vendor Defined Extension model validation, the User Defined Rule validation and the IED Engineering Table (IET) consistency validation. It also integrates the standard UCAIUG (Utility Communication Architecture International Users Group) Procedure validation for quality assurance testing. Our proposed algorithm is not only flexible and efficient in terms of ensuring interoperable functionality of tested devices, it is also convenient for use by system integrators and test engineers.

• 한국경영정보학회:학술대회논문집
• /
• 2007.06a
• /
• pp.557-561
• /
• 2007

Along with the significance of information systems in today s global business operation, the significance of information systems control and audit is ever increasing in the effort to secure accuracy and integrity of vital business data. A study is undertaken to integrate Food and Drug Administration computerized systems validation regulations. Securities & Exchange Commission Sarbanes-Oxley Act of 200 and other significant regulations, and lastly, People Capability Maturity Model into one comprehensive information system validation model. The initial benefits to this comprehensive model are convenience, time-saving, and synchronization of the regulations. An organization that is striving for a high level of quality system in its essential operating areas of organization may opt for this model. After the complete development of the model, a field test would be scheduled to test its efficacy and validity.

• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.55 no.11
• /
• pp.485-491
• /
• 2006

In this paper, we study the problem of model selection for Support Vector Machine(SVM) predictor for short-term load forecasting. The model selection amounts to tuning SVM parameters, such as the cost coefficient C and kernel parameters and so on, in order to maximize the prediction performance of SVM. We propose that Cross-Validation method can be used as a model selection algorithm for SVM-based load forecasting technique. Through the various experiments on several data sets, we found that the difference between the prediction error of SVM using Cross-Validation and that of ideal SVM is less than 5%. This shows that SVM parameters for load forecasting can be efficiently tuned by using Cross-Validation.

• Journal of Digestive Cancer Research
• /
• v.11 no.3
• /
• pp.157-164
• /
• 2023

Prediction is a significant topic in clinical research. The development and validation of a prediction model has been increasingly published in clinical research. In this review, we investigated analytical methods and validation schemes for a clinical prediction model used in digestive cancer research. Deep learning and logistic regression, with split-sample validation as an internal or external validation, were the most commonly used methods. Furthermore, we briefly introduced and summarized the advantages and disadvantages of each method. Finally, we discussed several points to consider when conducting prediction model studies.

• Journal of Aerospace System Engineering
• /
• v.12 no.4
• /
• pp.1-8
• /
• 2018

The state of registry issues a type certificate validation (TCV) based on the satisfactory evidence that the product (aircraft, engine, and propeller) is in compliance with the appropriate airworthiness requirements. The Korean government performs an evaluation to determine whether the product complies with Korean airworthiness standards for issuing TCV according to the Korean aviation safety law. Recently, the Validation Principles Working Group (VPWG) has developed a risk-based model for validation of civil aeronautical products. Also, VPWG proposed to incorporate this validation model into the corresponding ICAO Standards and Recommended Practices and guidance material. In this paper, we have reviewed the validation model and discussed improvements in the validation process.

• Journal of the Korea Society for Simulation
• /
• v.19 no.1
• /
• pp.153-160
• /
• 2010

Most part of errors in software development process are included during the stage of requirements definition and design. And correction or elimination of errors from those stages requires much more efforts and costs than those from the later part of software development process. However, despite of the importance of the validation of requirement definition and design stages, several kinds of problem have made it hard to be done successfully. Therefore, in this paper, we introduce a novel validation process for the preliminary design stage. The validation process is based on simulations of model and it can be used to validate requirements and model simultaneously. Models in the validation process will take only the behavior of software and be built on Ptolemy framework. The usability of our validation process is confirmed with a case study over DNS system environment. And the result of simulation shows well-known errors or vulnerabilities can be found with simulations of model which has the behavior of software. This means our validation process can be used as a process to validate requirements and models during the early stage of software development process.

• Journal of Environmental Impact Assessment
• /
• v.21 no.6
• /
• pp.893-901
• /
• 2012

Aircraft noise model such as FAA Integrated Noise Model(INM) has recently been used for forecasting the impact of noise in a residential area near an airport and quantifying the effect of various options for noise mitigation. The noise modeling should be reliable and precise in order to ensure the quality of the results provided. In this study, the validation of the noise levels simulated by the INM against measurement data recorded continuously at multiple monitoring sites was discussed. As a result of validation, the quality of the input data used as a fixed point profiles for the INM was enhanced. The noise contour maps were designed as a way to evaluate the aircraft noise of the vicinity of the airfield. The results of this study indicate that the validation of aircraft noise model by the measurement data would be required for the accurate assessment of the aircraft noise levels.

• Journal of the Korea Society for Simulation
• /
• v.19 no.2
• /
• pp.127-135
• /
• 2010

The validation of a simulation model is a key to demonstrate that the simulation model is reliable. However, among various validation methods have been introduced, it is very poor to research the specific techniques for the time series data. Therefore, this paper suggests the methodology to verify the simulation using the time series data by Wavelet Transform, Power Spectrum and Coherence. This method performs 2 steps as followed. Firstly, we get spectrum using the Wavelet transform available for non-periodic signal separation. Secondly, we compare 2 patterns of output data from simulation model and actual system by Coherence Analysis. As a result of comparing it with other validation techniques, the suggested way can judge simulation model accuracy more clearly. By this way, we can make it possible to perform the simulation validation test under various situations using detailed sectional validation method, which has been impossible using a single statistics for the whole model.