• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.33 no.2
• /
• pp.63-71
• /
• 2010

The existing reliability evaluation models which have already developed by the corporations are so various because of using Maximum Likelihood Method. The existing models are very complicated owing to using system designing methods. Therefore, it is very difficult to utilize the existing models in business fields of many corporations. The purposes of this paper are as follows: The first purpose is to study the simple estimated Parameter to be easily utilized in the business fields of the corporations. The second purpose is to testify the simplification of the developed Parameter of estimated method by comparing the developed reliability evaluation model with the existing reliability evaluation models which are used in the business fields of the corporations.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.19 no.2
• /
• pp.21-43
• /
• 1994

Software acquisition involves purchase of new technology as well as the product itself. Consequently, evaluation of candidate packages or development contractors requires formal models that can objectively compare the candidates' technological characteristics with respect to user requirements. This paper proposes three technological evaluation models for software acquisition : 1) a structural model dthat organizes the technological factors to be evaluated, 2) a scoring model that quantifies the candidates' technological values, and 3) an organization model that orgnizes and assigns responsibilities to technical evaluators. Three models, initially built on expert surveys and later refined through interviews with opinion leaders, are primarily intended for governmental use : the Korean government is expected to use these models as the software acquisition standards starting in 1994.

• Journal of the Korean Society for information Management
• /
• v.40 no.3
• /
• pp.77-98
• /
• 2023

Large Language Models (LLMs) are becoming the major trend in the natural language processing field. These models were built based on research data, but information such as types, limitations, and risks of using research data are unknown. This research would present how to analyze and evaluate the LLMs that were built with research data: LLaMA or LLaMA base models such as Alpaca of Stanford, Vicuna of the large model systems organization, and ChatGPT from OpenAI from the perspective of research data. This quality evaluation focuses on the validity, functionality, and reliability of Data Quality Management (DQM). Furthermore, we adopted the Holistic Evaluation of Language Models (HELM) to understand its evaluation criteria and then discussed its limitations. This study presents quality evaluation criteria for LLMs using research data and future development directions.

• Management & Information Systems Review
• /
• v.4
• /
• pp.67-88
• /
• 2000

The purpose of this study is to present models for evaluation and selection of DataBase Management Systems(DBMS) suppliers. The major concern of management is that most decision problems have multiple, usually conflicting, criteria. The fuzzified multiple-objective programming models are given to accomodate the aspiration level and satisfaction level of decision makers. The proposed models are classified into two types, that is, pre-emptive priority and interpolated non-membership function model. Numerical examples illustrating each type of model are presented and the implications of these models are discussed.

• Journal of Korean Institute of Industrial Engineers
• /
• v.34 no.2
• /
• pp.190-204
• /
• 2008

Recently, it has been strongly required to establish a systematic and sustainable performance investigation and evaluation framework on governmental funding projects for IT small and medium-sized enterprises. In this paper, Data Envelopment Analysis (DEA) models are adopted for performance evaluation on governmental funding projects for IT small and medium-sized enterprises. A new data structure is proposed for the DEA performance evaluation. Generally, in using DEA models, DEA multipliers restriction is critical to achieve the reliability of DEA optimal solutions. Based on the outputs and inputs considered in this study, Acceptance Region (AR) constraints are generated and incorporated into the DEA models so as to improve the reliability of DEA efficiency scores. Associated with AR Type I (AR-I), AR Global Model (ARGM) constraints, DEA/ (AR-I, ARGM) models are designed and then sensitivity analysis follows investigating the robustness of DEA efficiency scores relating to AR constraints adjustment. Finally, a performance evaluation is illustrated regarding governmental direct funding projects from Ministry of Information and Communication (MIC) in Korea where each project unit (i.e. Decision Making Unit (DMU)) is determined whether it is efficient or not. By using DEA/(AR-I, ARGM) models designed in this paper, robustly efficient DMUs are gradually identified according to the successive AR constraints adjustment. Among 25 DMUs, results show that 6 DMUs such as B, E, G, Q, S, Y are determined as robustly efficient against AR constraints intermediate adjustment.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.525-533
• /
• 2015

The evolution of spectrum sharing technology enables the creation of many business scenarios and business models such as TV white space service. Business models considering spectrum sharing should guarantee economic feasibility for service providers and increasing benefit for service users. In addition, new business models should contribute to economic activation in the wireless telecommunication service industry. It is therefore necessary to design quantitative evaluation methods for selection of the best business models. The methods should reflect the various points of view of valuation. Our research addresses evaluation method for business models considering spectrum sharing. We define evaluation indicators to reflect the distinct characteristics of spectrum sharing. Also, we adopt analytic hierarchy process(AHP) to derive the weights of each indicator to evaluate business models considering spectrum sharing.

• Journal of Korean Society of Steel Construction
• /
• v.11 no.1 s.38
• /
• pp.23-31
• /
• 1999

The concept models are used for the analysis of joints because they are simple to use and accurate. The modeling parameters of concept models are estimated using the results of experiments performed on the joints. The concept joint models accurately describe the behavior of joints under the loads which are used in the experiments for the estimation of parameters. However, they may not be accurate under the loads which are not used in the experiments. The accuracy can be dependent on the loads which are used in the evaluation of accuracy. In this study, antioptimization is presented to find the worst possible loads, under which the accuracy of concept joint models can be evaluated. The procedure was applied to the accuracy evaluation of concept joint models in an isolated 3-D joint and 2-D joints of a vehicle structure.

• The Transactions of the Korea Information Processing Society
• /
• v.4 no.7
• /
• pp.1706-1718
• /
• 1997

The rapid increase in the use of many commercial software products has necessitated a systematic and objective method of their evaluation and selection. Our study focuses on the assignment of weights and choice of proper models. First, the weights of attributes are assigned consistently by using the analytic hierarchy process. Second, many models, which can be suitable for the structure of evaluation and selection for software product, are collected, categorized into two types of model, and compared in terms of their strength and weakness. The models involved are four compensatory models and seven noncompensatory models. Finally, they are analyzed through the application of specific software products(database data modelers) in terms of their attributes. Our study enhances the applicability of models to a variety of user requirement utilizing the evaluating procedure and applications.

• Journal of Technology Innovation
• /
• v.13 no.3
• /
• pp.175-196
• /
• 2005

This Paper examines analytic studies of the evaluation system used for evaluating government-supported R&D Institutes (GSRIs), and designs a new model for analyzing the evaluation system's effectiveness. The analytic models in existing studies use the meta evaluation and balanced scorecard (BSC) models. However, theses studies focused on the structure and elements of the evaluation system for examples, the appropriateness of the elements within the evaluation system and the balance of the evaluation index. Accordingly, the effectiveness of the GSRI evaluation system, that is, the evaluation's influence on GSRI performance improvement was not analyzed. This study uses the institution theory and contingency theory perspectives as related to government organization management to develop an analytical model of GSRI evaluation system effectiveness. The new model proposes an analytical approach for improving the effectiveness of the GSRI evaluation system in an institutionalized environment.

• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.149-156
• /
• 2013

In this study, the Model of Emotion Evaluation, an emotional analysis actively applied in environmental assessment, was divided into two parts, the abbreviated model and the inferential model, through pilot study and experiment. In addition, an analysis was conducted through the experiment on the attributes of the evaluation vocabularies of two additional types of representative models, the EPA Model and PAD Model, and the results show a huge difference in the development approach and lexical constitution of the two models. It was also identified through factor analysis that the vocabularies were abbreviated according to the respective models. Similarity relationships were analyzed using multidimensional scaling and the results show that mutual relationship was established to some degree. Based on this, we can conclude that, rather than a biased use of the Model of Emotion Evaluation in emotion evaluation, a more objective image analysis is possible by analyzing the characteristics of the model before applying it. In this study, the evaluation target was confined only to the environmental assessment of streetscape and continuous research on the Model of Emotion Evaluation that allows for the comparison of evaluation models in various areas is needed.