• International journal of advanced smart convergence
• /
• v.12 no.3
• /
• pp.51-60
• /
• 2023

This study focuses on the design of a GPT-based system for relatively rapid technology credit assessment of SMEs. This system addresses the limitations of traditional time-consuming evaluation methods and proposes a GPT-based model to comprehensively evaluate the technological capabilities of SMEs. This model fine-tunes the GPT model to perform fast technical credit assessment on SME-specific text data. Also, It presents a system that automates technical credit evaluation of SMEs using GPT and LLM-based chatbot technology. This system relatively shortens the time required for technology credit evaluation of small and medium-sized enterprises compared to existing methods. This model quickly assesses the reliability of the technology in terms of usability of the base model.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.28 no.4
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.4
• /
• pp.819-839
• /
• 2009

Proposed increases to the government's R&D budget should be discussed based on merits of meeting efficiency and effectiveness criteria. The evaluation of the national R&D budget and related programs are performed in two areas: a system of R&D budget coordination and allocation, and a system of R&D program performance. This paper mainly focuses on the operational areas of R&D budget evaluation system with a focus on their impact to efficiency and effectiveness. The core view point for a R&D budget evaluation system involves two directions: Firstly, to detail the relationships between the later stage (ex. post) activities such as, program survey, analysis, and program performance evaluation, with the budget evaluation. Secondly, to critically oversee all R&D coordination procedures with a different perspective. Budgeting is generally known as a serial process of policy making, planning and executing. It is highly desirable for the budget to be allocated to, and spent by, specific programs as planned, and that each plan be aligned with a specific policy. As such, a strong relevance between the program structure and budget code system is integral to successful execution. It should be performed using a decision making system which closely examines the link between policy and budget. It is also recommended that systematic relationships be maintained among budget coordination and allocation, performance evaluations of policy and program levels, and program survey and analysis system, and that their operational schedule should be reviewed comprehensively as a one integrated system. The National Science and Technology Council is expected to play a major and practical role as the center of policy planning and should be supported by the objective and unbiased system which covers overall process from policy making to program evaluation. Finally, increased utilization of contents, timely program survey and analysis, and accurate of activity scheduling of budget coordination and allocation, and diligent program performance evaluation all contribute towards a more efficient and effective overall evaluation system.

• The Korean Journal of Archival Studies
• /
• no.65
• /
• pp.151-197
• /
• 2020

The records management evaluation system is a system operated by the National Archives of Korea since 2007 based on the 「Public Records Management Act」. As the environment of public records management changes dramatically, there is a growing perception that fundamental improvement is necessary in the operation of this evaluation system. In particular, it is required that the most emphasized area is the customized methods based on the type and characteristics of the institutions. This study focused on the self-evaluation method, which aims to strengthen the autonomous evaluation capability of institutions as a new records management evaluation system in public institutions. In particular, the needs to change toward the self-evaluation method is described in relation to the diversity of the institutions to be evaluated, the specificity of the organizational structure of the archives, and the hierarchy and individuality of the institutions. A self-evaluation system (draft) was designed by which an institution diagnoses the records management work by itself, which aims to improve the level of performance. It also covered the development of evaluation items and indicators, the step-by-step application, and the legal and operational aspects to run the records management evaluation system in phases in public records management practices.

• Journal of Digital Convergence
• /
• v.11 no.9
• /
• pp.45-54
• /
• 2013

Currently, the domestic nursing information system software products are being developed competitively with the participation of many companies, generating quantitative development with high value added. However, it is true that the study that concurrently adds qualitative enhancements to such quantitative development has been inadequate. In order to secure international competitiveness in the field of nursing information system software, it is necessary to establish quality requirements on this system, and along with it, establish an evaluation system on the nursing information system software products. The purpose of this study is to analyze the accompaniment and technology of the nursing information system, and by identifying the requirements, establish test and evaluation system of the said system.

• International Journal of Highway Engineering
• /
• v.14 no.6
• /
• pp.75-84
• /
• 2012

PURPOSES : This paper aims to improve the evaluation method of the Level of Service(LOS) for urban streets presented by the current Korean Highway Capacity Manual(KHCM) and suggest its utilization plan as a part of the methods to evaluate the sustainability of a transportation policy. METHODS : This paper carried out a research in 3 steps to develop a new evaluation method. First of all, this paper reviewed the previous studies related to the LOS of urban streets and the socially requested items for a sustainable transportation system. Then this paper derived an index and weight through expert questions to select an evaluation index. Lastly, this paper compared the results according to the existing evaluation methods with the new evaluation methods through case studies. This paper used an Analytic Hierarchy Process(AHP) for importance analysis and weight selection between new evaluation items and indices, and applied a Grey System Theory(GST) for a synthetic and integrated evaluation between the selected evaluation indices. RESULTS : As a result of evaluating the LOS according to the existing evaluation methods and the integrated evaluation methods using a GST through case studies, it was analyzed that new methods' results are less than or equal to the existing evaluation methods; and as a result of applying a weight between evaluation indices according to AHP, it was noticed that the total score seems to rise more when the LOS in the existing evaluation is calculated lower. It was analyzed that the LOS calculated by reflecting the newly established evaluation items and the importance between indices in this study has difference from the LOS of the existing urban streets. CONCLUSIONS : It is expected that this evaluation method can diagnose the current conditions when establishing a future sustainable traffic system and can be used for the measurement of the sustainability effects of the improvement plans and so on.

• Journal of the Korea Society for Simulation
• /
• v.27 no.2
• /
• pp.61-69
• /
• 2018

As the technology of information and communication has developed over recent years, an embedded system is applied in multiple industries and becomes more complicated. For this reason, embedded system development cost and time are also increased. For decreasing the cost and time, this paper suggests requirement evaluation method for concurrent development of an embedded system based on Discrete Event System(DEVS) Formalism. This paper proposes a method of describing the requirements specification in the form of DEVS atomic model. Also, the paper proposes the evaluator model that compares evaluation target system and the requirements model that is an implementation of requirement specification and proposes the evaluation method using them. In addition, we propose a method to utilize the requirement model created for requirements evaluation in the concurrent development process of the embedded system. As the case study, this paper proceeds requirement evaluation of Kinect depth data processing system.

• Spatial Information Research
• /
• v.19 no.6
• /
• pp.1-10
• /
• 2011

The evaluation systems on the National Spatial Information Policy(NSIP) has been changed, since the Establishment and Use of the National Geographic Information System Act(NGIS Act, 2000) was abolished and the National Spatial Data Infrastructure Act(NSDI Act, 2009) was enacted. As compared to the NGIS Act, the policy evaluation systems for National Spatial Information are regarded as unified and centralized. However, some argue that the claim of budget and the legal feasibility of the NSIP was weakened. Given the different views on the two laws, this study aims at analyzing the changes in the evaluation system by comparing the NGIS Act and the NSDI Act. A Comparative Analysis framework is employed. The subjects of the comparative analysis are evaluation mechanism, evaluator, evaluation target and range, after-assessment utilization, and agent. In order to improve the effectiveness of the evaluation system, it is recommended that the clarification of evaluation purposes, institutional enhancement for evaluation agency, the development of evaluation indexes, the combination of top-down approach and bottom -up approach, and the increased linkage between budget and evaluation result.

• Journal of Digital Convergence
• /
• v.13 no.5
• /
• pp.251-257
• /
• 2015

Intrusion protection system is a security system that stop abnormal traffics through automatic activity by finding out attack signatures in network. Unlike firewall or intrusion detection system that defends passively, it is a solution that stop the intrusion before intrusion warning. The security performance of intrusion protection system is influenced by security auditability, user data protection, security athentication, etc., and performance is influenced by detection time, throughput, attack prevention performance, etc. In this paper, we constructed a convergence performance evaluation model about software product evaluation to construct the model for security performance evaluation of intrusion protection system based on CC(Common Criteria : ISO/IEC 15408) and ISO international standard about software product evaluation.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.229-237
• /
• 2023

In this research, a new Test and Evaluation (T&E) procedure for defense AI systems is proposed to fill the existing gap in established methodologies. This proposed concept incorporates a data-based performance evaluation, allowing for independent assessment of AI model efficacy. It then follows with an on-site T&E using the actual AI system. The performance evaluation approach adopts the project promotion framework from the defense acquisition system, outlining 10 steps for R&D projects and 9 steps for procurement projects. This procedure was crafted after examining AI system testing standards and guidelines from both domestic and international civilian sectors. The validity of each step in the procedure was confirmed using real-world data. This study's findings aim to offer insightful guidance in defense T&E, particularly in developing robust T&E procedures for defense AI systems.