• Journal of Korean Society for Quality Management
• /
• v.51 no.2
• /
• pp.185-202
• /
• 2023

Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Journal of Information Technology Services
• /
• v.10 no.4
• /
• pp.171-189
• /
• 2011

KAs information and knowledge are increasingly becoming more important in the knowledge-driven society, knowledge management, as a very important management paradigm, is securing firm position in private and public sectors. Complying with this paradigm, government-funded research institutes in science-technology sector are actively utilizing knowledge management by employing knowledge management system and evaluating its applications' performance. The purpose of this study is to develop evaluation items and measurement indices to rationally measure knowledge management performance of the government-funded research institutes and to verify the feasibility of applying these evaluation items and indices. To achieve this research goal, the evaluation model of knowledge management performance was constructed by reviewing and integrating the existing studies, and subsequently, evaluation areas, evaluation items, measurement indices were derived from this evaluation model. Also, the feasibility analysis on the evaluation items and measurement indices was performed by means of FGI(Focus Group Interview) with the knowledge management experts belonging to Korean government-funded institutions in science-technology sector. The implications of this study are as follows : in theoretical perspective, this study has proposed a criterion frame to evaluate knowledge management performance, and has rationally drawn evaluation items and measurement indices from the criterion frame. And in practical perspective, this study has improved the validity and practicality of the measurement indices, which can lead to more reasonable and easier evaluation of knowledge management performance of the government-funded research institutes.

• International Journal of Advanced Culture Technology
• /
• v.6 no.4
• /
• pp.131-142
• /
• 2018

This research examines the impact of teachers' self-evaluation on their classroom interactions with students. Changes in class behavior were analyzed by following two experienced middle school teachers for one semester of self-evaluation, comparing their classes at the beginning and end of the semester. A qualitative research method was adopted to take, a deeper look at the effect of changes in the teachers' in class actions. Both of the teachers reported positive effects of implementing self-evaluation on their teaching pedagogy, focusing specifically on their interactions with students when asking question and giving feedback. By the end of semester, they were asking broader questions that encouraged their students to engage in deeper thought and, when giving feedback, the class atmosphere was much brighter with better communication due to the positive reinforcement provided. This research supports research into ways to enhance teachers' expertise and improve their teaching via self-evaluation, centering on teachers' actions in the classroom.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.14 no.1
• /
• pp.177-177
• /
• 1989

This study concerns performance evaluation of the research-funding agencies focused on Korea Science and Engineering Foundation(KOSEF). On the basis of the constituents approach and the systems approach of organizational effectiveness theory, the evaluation items are derived reflecting generic characteristics of the research-funding agencies, and their priorities are determined using analytic hierarchy process(AHP). Three groups of constituents with differing interest and expections are identified, and their perceptions on the importance of the evaluation items are measured through questionnaire survey. Analyses show that the evaluation items perceived important by each constituency are significant different from one another. The implications of the result to the Government and KOSEF are discussed.

• Asia-Pacific Journal of Business
• /
• v.14 no.1
• /
• pp.1-19
• /
• 2023

Purpose - The purpose of this study was to examine the internal relevance between digital transformation, manipulation of asset evaluation and corporate M&A performance and further explores the impact path of manipulation of asset valuation on corporate M&A performance. Design/methodology/approach - This study based on the financial data of A-share listed companies in Shanghai and Shenzhen Stock Exchanges from 2013 to 2021. Findings - First, manipulation of asset evaluation is negatively correlated with M&A performance. Second, Digital transformation significantly weakens the negative correlation between manipulation of asset evaluation and corporate M&A performance. Third, The effectiveness of internal control plays a partially intermediary role in the process of manipulation of asset evaluation affecting M&A performance. Research implications or Originality - Enriching the existing literature on the subject, the study can also provide useful reference for improving the performance of corporate mergers and acquisitions, regulating asset valuation, promoting the digital transformation of enterprises and improving internal control mechanisms, with both theoretical and practical implications.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.9 no.4
• /
• pp.1086-1094
• /
• 2008

Today's small and medium-sized enterprises in technology development for future industrial growth engine. In addition evaluation of the technological competitiveness of companies and countries for R&D investment as a significant item evaluated constantly expanding, he said. However, R&D productivity to properly measure and assess the companies rarely. This paper examines the existing technology, technology assessment, the study's limitations, the small and medium-sized companies to complement the U-IT TE and PSMP Model suggested by the design environment, and technology-related companies in the technology, the ability to comprehensively assess and as a tool to leverage, technical analysis and quantitative evaluation and production from the completion of the Process Model, presented want to formalize.

• Journal of Information Technology Services
• /
• v.7 no.3
• /
• pp.175-198
• /
• 2008

The wide spread of the Internet has become a momentum to promote informatization, and thus individuals, organizations, and government bodies are competitively participating in this kind of new wave. Informatization enables us not only to circulate and utilize information without any limitation but also to maximize users' benefits and convenience. On the other hand, it brings about negative effects-security incidents such as cyber terror, Internet fraud and technology leakage, etc. Evaluation on security level should precede over all the others in order to minimize damage by security incidents since it diagnoses current status on security as it is and can be used as a guideline for appropriate security management. In this study, evaluation domains, items and indicators of information security to evaluate information security are theoretically developed on the basis of critically reviewing the major existing research. And then the coincidence level(content validity, ease and reliability of evaluation) of each evaluation indicators are empirically analyzed through performing the field study of 83 information security experts.

• Journal of Information Science Theory and Practice
• /
• v.3 no.4
• /
• pp.19-34
• /
• 2015

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.19 no.5
• /
• pp.613-617
• /
• 2016

Development-concerned parties, business managers and test evaluators have experienced conflicts among themselves due to the absence of standardized criteria for military electro-optical(EO) and infrared(IR) devices in test evaluation planning and evaluation phases. Therefore, establishment of objectified test and evaluation criteria for EO/IR devices is required. This paper applies South Korea's weather measurement average of minimum 15 km for visibility range, 3 bar from Johnson criteria for EO device and 4 bar from NATO's STANAG-4347 for IR device for target type, and 50 % probability for evaluation criteria, respectively. Based upon these criteria, this paper will establish suitable criteria that are improved for development weapon system in consideration of required capability of demanding forces and field environment.