• Journal of Technology Innovation
• /
• v.13 no.3
• /
• pp.175-196
• /
• 2005

This Paper examines analytic studies of the evaluation system used for evaluating government-supported R&D Institutes (GSRIs), and designs a new model for analyzing the evaluation system's effectiveness. The analytic models in existing studies use the meta evaluation and balanced scorecard (BSC) models. However, theses studies focused on the structure and elements of the evaluation system for examples, the appropriateness of the elements within the evaluation system and the balance of the evaluation index. Accordingly, the effectiveness of the GSRI evaluation system, that is, the evaluation's influence on GSRI performance improvement was not analyzed. This study uses the institution theory and contingency theory perspectives as related to government organization management to develop an analytical model of GSRI evaluation system effectiveness. The new model proposes an analytical approach for improving the effectiveness of the GSRI evaluation system in an institutionalized environment.

• Journal of Engineering Education Research
• /
• v.15 no.4
• /
• pp.76-84
• /
• 2012

The purpose of this study is to develop an evaluation criteria for students' portfolios in an annual intramural contest. To accomplish the purpose, evaluation categories and their questions were developed after previous literature, ABEEK's evaluation guidelines, and eight Universities' evaluation forms were analyzed. Furthermore, experts' validity tests were completed by showing that the evaluation criteria form was validated with a mean score of 4.24. Also, the inter-rater reliability was turned out with a high score of .86. The interview results by evaluators of students' portfolios made the final version of evaluation criteria form include five evaluation criteria categories and their allotted score portions: overall organization(40), personal information(15), certificates and awards(5), curriculum(15), and extra-curriculum(15). The importance of overall organization was discussed from the perspectives of teachers as well as students.

• Perspectives in Nursing Science
• /
• v.1 no.1
• /
• pp.50-65
• /
• 2004

Despite the new wave of diverse philosophical thoughts in nursing, the criteria for theory evaluation rarely incorporate the new thoughts in its realm. Especially, feminist thoughts, which have contributed to the development of nursing knowledge through incorporating diversities and complexities of nursing phenomenon and reflecting social, cultural, and historical contexts surrounding nursing encounters, were rarely incorporated into the evaluation criteria. In this paper, a feminist approach to theory evaluation is proposed based on a critical analysis of the existing evaluation criteria. First, a historical review of feminist thoughts is provided, and feminist principles across diverse groups of thinking within feminism are discussed. Then, theory evaluation criteria are historically analyzed and critiqued while considering the feminist principles. The critical points found in the currently available theory evaluation criteria include: (a) the evaluation criteria are based on objectivity, (b) they are ignoring gender differences; (c) cultural differences tend not to be seriously considered; and (d) contexts surrounding nursing phenomenon are rarely considered. Based on the critical points, four additional components for theory evaluation are proposed. The components are: (a) respect for subjectivity; (b) historical and sociopolitical contextual considerations; (c) gender sensitivity; (d) cultural competence; and (e) blueprint for action.

• The Journal of Fisheries Business Administration
• /
• v.48 no.1
• /
• pp.31-49
• /
• 2017

This study focuses on developing a theoretical framework for evaluating Operational Performance of the Marine Forest Creation project on a balanced and comprehensive perspective by using BSC, AHP, and IPA. Also, the purpose of this study is empirically to analyze operational performance of the project and to suggest the future improvement plan. For this purpose, We will first determine the critical success factors(CSF) and key performance indicators(KPI) required for evaluating the performance of the Marine Forest Creation project from the four perspectives of BSC. And, After determining the weight for each of CSF, KPI, and four perspectives of BSC by using AHP, we will measure the project performance. We will also conduct IPA analysis to propose the direction of improvement of the Marine Forest Creation project. The results of this study are as follows. First, this study has drawn 8 critical success factors and 16 key performance indicators for four BSC perspectives based on the theoretical considerations and expert interview survey. Second, as a result of deriving relative importance of BSC perspectives using AHP, customer perspective was the highest, followed by financial perspective, learning and growth perspective, and internal process perspective. Third, as the results of analyzing the importance and performance of BSC perspectives using IPA, customer perspective was the maintenance reinforcement category, financial perspective was the key improvement category, internal process perspective and learning and growth perspective were gradual improvement category. This study has a great academic significance in terms of BSC first tried to evaluate the performance of the Marine Forest Creation project. The results of this study are expected to lead to various discussions for a balanced and comprehensive verification of Marine Forest Creation project performance.

• Osong Public Health and Research Perspectives
• /
• v.9 no.6
• /
• pp.363-363
• /
• 2018

• Journal of The Korean Association of Information Education
• /
• v.18 no.4
• /
• pp.541-548
• /
• 2014

The goal of this study is to suggest evaluation tools to assess computational thinking(CT) skills in primary robot-based programs. In addition, the researcher has expanded its evaluation approaches to include interpersonal competencies from the socio-cultural perspectives, not just focusing on intrapersonal competencies. In order to pursue the research goal, one-semester robots programs for the fifth graders were designed, and evaluation tools including a learners' CT competencies survey and a learning process monitoring rubric were developed. The results of this study are meaningful because it has expanded the evaluation approaches to connect to the concepts of CT and to include interpersonal aspects from the socio-cultural perspectives.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.10
• /
• pp.1301-1308
• /
• 2016

Internet traffic identification is an essential preliminary step for stable service provision and efficient network management. The payload signature-based-classification is considered as a reliable method for Internet traffic identification. But its performance is highly dependent on the number and the structure of signatures. If the numbers and structural complexity of signatures are not proper, the performance of payload signature-based-classification easily deteriorates. Therefore, in order to improve the performance of the identification system, it is necessary to regulate the numbers of the signature. In this paper, we propose a novel signature quality evaluation method to decide which signature is highly efficient for Internet traffic identification. We newly define the signature quality evaluation criteria and find the highly efficient signature through the method. Quality evaluation is performed in three different perspectives and the weight of each signature is computed through those perspectives values. And we construct the signature map(S-MAP) to find the highly efficient signature. The proposed method achieved an approximately fourfold increased efficiency in application traffic identification.

• Journal of the Korean Home Economics Association
• /
• v.38 no.5
• /
• pp.1-14
• /
• 2000

The purpose of this study is to develop and evaluate a remarriage preparation program. Based on the system theory, strong family perspective, care & justice perspectives, and empirical research in this field,4 session remarriage preparation program is developed. Target population of this program is persons who remarry and persons who marry with remarried partner This program is evaluated in terms of the level of remarriage preparation and level of changing attitude after education in terms of self-esteem, cognition & knowledge of parent behavior in the remarried family, object evaluation of their future remarriage life. Future research, theoretical and practical implications are added.

• Journal of the Korean Data and Information Science Society
• /
• v.18 no.2
• /
• pp.401-409
• /
• 2007

This paper addresses a performance evaluation model for ERP system's implementation using Analytic Network Process (ANP) technique. In this study, the performance variables are identified as the perspectives of cost, business process, systems operation, and change management, respectively. The empirical study also investigated factors that affect the performance variables to find out the causal relationship between them using the ANP approach. The data for the empirical analysis were collected from manufacturing companies that have implemented ERP systems. The research findings indicate the proposed model is powerful in proposing that the indirect relationship between influencing factors and managerial effectiveness, mediated by employee satisfaction, is an important one.

• Journal of Internet Computing and Services
• /
• v.10 no.3
• /
• pp.159-172
• /
• 2009

The purposes of this study were to identify factors affecting the quality of universities' e-learning contents from the perspectives of learners and to find out specific solutions for improving them. To achieve these goals, research questions were established as follows: 1) What factors were influencing the quality of universities' e-learning contents, and how were learners perceived about each factor(by its importance and satisfaction)? 2) Were there any differences on the learners' perceptions about each factor(by its importance and satisfaction)? 3) What were any specific ways to enhance the quality of universities' e-learning contents? The participants were of 543 university students who took at least one e-learning course and were living in the metropolitan areas(Seoul, Incheon, Gyeonggi). The survey questionnaire was consisted of 38 items developed through the literature review. To analyze the data collected, factor analysis and paired-sample t-test were conducted. The results were as follows: Five identified factors influencing the quality of universities' e-learning contents from the perspectives of learners were instructional strategies, learning contents, usability, evaluation/feedback, and interface design, and all identified factors were statistically significant differences among the learners' perceptions of its importance and satisfaction. The analysis results of importance-satisfaction matrix by each factor showed that 1) learning contents was the factor that current status should be at least continuously maintained, 2) usability, instructional strategies, and evaluation/feedback were the factors that learners' satisfactions still need to be increased although those importances were not relatively high, and 3) interface factor was important, while learners' satisfaction toward it was not much high so that solutions to increase the satisfaction need to be immediately considered. Based on the results, several suggestions to enhance universities' e-learning contents from the learners' perspectives were also recommended.