• Journal of the Korean Society for information Management
• /
• v.32 no.4
• /
• pp.249-272
• /
• 2015

Inappropriate applications of bibliometric approach and misinterpretation on the analysis in research evaluation have been found and recognized nationally and internationally as the use of the approach has been rapidly adopted in various sectors in research evaluation systems and research funding agencies. The flood of misuse led to several numbers of declarations and statements on appropriate research evaluation, including Leiden Manifesto, DORA, IEEE Statement, etc. The similar recommendations from five different declarations, Leiden Manifest, IEEE Statement, DORA, Institut de France, and Thomson Reuters White paper were reviewed and meta-analyzed in this study and it is revealed that most of them emphasize evaluation on quality in various aspects with multiple indicators. Research evaluation with assessing multiple aspects of individual research based on the understandings of its purpose and pertinent subject area was revealed as being mostly advised in the declarations, and this recommendation can be regarded as being mostly requested in national research evaluation system. For future study, interviews with relevant stakeholders of national research evaluation system in order to explore its application are needed to confirm the findings of this review.

• Korean Journal of Social Welfare Studies
• /
• v.47 no.4
• /
• pp.333-360
• /
• 2016

Social Impact Bonds(SIBs) has emerged as a promising way to finance proven social services programs, fund what works, and drive government accountability and has increased fast. In this context, this study examines and classifies the structure of SIB focusing key criteria of the main steps through two-step cluster analysis. Analysis results are as follows. First, the main commissioners of SIB are the ministries of the central government. And in terms of the stage of invest, there are usually two or three investors mainly consisting of social finance organizations. Second, in terms of target and age of SIB beneficiaries, it focuses on the adolescent and youth. Third, in the outcome evaluation stage, the results show that in most cases outcome payments are determined by a validation of service provider or government administrative data. However, the rate of payments are based on the comparison of the program beneficiaries to other comparable groups is 23.8%. Finally, The results of two-step cluster analysis are as; 'mix of central government and social finance organization', 'multiple agent including private organization', and 'multiple social provider'. Among three types, 'multiple agent including private organization' shows the most active participation between agents and the most systematic outcome measurement and management. The results of this study imply that the importance of the method to manage and measure outcome in SIB structure. Moreover, the consist of commissioners or investors is needed to expanded more.

• (The) Research of the performance art and culture
• /
• no.36
• /
• pp.585-602
• /
• 2018

This article examines the academic world of Professor Sa jin-sil. This article is not a detailed and rigorous assessment of Prof. Sa's work. During my directly or indirectly meeting with Prof. Sa jin-sil, the writing was based on my experiences. This is why the theme of "participatory observation records" is attached. I was aware that this writing would become a customary and formal funeral speech. Because I thought Prof. Sa also did not want formal and customary writing. The initiation of the participatory observational records that I describe was the literature study of Prof. Sa. What I am about to say in the title of the table of "Known Performance and to Revalue." There I summarized my thoughts on what Prof. Sa contributed to the research of the literature study on traditional performance and my opinion of the justice of the assessment of her contributions. I have not recommitted again about contributions or achievements that have already been widely recognized. What I noticed here was what was to be revalued. I once again stressed the achievements that were not properly evaluated despite their importance and significance. In the ensuing discussion, I looked at Prof. Sa's entirely different academic side. I call the passage "an unexpected result against prejudice." The subjects covered were Prof. Sa's field-contextual studies. Prof. Sa is often referred to as a dramatical history or a traditional performing arts scholar who studies literature. Such an idea is so common that it is easy to overlook field-contextual research results, not literature-based. But I think this is prejudice. That is why the title of the table of contents has the words 'unexpected' and 'prejudice'. Here I actively emphasized and evaluated Professor Sa's achievements in field-contextual studies.

• Journal of Engineering Education Research
• /
• v.12 no.3
• /
• pp.96-106
• /
• 2009

The purpose of this study was to suggest possibility of adaptation of course-embedded assessment for program outcome in engineering education through literature review on concept, benefits, adaptation process, case study in higher education of course-embedded assessment. The model of course-embedded assessment was given with consideration for each step, that is, set up of program outcomes, check of related courses, selection of assessment tools, set up of performance criteria, implementation of course-embedded assessment, and analysis of results. Some prerequisites were given to set up course-embedded assessment successfully in engineering education field of Korea.

• Review of KIISC
• /
• v.22 no.6
• /
• pp.22-28
• /
• 2012

정보서비스 이용이 보편화됨에 따라 개인과 조직 모두에게 보안은 매우 중요한 이슈가 되었다. 보안위협에 대비하기 위해 사용되는 정보보안 제품 및 서비스에 필수적인 요소가 암호이며, 정보 이용 및 관리 환경이 다양해짐에 따라 그 중요성이 점차 강조되고 있다. 암호분야의 지속적인 발전을 위해서는 관련 연구의 성과에 대한 측정 및 평가가 필수적일 것이다. 본고에서는 세계암호학회(International Association for Cryptologic Research, IACR) 주관의 학술행사 및 학술지에서 발표된 논문을 기준으로 암호분야 연구의 성과를 고찰하였다. 발표논문편수와 발표자수 기준으로 국내 암호연구 성과를 파악하였고, 국내 연구자의 연구결과물의 국제적 위상에 대해 비교하였다.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.8 no.2
• /
• pp.129-139
• /
• 2013

This paper is targeted on proposing ameliorating alternative to performance assessment method of GSEM through evaluating the current one, which is initiated by SMBA to induce fair competition among 5 GSEM across the country and accommodate the quality improvement of entrepreneurship education since 2005 after beginning the SMBA support, from the perspective of BSC(Balanced Scorecard) tool. Ultimately, it complements the policy defects of SMBA over GSEM, in particular, in the process of performance assessment and management. This paper carries out two studies as follow. First, throughout reviewing the previous studies relating to BSC applications to non-profit organization, it set out the direction of introducing BSC in assessing performance of GSEM in order to enhance its effectiveness. Second, it evaluate the rationality of performance assessing tools apllied to GSEM by SMBA on the basis of BSC application over non-profit organization, especially in education institution. Research results shows the following implications. First, the current evaluation system over GSEM is just merely assessment itself and not much contributions for the post performance management. Second, The annual evaluation just remains to check up whether the policy goals are met or not. Third, the current evaluation puts much emphasis just on financial inputs and hardware infra, not considering human resources and utilization of government policy and institution. Fourth, the policy goals are unilaterally focused on entrepreneurs. Fifth, the current evaluation systems do not contain any indexes relating to learning and growth perspectives for concerning sustainable and independent growing up. However, lack of empirical testing require this paper to need the further study in the future.

• 한국경영정보학회:학술대회논문집
• /
• 2007.11a
• /
• pp.102-108
• /
• 2007

본 연구는 성과관리가 조직의 지속적인 성장과 발전의 혁신도구로써 조직성과에 영향을 미친다는 측면에서 공공부문의 균형성과표(BSC) 운용의 성공요인과 고려사항을 바탕으로 연구모형을 설정한 후 이를 실증적으로 분석하였다. 이를 위하여 성과관리를 위한 BSC의 추진 관리 단계인 계획, 실행, 평가, 환류 등 순환주기에 관련된 변수들을 독립변수로 하고, 조직성과에 관련된 변수들을 종속변수로 선정하여 독립변수가 종속변수에 미치는 영향을 분석하였다. BSC를 구축 운영하고 있는 공공기관의 BSC 성과관리시스템 담당자에게 설문조사를 실시하여 분석한 결과, BSC 운영 단계별 하위변수들은 상호간에 영향을 미치며, 조직성과에도 유의미한 영향을 미치는 것으로 나타났다. 이러한 분석결과에 따른 정책적인 시사점은 성과관리를 조직 내에 촉진 유지하기 위한 조직적, 정책적, 전략적 환경을 조성하여야 한다는 점이다. 또한 공공부문에서 성과관리제도가 실패하는 가장 큰 이유는 객관적인 평가지표가 명확히 설정되지 않았거나 보상체계가 불충하기 때문이다. 공공부문의 경쟁력 확보를 위해서는 구성원이 전략적 사고의식을 가져야 한다.

• Korean Journal of Labor Studies
• /
• v.23 no.1
• /
• pp.221-253
• /
• 2017

This study aims at analyzing the management strategy and performance of companies that have been pursuing Generational Diversity. The management strategies were examined in terms of production, organizational structure and skill development. Performance was then evaluated using Balanced Scorecard (BSC). We selected four Japanese companies that practice Generational Diversity between the younger(age less then 34) and older generation(age older then 65). Our findings suggest the following. The common management strategies of the four companies include 1) creating generation-diverse teams 2) ensuring flexible work arrangements and 3) providing skill training programs. These strategies have yield positive outcomes such as sales increase, cost reduction (financial perspective) and expansion of the market share (customer perspective). Non-financial performance includes improvement of product and service quality (internal business perspective) and skill improvement of both the young and the old workers (learning and growth perspective). This study provides practical implications to domestic companies for their successful management of generational diversity in workplace.

• Information Systems Review
• /
• v.9 no.1
• /
• pp.259-282
• /
• 2007

This paper provides a case for the comprehensive performance management system in Public Procurement Service. Public Procurement Service set up the BSC system at the beginning of 2006 by improving and complementing the earliest performance management system and made it possible to automatically connet the performance measurement and evaluation of the departmental and person by using CSF and KPI, which result from their mission and strategic assignments. Therefore, the public service of the adminstration is able to offer better customer service, as the private corporations do, apply the incentive and disincentive policies to the personnel and reward administration and contribute to changing the administration into an organization of competition and performance compensation. The application of the BSC system enables the strengthening of the individual evaluation system in the departmental, integration of various evaluations into one, and the establishment of a monitering system of achievement rate in the objective management in the periodic results. Such a case study of Public Procurement Service will determine the course of establishment of the BSC in other public institutions and suggest many successful methods and ideas for the performance management system.

• Journal of Internet Computing and Services
• /
• v.24 no.6
• /
• pp.31-39
• /
• 2023

The purpose of this study is to propose a scientific performance evaluation framework for measuring and managing the overall outcome of complex types of projects that are linked to public demand-based commercialization, such as information system projects and public procurement, in integrated national R&D projects. In the case of integrated national R&D projects that involve multiple research institutes to form a single final product, and in the case of demand-based demonstration and commercialization of the project results, the existing evaluation system that evaluates performance based on the short-term outputs of the detailed tasks comprising the R&D project has limitations in evaluating the mid- and long-term effects and practicality of the integrated research products. (Moreover, as the paradigm of national R&D projects is changing to a mission-oriented one that emphasizes efficiency, there is a need to change the performance evaluation of national R&D projects to focus on the effectiveness and practicality of the results.) In this study, we propose a performance evaluation framework from a structural perspective to evaluate the completeness of each national R&D project from a practical perspective, such as its effectiveness, beyond simple short-term output, by utilizing the Hourglass model. In particular, it presents an integrated performance evaluation framework that links the top-down and bottom-up approaches leading to Tool-System-Service-Effect according to the structure of R&D projects. By applying the proposed detailed evaluation indicators and performance evaluation frame to actual national R&D projects, the validity of the indicators and the effectiveness of the proposed performance evaluation frame were verified, and these results are expected to provide academic, policy, and industrial implications for the performance evaluation system of national R&D projects that emphasize efficiency in the future.