• 제목/요약/키워드: Outcomes Measurement

검색결과 295건 처리시간 0.026초

The Evaluation Tool and Process for Effective Education Outcomes Measurement and Analysis of Computer Education

  • Kim, Young-Tak;Sim, Gab-Sig
    • 한국컴퓨터정보학회논문지
    • /
    • 제21권9호
    • /
    • pp.149-156
    • /
    • 2016
  • This paper is concerned with education courses operating practices for basic computer literacy training. In this study, we propose an example for students to effectively measure and evaluate the achievement of defined ability in the performance measurement and analysis, learning objectives and learning outcomes set in operation throughout the course. Through research and development use case presents the tools for teaching method and effective and objective measurement of the related subjects. And based on the results, we propose the possibility of utilizing NCS-based course operation and education certification. In this study, the measurement process is based on the association with the objective of the development and operation, and measurement tools, measuring tools for measuring learning outcomes associated with the curriculum design methods for the measurement and evaluation of the case of the operation of the course units of learning outcomes and the method proposed.

공공도서관 데이터를 활용한 도서관 성과평가 시스템 구축 연구 (A Study on Building of Outcomes Evaluation System Using Data of a Public Library)

  • 한상우;박성재
    • 한국문헌정보학회지
    • /
    • 제52권4호
    • /
    • pp.163-178
    • /
    • 2018
  • 본 연구는 공공도서관에서 운영하는 프로그램의 성과를 측정할 수 있는 시스템의 구축을 목적으로 한다. 이를 위해 로직모델을 기반으로 개발된 도서관 성과측정 프레임워크를 적용하고 사서가 직접 KOLAS에서 데이터를 반출하고 성과평가 시스템에 업로드하여 성과를 측정하고 결과를 출력할 수 있도록 시스템(LibOutcomes system)을 구축하였다. 연구 결과, 성과평가 시스템을 이용한 성과 측정은 시각적으로 결과를 확인하기에 유용하였다. 또한 웹 기반 시스템으로 구축함으로써 접근 및 이용의 용이성을 확보할 수 있었고, 향후 KOLAS의 한 기능으로 확장할 수 있는 가능성을 제시하였다.

네트워크 성과측정 기획을 위한 개념도 연구법(Concept Mapping) 적용가능성 (A Study on the Applicability of Concept Mapping in the Planning of Network Outcomes Measurement)

  • 김지영
    • 한국사회복지학
    • /
    • 제59권3호
    • /
    • pp.281-304
    • /
    • 2007
  • 사회복지 서비스 부문에서 최근 상호조직간 네트워크의 필요성이 증가하면서 상호조직간 네트워크 사업이 활성화되고 있다. 이와 함께, 네트워크 성과에 대한 책임성의 요구도 증가하고 있다. 네트워크 성과를 성공적으로 수행하기 위해서는 성과에 관한 상호조직 간의 공통된 이해의 틀을 갖추는 것이 필요하며, 성과 개념에 관한 합의 도출이 이루어져야 한다. 따라서, 본 연구는 사회복지 실천현장에서 각기 다른 이해관계에 놓인 조직들이 네트워크 성과측정을 기획하기 위한 기초 작업으로서 성과의 개념적 틀을 개발하고 개념적 합의를 도출할 수 있도록 돕는 concept mapping(개념도 연구법)을 적용한 사례를 소개하고 실천현장에서의 활용가능성을 모색해 보았다. 개념도 연구법을 적용한 결과 협력적인 수행과 지속적인 의사결정 과정 속에 놓여 있는 네트워크 조직에서의 성과측정 기획을 위한 실천적 함의를 발견할 수 있었으며, 사회복지 실천에의 적용 유용성을 향상하기 위한 대안들을 제시하였다.

  • PDF

균형성과표(BSC) 기반의 정보보호 성과 지표 개발 및 측정 방법에 관한 연구 (A Study on Developing of Performance Evaluation Index and Method of Measurement for Information Security Outcomes applying BSC)

  • 장상수
    • 융합보안논문지
    • /
    • 제14권4호
    • /
    • pp.41-53
    • /
    • 2014
  • 조직의 정보보호 목표를 효율적이고 효과적으로 달성하기 위해서는 정보보호 수준을 정확히 평가하고 개선 방향을 제시하는 정보보호 성과평가 지표와 측정방법이 필요하다. 그러나 이러한 요구사항에도 불구하고 국내 기업의 정보보호 활동에 대한 성과나 효과를 측정하기 위한 표준적인 지표나 활용 가능한 측정 방법이 미흡한 실정이다. 이로 인해 기업에서는 지속적인 보안투자 결정을 이끌어 내는데 큰 어려움을 겪고 있다. 본 연구의 목적은 이러한 각 기업 환경에 적합한 합리적인 성과평가를 위하여 성과평가에 영향을 주는 다양한 관점에서 성과평가지표를 도출하고, 평가지표간 중요도에 따른 가중치 부여를 통하여 평가 지표와 측정방법을 개발하는 것이다. 정보보호 활동의 다양한 성과 요인을 균형 있게 평가하기 위해 Norton과 Kaplan(1992)이 개발한 균형성과표 (BSC : Balanced Scorecard) 모형을 활용하였다. 본 연구 결과는 국내 기업들이 정보보호 수준을 파악하고 주기적인 성과측정을 통해 자사의 정보보호 현황 파악과 추이 분석이 가능하고 정보보호 투자 등 전략을 수립하는데 적용할 수 있다.

Measurement of Public Research Outcomes: A Technology Valuation Method

  • Park, Jung-Min;Lim, Seong-Il;Seol, Sung-Soo
    • Asian Journal of Innovation and Policy
    • /
    • 제6권2호
    • /
    • pp.206-224
    • /
    • 2017
  • This article proposes a logic model for assessing the performance of the outcome of public research as a technology valuation method. It consists of two parts and eight steps. The first part is a scoring system and the second part is a validation process of the performance index derived from scoring by valuation method. The scoring in the first part generally requires a focus group method to find out the value drivers and make an evaluation table. The reason why we call it the technology valuation method is that the first part is derived from the simple evaluation of technology value using checklists for value drive. The second part is the regular technology valuation process. The model is designed for the measurement of unquantifiable outcome. Is knowledge or scientific outcome comparable to the measured outcome? If possible, how big is the unquantifiable outcome? This model is based on financial valuation techniques with clear or acceptable market data. Therefore, it cannot work solely for unquantifiable outcomes without comparable measurable outcomes, unlike economic valuation.

PMO 역량에 따른 프로젝트 성과에 관한 연구 (An Exploratory Study on the Project Performance by PMO Capability)

  • 배재권;김진화;김상열
    • Asia pacific journal of information systems
    • /
    • 제18권1호
    • /
    • pp.53-77
    • /
    • 2008
  • In recent years, although numbers of corporations are bringing in PMO, they seem to be indifferent to PMO performance measurement. This demonstrates that there are also other reasons beside performance measurement of information systems (IS) project being ambiguous by introducing PMO; the lack of acknowledging the concrete function of PMO, and the scarcity of empirical study about the effect of PMO on the project members and project performance. In this sense, this study is aimed at proposing a new research model in which project success factors (i.e., standardization, management advocacy, and staff expertise) affect PMO capability (i.e., knowledge management, resources management, and problem solving competency) positively, leading to project performance (i.e., task outcomes, psychological outcomes, and organizational outcomes) eventually. To empirically test the research model, data are surveyed from PMO department and IS department. To prove the validity of the proposed research model, PLS analysis is applied with valid 132 questionnaires. By employing PLS technique, the measurement reliability and validity of research variables are tested and the path analysis is conducted to do the hypothesis testing. The path analysis results can be organized into 7 ways in large scale. First, standardization of project success factors has a positive association with knowledge management, resources management, and problem solving competency of PMO capabilities. The findings of this result indicate that the multiple or single project management should satisfy standardization in order to operate an effective PMO. Second, management advocacy of project success factors has a positive association with knowledge management, resources management, and problem solving competency. Management advocacy refers to the willingness of management to provide the required resources and authority for project success. There is agreement among researchers regarding the importance of management advocacy for favorable PMO capability. Third, staff expertise of project success factors has a positive association with knowledge management, resources management, and problem solving competency. The findings of this result indicate that the formation of an exceptional consultant or members with a proficient knowledge for staff expertise of project member is the key factor to elevate the PMO capability. Past research suggests that experience and knowledge and the resultant familiarity with the problem faced can be an important determinant of PMO capability. A capable project with appropriate staff expertise means that it enjoys a diversity of abilities and experiences. Fourth, knowledge management competency of PMO capabilities has a positive impact on psychological outcomes but has no direct effect on task outcomes and organizational outcomes. In domestic case of S. Korea, PMO was finally introduced to many other corporations in 2005 though it started bringing in 2000. Therefore, it had neither a significant impact on the task outcomes nor organizational outcomes by lacking the contents and the infrastructure of the knowledge management because the knowledge consolidation and management period of PMO is comparatively shorter by terms than other foreign nations. Fifth, resources management competency of PMO capabilities has a positive association with task outcomes, psychological outcomes, and organizational outcomes. In addition, problem solving competency of PMO capabilities has a positive association with task outcomes, psychological outcomes, and organizational outcomes. Therefore, the findings of this results stress that PMO capabilities has a positive impact on project performance. Sixth, according to the path analysis of the hypothesis, which suggested in this research, problem solving competency is the PMO capability which is the key success factor for task, psychological, and organizational outcomes as an integrated performance model. Further, the analysis reveals that problem solving competency is an important factor for integrated performance model. The finding is in line with past IS research, which affirms that the work of IS projects is essentially a problem solving endeavor. Seventh, in the path analysis of the hypothesis in this research, the path of the management advocacy $\rightarrow$ problem solving competency $\rightarrow$ organizational outcomes appears to be the most important and strongest path. In brief, the finding of this study suggests that project success factors influence PMO capability positively, and project performance as well. From the results, it can be concluded that PMO helped great improve the project success rate and project performance. This study advances research on PMO capability in three important aspects. First, the findings of our study have implications for IS theory and future research. Our study contributes to IS theory by synthesizing concepts from PMO research and project management research with those in IS research. We proposed and tested PMO capability of IS projects and the findings of our investigation provided some preliminary answers to some of the questions raised. Secondly, this thesis does not only help depicting the concept of IT governance but also approaches empirically. It makes a gradual approach to the main content, step by step, in contrary of simple standard, scholastic way of thinking. Finally, we argued that this task-oriented(technical) view is not sufficient to adequately conceptualize IS project performance. Hence, we applied that the research on organization teams, which provides a flip viewpoint to that of project management research in that it gives more weight for psychological outcomes of organizational work groups, can be very helpful in reconceptualizing the IS project performance construct. The limitations of this study are also discussed to provide research directions for future research.

안전 의식의 결정 요인으로서 핵심 안전 성향 (Core Safety Disposition as a Cause of Safety Consciousness)

  • 박영석;정지희
    • 한국안전학회지
    • /
    • 제34권6호
    • /
    • pp.58-64
    • /
    • 2019
  • Over the past decades there has been a growing body of researches that examines the psychological traits related to safety outcomes. After briefly reviewing the relationships between psychological dispositions and safety outcomes, we empirically examine the relationships with 2 samples of 1,102 participants. Fifteen psychological dispositions (big 5 personality, locus of control, cognitive failure, affection from job and relations, 4 achievement goal orientations, self-efficacy, fatigue, and depression) and four psychological outcomes (safe behavior, unsafe behavior, accidents, and injuries) are examined. After covariance structure modeling variances of safety outcomes are well explained by simple 4 dispositions of consciousness, mastery-approach goal orientation, self-efficacy, and depression. We name them 'core safety disposition', and name four psychological outcomes 'safety consciousness', and the relationships between those latent variables are stronger than between measurement variables. We propose core safety disposition as a cause of safety consciousness, and discuss implications for research and practices.

교과기반 학습성과 평가시스템 개발: 군산대학교 공학인 건축공학심화프로그램 사례 연구 (Framework for Course-Embedded Outcomes Assessment: A Case Study of Architecture & Building Engineering Program at KSNU)

  • 박성신
    • 공학교육연구
    • /
    • 제23권1호
    • /
    • pp.47-58
    • /
    • 2020
  • Kunsan National University obtained accreditation for its Architecture & Building Engineering Program from the Accreditation Board for Engineering Education in Korea (ABEEK) in 2004 and has offered an ABEEK-accredited degree pathway ever since. Then, in 2018, the university introduced the course-embedded outcomes assessment system as per ABEEK's KEC2015 accreditation criteria. One year into its implementation, the new system allows the measurement and assessment of 10 program outcomes covering 19 curricular modules and 1 non-curricular licensing examination. The system incorporates the four areas of specialization within architectural engineering as well as the three course categories of the math, science, and computer; liberal arts; and engineering core modules under the accreditation scheme. It also takes the students' academic years into account, especially for the mandatory modules offered to all students. Its rubric clarifies the performance criteria, performance level, assessment tools, objectives, and modules. The 2018 course-embedded outcomes assessment system is an ever-evolving structure with regular CQI: Continuous Quality Improvements along the circular process of system establishment → implementation → evaluation as per the virtuous cycle model required for an accredited engineering program.

Impact of Service Quality on Behavioural Intention to Use Fin Tech Payment Services: An Extension of SERVEQUAL Model

  • Vikas Sharma;Sanjay Taneja;Munish Gupta;KshitizJangir;Ercan Ozen
    • Asia pacific journal of information systems
    • /
    • 제33권4호
    • /
    • pp.1093-1117
    • /
    • 2023
  • The study aims to determine the impact of quality outcomes on behavior intentions in Financial Technology (FinTech) payment services. The study is focused on the development and testing of the impact of the SERVQUAL model on the TAM, i.e., Technology Acceptance Model for the measurement of the behavioral intention of users to use fintech payment services. The sample entails 578 specific survey responses from northern India from October to December 2022. The respondents were users of FinTech. The PLS-SEM technique was employed to explain the implementation process. Consequently, it discovered a significant relationship between the SERVQUAL models and the impact on behavioral intentions identified by TAM. The study will provide insight into the factors that impact the quality outcomes and adoption of Fintech payment services to the providers. The paper demystifies FinTech payment services in the range of perception of service quality outcomes and provides essential theories. The TAM model reflects the customer's sense of satisfaction, usefulness, and attitude. In contrast, the SERVQUAL model demonstrates the user's assessment of service quality outcomes such as quality, trust, security, and service quality positively affects behavioral intention in FinTech payment services.

Estimating the AUC of the MROC curve in the presence of measurement errors

  • G, Siva;R, Vishnu Vardhan;Kamath, Asha
    • Communications for Statistical Applications and Methods
    • /
    • 제29권5호
    • /
    • pp.533-545
    • /
    • 2022
  • Collection of data on several variables, especially in the field of medicine, results in the problem of measurement errors. The presence of such measurement errors may influence the outcomes or estimates of the parameter in the model. In classification scenario, the presence of measurement errors will affect the intrinsic cum summary measures of Receiver Operating Characteristic (ROC) curve. In the context of ROC curve, only a few researchers have attempted to study the problem of measurement errors in estimating the area under their respective ROC curves in the framework of univariate setup. In this paper, we work on the estimation of area under the multivariate ROC curve in the presence of measurement errors. The proposed work is supported with a real dataset and simulation studies. Results show that the proposed bias-corrected estimator helps in correcting the AUC with minimum bias and minimum mean square error.