• Title/Summary/Keyword: Competency Evaluation Item

Search Result 32, Processing Time 0.023 seconds

A Study on Competency Evaluation Item of Design Phase VE Team (설계VE팀의 역량 평가항목에 관한 연구)

  • Seo, Ha-Na;Lee, Hak-Ki
    • Proceedings of the Korean Institute Of Construction Engineering and Management
    • /
    • 2007.11a
    • /
    • pp.797-800
    • /
    • 2007
  • Value Engineering(VE) is being applied as an useful tool to eliminate the waste of cost and noneffective factors previously in construction projects. Ministry of construction and transportation' has been accordingly enforcing extensionally design phase VE to the construction costing more than 10 billion won, an importance of design phase VE. Although there are legal supports and technical effects, an effect about an introduction of design phase VE can not be applied properly because of several problems at the process. So, in this study, try to find out competency factors of design phase VE to enforce a competency of VE team as a basic database for developing a check list, and estimate weight. For the result, find out a competency evaluation item and organize as a team knowledge, a team work skill and a team attitude. Perform a first survey to verify a reliability and propriety regarding the found competency evaluation, perform the second survey competency as to evaluation item of the found 1, 2, 3 class and then estimate the weight by AHP.

  • PDF

Development of Parallel Short Forms of the Convergent Thinking and Problem Solving Inventory Utilizing Item Response Theory : A Case Study of Students in H University (문항반응이론을 적용한 융합적 사고 및 문제해결 역량진단 도구의 병렬 단축형 개발 : H 대학교를 중심으로)

  • You, Hyunjoo;Nam, Na-Ra
    • Journal of Engineering Education Research
    • /
    • v.26 no.3
    • /
    • pp.35-41
    • /
    • 2023
  • The study was conducted to develop two parallel short forms for the Convergent thinking and Problem solving questionnaires which are part of H University's core competency diagnostic tools, based on Multi-Item Response Theory. Item responses of 2,580 students were analyzed using Graded Response Model(GRM) to determine item difficulty and discrimination of each item. The research results are as follows. Two parrallel short tests were developed for the Convergent thinking questionnaire consisting of 12 items which were originally 17 items. Likewise, the Problem solving questionnaire, which originally consisted of 15 questions, was divided into two parallel short forms, each consisting of 9 items. The reliability of the shortened parallel tests was confirmed through internal consistency analysis, and their similarity to the original tests was established through correlation analysis. This study contributed to quality management of competency-based education and programs at H University by developing shortened tests. Based on the results, implications were presented as well as limitations and discussions.

Feature analysis for competency and representation type of mathematics assessment (수학과 평가 문항의 역량 및 표현 형식 특성 분석)

  • Park, Ji Hyun
    • The Mathematical Education
    • /
    • v.60 no.2
    • /
    • pp.209-228
    • /
    • 2021
  • The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

Student Responses to Smart Device-Based Test on Competency Evaluation in Dental Education

  • Kim, Jooah;Kim, Soo-Yoon
    • Journal of Korean Dental Science
    • /
    • v.12 no.2
    • /
    • pp.58-65
    • /
    • 2019
  • Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

A Study on Competency Evaluation Checklist of Design Phase VE Team (설계VE팀의 역량평가 체크리스트에 관한 연구)

  • Seo, Ha-Na;Lee, Hak-Ki
    • Korean Journal of Construction Engineering and Management
    • /
    • v.9 no.4
    • /
    • pp.154-162
    • /
    • 2008
  • Ministry of construction and transportation has been enforcing extensionally design phase VE(Value Engineering) to the construction costing more than 10 billion won, an importance of design phase VE accordingly is raising to get rid of a waste of cost and noneffective factors previously in construction projects. Although there are legal supports and technical effects, an effect about an introduction of design phase VE can not be applied properly because of several problems at the process. So, in this study, present competency factors of design phase VE to highly raise the output through organizing an effective team at the beginning stage of design phase VE. Find out 29 competency factors through characteristics of design VE team for the check list, classify by team knowledge, team work skill, and team attitude. Get an efficiency regarding importance and find out Competency Evaluation items of design VE team, present a Competency Evaluation plan for indicating an objective standard to Competency Evaluation by measuring relative importance as to each Competency Evaluation item.

Development and Validation of the Core Competency Evaluation Tool for New Graduate Nurse's Preceptor (신규간호사 프리셉터의 핵심역략 평가도구 개발)

  • Kwon, In-Gak;Jung, Kyoung-Hee;Cho, Hye-Sool;Hwang, Ji-Won;Kim, Ji-Young;Jeon, Kyoung-Ok;Sung, Young-Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.8 no.4
    • /
    • pp.535-549
    • /
    • 2002
  • Purpose : The purpose of this study was to develop a core competency evaluation tool of the preceptors training new graduate nurses and to determine the validity of the developed instrument. Method : This study was conducted in 2 phases. In phase I, preceptor's core competency list was developed through literature review, focus group interview, and review by nursing directors and nurse managers. In phase II, 60 preceptors were evaluated with the developed instrument and categorized into excellent, good & poor core competency groups. For validation of the instrument, new graduates' clinical performance improvement and satisfaction with preceptor were compared between excellent and poor group. Result : The data were analyzed by SPSS P.C and the results were as follows. 1) Preceptor's core competencies were classified into three domains; Role model(10 items), Socialization facilitator(8 items), and Educator(16 items), and each item had four point system of "strongly agree" to "strongly disagree". Cronbach'${\alpha}$ of the instrument was.9416. 2) Comparison of clinical performance improvement and satisfaction with preceptor of the new graduates trained by excellent and poor preceptors revealed that new graduates' clinical performance improvement(p=.015) and satisfaction with the preceptor(p=.005) were significantly higher in the excellent core competency preceptor group than the poor core competency preceptor group. Conclusion : The validity of the preceptor's core competency evaluation tool developed in this study was confirmed. Therefore, this tool can be effectively utilized for education and evaluation of new graduates' preceptors in clinical settings.

  • PDF

Development of Evaluation Tool for Clinical Nursing Practice Competency of Nursing students (간호학생의 임상실무수행능력 평가도구 개발)

  • Lee, Kun-Ja;Chang, Chun-Ja;Lee, Eun-Ja;Lee, Yea-Jin;Kang, Ik-Wha
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.11 no.3
    • /
    • pp.323-333
    • /
    • 2005
  • Purpose: The purpose of this study was to development and measure validity and reliability of evaluation tool for clinical nursing practice competency of Nursing students. Method: The participants in this study were 568 nurses who had worked for more than three years above in hospitals. A questionnaire of 79 items was administered to the nurses using a convenience sampling method. The data were collected from Sep. 12th, to Oct. 20th, 2004. Result: The derived outcome tool consisted of 6 factors of direct nursing actions and 6 factors of indirect nursing actions on the basis of 79 items. The 6 factors in direct nursing actions accounted for 76.84% of the variance and 6 factors in indirect nursing actions accounted for 79.68% of the variance on total scale. As a result of the item analysis, 79 items were selected and the internal consistency alpha coefficient was .9917. The value of Cronbach' alpha of direct nursing actions was .9640, indirect nursing actions was .9550. Conclusion: The results of this study show that useful application to the evaluation tool of clinical practice competency of Nursing students and further studies need to be done to verify clinical practice educational evaluation.

  • PDF

Curriculum Development for Agribusiness Management Consulting Competency of Agricultural Educator (농업인교육자의 농기업경영컨설팅능력 개발을 위한 교육과정 개발)

  • Kang, Dae Koo
    • Journal of Agricultural Extension & Community Development
    • /
    • v.19 no.4
    • /
    • pp.905-959
    • /
    • 2012
  • This study was aimed to find the agribusiness management consulting competency for agricultural educator, to find the teaching method and evaluation criteria for each competency group, and to recommend the subjects, contents of each subject, instruction method and evaluation criteria of each subject. Through the literature review, web searching of agricultural consulting company and 17 experts members' reviews as delphi methods, agribusiness management consulting competency for agricultural educator was found of 64 items in 90 items. After educability reviews, it was selected of 45 item in 64 items for necessary and educable competency. And it was selected to good teaching method and evaluation criteria in each competency groups. Finally, eight subjects, major contents of each subject, instructional method and evaluation criteria in each subject were recommended for agribusiness management competency, and some recommendations were presented.

Development of Competencies for New Nurses and Verification of Content Validity through a Delphi Survey (델파이조사를 통한 신규간호사 역량 도출 및 내용타당도 검증)

  • Hanna Jung;Yoonjung Lee;Jung Yeon Kim;Minjin Lee;Soo Young Han;Yumie Rhee;Shinki An;Phill Ja Kim
    • Korean Medical Education Review
    • /
    • v.25 no.2
    • /
    • pp.159-173
    • /
    • 2023
  • The purpose of this study was to develop and validate a competency tool for new nurses and to pilot-test it with new nurses. A Delphi survey was conducted to develop a competency tool, and a self-evaluation was conducted among new nurses who pilot-tested the finally derived competencies. The Delphi survey panel consisted of 18 people, including adjunct professors at the College of Nursing, nursing managers, and nurses with master's degrees. The Delphi survey asked about the validity of the competencies constructed in two rounds. After analyzing the Delphi results with mean, standard deviation, content validity ratio, degrees of convergence, and degrees of consensus, 12 core competencies and 36 enabling competencies were finally derived. The competencies consisted of clinical judgment and management (nine items), task competence (four items), patient orientation (five items), moral value orientation (three items), cooperation (two items), supply management (two items), professional development (three items), confidence (one item), self-control (two items), flexibility (two items), influence (one item), and nurturing others (two items). The finally derived competencies were pilot-tested with 229 new nurses who had worked for 2-12 months. The self-evaluation scores of new nurses were distributed differently according to their working period. In this study, the competencies required for new nurses were identified and the corresponding enabling competencies were identified. In the future, it is expected that a competency-based education program will be prepared based on these findings, and furthermore, it will be possible to provide high-quality medical and nursing services that meet patients' needs by improving the competency of new nurses and lowering the turnover rate.

Educational Evaluation of Competency in Nursing Skills through Open Laboratory Self-directed Practice (실습실 개방 자율 실습방법 적용이 기본간호학 실기 숙련도에 미치는 영향에 관한 교육평가적 연구)

  • Paik Hoon-Jung
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.11 no.1
    • /
    • pp.13-20
    • /
    • 2004
  • Purpose: This study was conducted to evaluate the effect of open laboratory self-directed practice in improving nursing skill competency. Method: This study was a one group posttest only design that examined the competency in basic nursing skills after traditional education and open laboratory self-directed practice. Students participated in traditional education and open laboratory practice through self-study. Whenever practice was done, the item of practice and time were measured and documented. Collected data were analyzed by frequency, percentages, averages and standard deviations, and Pearson correlation coefficients. Result: 1 The average number of students who participated in the open lab self-directed practice was 53.9 (64.2%) and the total number of hours of participation was 1567.5 minutes per year. Each student participated for an average of 29.1 minutes per year. 2. Analysis showed a statistically positive correlation between practical skill and open laboratory self-study (r=0.252, p=0.048).

  • PDF