• 한국신뢰성학회지:신뢰성응용연구
• /
• 제18권2호
• /
• pp.161-172
• /
• 2018

Purpose: Test & Evaluation items are main contents which verify performance of the development system and they are deduced going through project management system stages. However, there is no systematic or standardized framework for Test & Evaluation items, so a lot of differences occur between projects and people are questioning whether verification items are selected for the optimization of the development system. In this regard, this research proposes the process of deducing Test & Evaluation items in a systematic way during a development stage by applying QFD (Quality Function Deployment) technique which reflects customers' requirements. Methods: Test & Evaluation items are recognized as customers' requirements, and QFD technique which refines and gathers various requirements of customers effectively during general products' development stage is applied to complete HOQ (House of Quality) Conclusion: There is no specific methodology for Test & Evaluation items, so currently, they are selected by including items which are given by similar projects or higher authorities. However, by utilizing QFD technique, selection of evaluation items which goes through more systematic process is expected to be possible.

• Child Health Nursing Research
• /
• 제8권3호
• /
• pp.334-343
• /
• 2002

This study was aimed at primarily to develop a tool to evaluate sexuality education and secondarily to test effectiveness through application of developed evaluation tools in elementary school. The results from this study were summarized below: 1. On the basis of targeting the lower grades (1st- 3th year) and the higher grades (4th-6th year) elementary school students' sexuality education guidebooks published by Korea Ministry of Education & Human Resources Development, 71 preliminary items targeting the lower grades, 90 preliminary items targeting the higher grades were developed. 2. Through the validity test about the contents of the preliminary items three times, the items were regulated to 65 items targeting the lower grads and 57 items targeting the higher grades. And then, the preliminary items were re-regulated to 40 items separately. Then, pre-test which targeting each 30 students was enforced. 3.Finally, the evaluation tools for sexuality education that consisted of 40 items targeting the lower grades and the higher grades were developed. 4. eliability test of the developed tools, sexuality education evaluation tools showed alpha coefficient of internal consistency were 0.8355 (for the use of the lower grades) and 0.8881 (for the use of the higher grades). 5. o apply the developed sexuality education evaluation tools, 10-times sexuality education were carried out class unit and pre-post test were done using same questionnaire, which contains developed tool, there were significant difference in low grade (t=16.548, p=0.000), high grade (t=14.773, p=0.000). The results of this study suggest that the evaluation tool for sexuality education in elementary school may be a useful tool with a high degree of reliability and validity. In this sense, the evaluation tool for sexuality education developed by this study can be effectively utilized in Korea elementary schools.

• Journal of Korean Dental Science
• /
• 제12권2호
• /
• pp.58-65
• /
• 2019

Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

• 한국과학교육학회지
• /
• 제22권2호
• /
• pp.378-386
• /
• 2002

1999학년도부터 지난 3년 동안 시행된 대학수학능력시험에서 공통과학 중 화학 영역 문항에 대한 학생들의 응답을 조사하였다. 내용 영역과 탐구 과정에 따른 문항수, 내용 영역과 탐구 과정에 따른 평균 정답률, 정답률 수준에 따른 문항 분포, 정답률이 높거나 낮은 문항 등을 분석하였다. '환경' 영역에서의 문항수가 매우 적었는데, 특히 '오존층'에 대해서는 한문항도 출제되지 않았다. 가장 어려운 내용 영역은 '환경' 영역의 '산성비'였다. 탐구 과정별로는 '자료 분석 및 해석'에서 가장 많은 문항이 출제되었고, '문제 인식 및 가설 설정'이 가장 어려운 것으로 나타났다. '아주 어려운 수준'의 문항은 하나도 없고. '쉬운 수준'이나 '아주 쉬운 수준'에 해당하는 문항이 많았다. 학생들은 여러 가지 개념이나 지식을 요구하는 문항을 해결하는 데에 많은 어려움을 느꼈고, 저학년에서 다루어진 개념만을 요구하는 문항을 쉽게 해결하였다. 교육학적 함의에 대해 논의하였다.

• 한국과학교육학회지
• /
• 제30권4호
• /
• pp.452-471
• /
• 2010

수능이 1994학년도에 처음 시행된 이후 17년 동안 시행되어 오면서 기출을 피하면서 사고력을 측정하는 참신한 문항을 출제하는 것이 점점 어려워지고 있다. 그러므로 수학능력 측정을 위한 양호한 문항의 개발을 위한 지속적인 연구가 필요하다. 이러한 맥락에서 수능 문항 개발에 필요한 시사점을 도출하기 위해 수능과 같은 국가 수준의 선다형 대입 관련 시험 분석의 일환으로 일본 센터시험을 분석하였다. 이 연구에서는 센터시험의 체제와 이과 출제 과목 및 응시과목의 수나 응시자 현황을 파악하고, 2009년 1월에 시행한 '이과' 시험의 검사지 구성, 문항 유형, 특이 사항 등을 분석하였다. 또한 센터시험 문항을 수능과 관련하여 내용 요소 및 행동영역에 따라 분석하였고, 아울러 우리나라 수험생의 관점에서 예상 정답률을 추정하였다. 분석 결과, 센터시험 문항은 고급 사고력보다는 지식 측정 또는 낮은 사고력을 주로 측정하고 있다. 또한 문항 당 배당되는 시간이 수능보다 길며 문항 수가 고정되지 않았고, 배점과 답지 수도 다양하다. 그리고 실생활 소재를 많이 사용하면서 문장 표현을 엄격하게 하지 않는 경향이 있다. 센터시험에서 원점수를 사용하는 것으로 보아 선택 과목 간 유 불리 문제가 크지 않은 것으로 보인다. 또한 문과나 이과의 계열 구분 없이 대부분의 학과에서 선택 과목으로 과학과목 성적을 요구하고 있다.

• 한국응급구조학회지
• /
• 제24권3호
• /
• pp.41-53
• /
• 2020

Purpose: This study tests the validity of a standard evaluation tool of ambulance ride practices with new evaluation items and supports its application by 119 preceptors. Methods: We tested the validity of standard evaluation items collected from 19 on-site professionals assessing ambulance ride practices. New evaluation items, 'understanding of emergency rescue equipment' and 'ability to communicate', were added as additional criteria. The modified Delphi technique was used to test the three evaluation areas and ten evaluation items. We used the analytic hierarchy process to analyze the weighting value of the reconstructed evaluation tool model. Results: All three evaluation areas and 10 evaluation items within the standard evaluation tools used for ambulance ride practices corresponded with the consistency index, degree of convergence, and agreement in the modified Delphi panel. Conclusion: These results provide evidence of the consistency and usefulness behind preceptors' use of this standard evaluation tool in ambulance ride practice.

• 한국수학사학회지
• /
• 제25권3호
• /
• pp.119-140
• /
• 2012

본 연구는 교육과정 평가원이 제시한 수학과 교과 내용학 평가 영역 및 평가 내용 요소에 따라 2009학년도부터 2012학년도까지, 중등교사 임용시험에서 출제된 수학과 교과 내용학의 문항을 분석한 것이다. 연구의 목적을 달성하기 위해 4년간 출제된 수학과 교과내용학의 105 문항을 수집하여, 9개 과목 간, 평가 영역 및 평가 내용 요소에 따라 출제된 비율을 분석하였고, 그 결과를 토대로 사범대학 수학교육과 교육과정의 운영이나 평가영역의 재조정에 대한 시사점을 도출하였다. 연구 결과 수학과 내용학의 9과목 간 출제비중에 있어서 현저한 차이가 있으며, 과목별 평가 영역 간에도 출제 비중에 있어서 큰차이가 있는 것으로 나타났다. 평가 내용 요소의 분석에 있어서도 262개 중에서 153개가 4년동안 교사 임용시험에 출제되지 않은 것으로 나타났다. 이러한 분석 결과에 근거하여 수학과 내용학의 출제 과목간의 비중이나 평가 영역 및 평가 내용 요소의 재 조정에 대한 필요성을 논의하였다.

• 한국과학교육학회지
• /
• 제33권6호
• /
• pp.1202-1218
• /
• 2013

본 연구는 교육과정 평가원이 제시한 화학과 교과 내용학 평가 영역 및 평가 내용 요소에 따라 2009학년도부터 2013학년도까지, 중등교사 임용시험에서 출제된 화학과 문항을 분석한 것이다. 연구의 목적을 달성하기 위해 5년간 출제된 화학과 교과내용학 1차 시험 140 문항을 수집하여 4개 과목간, 평가영역 및 평가내용요소에 따라 출제된 비율을 분석하였고, 그 결과를 토대로 사범대학 화학교육과 교육과정의 운영이나 평가 영역의 재조정에 대한 시사점을 도출하였다. 연구 결과 화학과 4개 과목 간 출제 비중에 있어서 현저한 차이가 있으며, 과목별 평가영역 간에도 출제비중에 있어서 큰 차이가 있는 것으로 나타났다. 평가내용요소의 분석에 있어서도 122개 중에서 41개가 5년 동안 교사 임용시험에 출제되지 않은 것으로 나타났다. 이러한 분석 결과에 근거하여 화학과 임용시험의 출제 과목 간의 비중이나 평가영역 및 평가 내용요소에 대한 재조정의 필요성을 제언하였다.

• 한국경영과학회지
• /
• 제28권4호
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.

• 한국의료질향상학회지
• /
• 제4권2호
• /
• pp.260-278
• /
• 1997

Background : Quality of professional nursing care is the most essential factor for survival and growth of nursing profession. Then, nursing professionals have responsibility for the evaluation of quality of professional nursing care. The purpose of this study was to develope an evaluation tool of nursing care for patients received gastrointestinal surgery with general anesthesia. This study was a primary work for the developement of a computer program for the evaluation of nursing care. Methods : This study was done through some consecutive steps. They were (1) Developement of items for the tool (2) Developement of an evaluation tool of nursing care quality for the G-I surgery patient (3) Test of reliability and validity of the tool. Two groups of experts and expert pannels who had much experience of the QA and the care of G-I surgery patients participated for developement of the items. 85 nursing records were used for the test of reliability and validity of the developed tool. The evaluation tools were developed with two types of scoring, norm-referenced tool and criterion-referenced tool. Results The system of items for tool was evaluation area evaluation item-indicator. There were 7evaluation areas which contained 32evaluation items which contained 7lindicators. Evaluation areas 1, 2, 3, 4 were for the evaluation of process and 5, 6, 7 were for the evaluation of outcome of nursing care for G-I surgery patient. For the test of interrator reliability, correlation coefficients of each scores of items and intragroup correlation coefficients were calculated. The average correlation coefficients between two rators were 0.65, 0.54 and the intragroup correlation coefficient were 0.99 and 1.00 by the types of scoring. The Cronbach alpha coefficients of the tools were 0.54 and 0.46 by the types of scoring. The average content validity index of the items was 0.95 from 4 pairs of experts. Because there were significant differences between some scores of quality of nursing care of 3 general hospitals regardless of the types of scoring, the tools could be thought to have some construct validity. And also, there were significant correlations between some scores of quality of nursing care and admission days and admission days after surgery regardless of the types of scoring, the tools could be thought to have predictive validity. Conclusion In this study, the evaluation tool of nursing care was developed for the very specified group of patient, G-I surgery patient. And the items were developed and tested by the experts of nursing practice. Because of these reasons, it was supposed that the tool could be used effectively in nursing pratice. And the procedures for the development and the test of the evaluation tool of nursing care in this study were supposed to be used for the developement of other tools.