• 대한화학회지
• /
• 제65권1호
• /
• pp.48-57
• /
• 2021

본 연구는 국제 학업성취도 평가인 TIMSS 2019 사전검사에서 지필 평가와 컴퓨터 기반 평가로 시행된 과학 평가 문항을 분석하여 검사 매체에 따라 문항 정답률에 영향을 미치는지를 문항 및 학년별로 살펴보았다. 그 결과, 4학년과 8학년 모두 검사 매체에 따른 과학과 문항 정답률 차이가 크지 않았다. 학년별로 살펴보면, 8학년보다는 4학년의 경우 정답률 차이가 상대적으로 크게 나타났다. 문항별로 살펴보면, 선다형 문항보다는 서답형 문항의 경우 정답률 차이가 상대적으로 크게 나타났다. 검사 매체 영향에 대한 과학과 평가 문항 내용을 분석한 결과로는 선다형 문항은 지필 평가와 컴퓨터 기반 평가 문항간의 차이가 거의 없었으나, 서답형 문항은 지필 평가에 비해 서답형 문항의 정답률이 낮아지는 경향을 보였다. 또한, 학년별로는 4학년 학생들이 8학년 학생들보다 서답형 문항에서 정답률이 낮아지는 것으로 나타났다. 본 연구를 토대로, 우리나라 컴퓨터 기반 평가의 개발과 현장 도입과 관련된 시사점을 제공하고 컴퓨터 기반 평가가 학교 평가로 잘 정착하기 위한 교육적 함의를 고찰하고자 한다.

• Journal of Korean Dental Science
• /
• 제12권2호
• /
• pp.58-65
• /
• 2019

Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

• 한국초등과학교육학회지:초등과학교육
• /
• 제23권4호
• /
• pp.305-317
• /
• 2004

The learning materials in elementary school science textbooks should include all kinds of materials being used by both teachers and students in the science teaching. The major purpose of this research is to analysis textbooks and teacher's guidebooks prepared for the science teaching of 3-6 grade students. To clarify this research, we listed whole of the learning materials of science teaching for each grade and counted numbers being used for whole of the lessons of science. And according to the characteristics and the methods of its preparation of materials, the types of learning materials can be divided into 10 categories such as teaching equipments for science, test materials, consumables, audio-visual aids, teaching equipments in general, collecting' recycling materials, field studies' collected data, breeding' cultivation materials, manufacture materials, and etc. At the result of this research, the 7th national science curriculum needs total 844 items of learning materials for science education. They could be separated into ten types of categories such as 159 items of teaching equipments for science, 65 items of test materials, 116 items of consumables, 198 items of audio-visual aids, 64 items teaching equipments in general, 31 items of collecting' recycling materials, 38 items of field studies (collecting) materials, 17 items of breeding-cultivation materials, 58 items of manufacturing materials, 105 items of other materials. And we found out that there were 332 items of materials for the 3rd grade, 303 items for the 4th grade, 324 items for the 5th grade, and 254 items for the 6th grade. The result of this research could be useful for classroom activities for science teaching.

• 대한한의학회지
• /
• 제43권2호
• /
• pp.27-41
• /
• 2022

Objectives: There should be an objective analysis on the academic competency for incorporating Computer-based Test (CBT) in the education of traditional Korean medicine (TKM). However, the Item Response Theory (IRT) for analyzing latent competency has not been introduced for its difficulty in calculation, interpretation and utilization. Methods: The current study analyzed responses of 390 students of 8 years to the herbology test with 14 items by utilizing Rasch model, and the characteristics of test and items were evaluated by using characteristic curve, information curve, difficulty, academic competency, and test score. The academic competency of the students across gender and years were presented with scale characteristic curve, Kernel density map, and Wright map, and examined based on T-test and ANOVA. Results: The estimated item, test, and ability parameters based on Rasch model provided reliable information on academic competency, and organized insights on students, test and items not available with test score calculated by the summation of item scores. The test showed acceptable validity for analyzing academic competency, but some of items revealed difficulty parameters to be modified with Wright map. The gender difference was not distinctive, however the differences between test years were obvious with Kernel density map. Conclusion: The current study analyzed the responses in the herbology test for measuring academic competency in the education of TKM using Rasch model, and structured analysis for competency-based Teaching in the e-learning era was suggested. It would provide the foundation for the learning analytics essential for self-directed learning and competency adaptive learning in TKM.

• 대한간호학회지
• /
• 제35권5호
• /
• pp.931-942
• /
• 2005

Purpose: The purpose of this study was to develop a meaning of life scale with high validity and reliability. Method: A conceptual framework composed of 4 phases of meanings of life was identified. And 49 preliminary items on a 4-points scale were developed through content validity. A reliability and validity test of the 49 items was conducted on 564 adults. By means of internal consistency of the 49 items, 1 item was deleted. To verify the 48 items, factor analysis, reliability test, and LISEREL were done. Result: Through exploratory factor analysis of the 48 items, 8 factors were extracted. These factors were labeled as 'self- awareness and self-acceptance', 'hope', 'responsibility awareness', 'love experience', 'self transcendence', 'relation experience', 'self contentedness', and 'Commitment'. Through LISEREL of the 48 items, 2 items were excluded and finally 46 itemsremained. Cronbach's Alpha of the 46 items was .94. The correlation coefficient of the Self-esteem scale was .79. Conclusion: By the above results, the researchers recommend the following: An exploratory study on the variables related to the meaning of life are needed for criterion validity of this scale. Studies on meaning of life of different groupa, and subjects are needed for reverification.

• Communications for Statistical Applications and Methods
• /
• 제17권3호
• /
• pp.327-335
• /
• 2010

문항반응이론은 문항의 난이도와 변별도가 검사를 치른 집단에 무관하게 항상 일정하며, 학생들이 매번 다른 검사를 치른다고 해도 자신의 고유한 능력점수를 받도록 하기위한 문항분석방법이다. 본 연구에서는 2000년부터 2009년까지 최근 10년 동안 대학수학능력시험에 출제되었던 통계영역 문제에 대하여 문항반응이론을 통한 분석을 실시하고 문항변별도와 문항난이도 등에 대해서 알아보았다. 그 결과 거의 60%의 문항이 어려운 문항으로 나타났다. 그러나 문항변별도는 비교적 양호한 것으로 판명되었다.

• Archives of Plastic Surgery
• /
• 제50권5호
• /
• pp.468-477
• /
• 2023

Background This article describes the development of the Myanmar Articulation, Resonation, Nasal Emission, and Nasal Turbulence test for children with cleft lip and palate (CLP), and evaluation of its validity and reliability. Methods It was created by three Thai researchers and a Burmese research assistant based on Burmese phonology. The content validity was evaluated by six Burmese language experts. All test items were divided into three groups: high-pressure oral consonants, low-pressure oral consonants, and nasal consonants. Results All items (58-word and 32-phrase/sentence) gave an excellent level of the expert agreement (item-level content validity indexes = 1.00). The target items were illustrated as color pictures. Each picture was clearly drawn and easy to identify. As a pilot study of face validity, all pictures were administered to 10 typical-developing children. The actual testing was assessed by 10 CLP children, and the developed test was analyzed through consultation of the Burmese teachers and interpreters from a speech camp. Testing scores for a total including three groups of target items were shown acceptable for internal consistency reliability (ranged from 0.4 to 0.88). Conclusion The constructed test is valid in terms of its content.

• 수산해양교육연구
• /
• 제26권3호
• /
• pp.597-610
• /
• 2014

The purpose of this study was to inquiry of influence of Meister high school and specialized vocational high school' students on career maturity in problem solving ability domain of test for enhanced employ ability & upgraded proficiency. Research subjects and region were sophomore students of each one of Meister high schools and specialized vocational high schools in Gwangju region. The sample(N=481) was drawn from 2 high schools and collected data were analyzed with SPSS using t-test, Pearson correlation and Levene's test. Items of problem solving ability domain of test for enhanced employ ability & upgraded proficiency were used test items developed in 2012. Career maturity test in Careernet site was used test items developed in 2001 which was made up 3 domains such as attitude, ability and action and 8 sub-regions such as planning, attitude on the vocation, independence, self-understanding, rational decision-making, explore of information, knowledge of hope vocation and career exploration and preparation of action, and constituted 64 items. The results were as follows. Findings of the analysis in specialized vocational high school students demonstrated the positive results of rational decision-making and explore of information in problem solving ability test for enhanced employ ability & upgraded proficiency. Comparing career maturity influence on Meister high school with specialized vocational high school students about problem solving ability domain of test for enhanced employ ability & upgraded proficiency, Meister high school students' score were more high grade than specialized vocational high school students grade.

• 대한수학교육학회지:학교수학
• /
• 제1권1호
• /
• pp.187-216
• /
• 1999

The purpose of this study is to develop mathematics performance assessment items for the 8th graders and to analyze their performance ability. First, five-themes were selected : 'Calculator', 'Cut and Paste', 'Rule finding', 'Place Assignment', 'My thinking'. Then, the assistance of Mathematics education specialists and Teachers, 10 P. A. items consisting of two subtasks and their evaluation rubric were developed. Then, items were revised by the results of pilot test. And, final version of items were administrated to the 8th graders of three regions(Seoul, Chongiu, Chungp$\acute{y}$ong). Through analyzing the performance ability of the subjects assessment items, the following conclusion were obtained: They were very insufficient in the ability to find some patterns in the given problem situation and to describe logically the patterns in terms of mathematical terminology. It is believed because they were familiar with the objective test to take one or short answer.

• 한국식품영양학회지
• /
• 제29권5호
• /
• pp.818-827
• /
• 2016

This study was conducted to develop and validate the Sugar Intake Reduction Test (SIRT) for young children, and included eating behaviors, attitude, and nutritional knowledge about sugars. A draft version of the SIRT was developed after literature review. The final draft of the SIRT was established after two pilot tests of 5 year old children and an expert group's review, and is comprised of a one on one test between an investigator and a child using picture tools. It contained of 20 questions which included 3 components: eating behaviors (5 items), preference for sugar sweetened food (10 items), and nutritional knowledge about sugars (5 items). The final SIRT was conducted on 181 children 5 (n=100) to 6 (n=81) years old, to examine its item and test adequacies. The passing rate of most items significantly increased with increasing age, and most of the item discrimination also differed significantly between the below and upper score groups. The content validity was given a high score by professionals (mean score 3.9 out of 4). Reliability of all the items in the SIRT was high (Cronbach's ${\alpha}=0.82$). Moreover, the total component and the sub-component scores of the SIRT correlated significantly. Our results indicate that the SIRT is a valid tool to measure sugar intake reduction in young children aged 5~6 years.