• Journal of the Korean Chemical Society
• /
• v.65 no.1
• /
• pp.48-57
• /
• 2021

This study analyzed the science assessment items that were conducted by the paper and the computer-based assessment in the TIMSS 2019 pre-test, which is an international academic achievement assessment. We examined whether the test mode influenced the percentage of items answered correctly by each graders. As a result, there was no significant difference in the correct answer rates of science items according to the test media in 4th and 8th graders. Looking at the each graders, the difference in the percentage of correct answers was relatively large in the fourth grader rather than the eighth grader. In terms of items, the difference in the percentage of correct answers was relatively larger for the constructed items than the multiple choice questions. As a result of analyzing the content of science and assessment items on the influence of the test media, the multiple choice items showed little difference between the paper and the computer-based assessment items, but the answer-type items tended to have a lower percentage of correct answers than the paper-based assessment. In addition, by grade, 4th graders showed lower percentages of correct answers in the constructed items than 8th graders. This study provides implications related to the development and introduction of computer-based assessment in Korea, and suggests an educational implications for computer-based assessment to be well established as school evaluation.

• Journal of Korean Dental Science
• /
• v.12 no.2
• /
• pp.58-65
• /
• 2019

Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

• Journal of Korean Elementary Science Education
• /
• v.23 no.4
• /
• pp.305-317
• /
• 2004

The learning materials in elementary school science textbooks should include all kinds of materials being used by both teachers and students in the science teaching. The major purpose of this research is to analysis textbooks and teacher's guidebooks prepared for the science teaching of 3-6 grade students. To clarify this research, we listed whole of the learning materials of science teaching for each grade and counted numbers being used for whole of the lessons of science. And according to the characteristics and the methods of its preparation of materials, the types of learning materials can be divided into 10 categories such as teaching equipments for science, test materials, consumables, audio-visual aids, teaching equipments in general, collecting' recycling materials, field studies' collected data, breeding' cultivation materials, manufacture materials, and etc. At the result of this research, the 7th national science curriculum needs total 844 items of learning materials for science education. They could be separated into ten types of categories such as 159 items of teaching equipments for science, 65 items of test materials, 116 items of consumables, 198 items of audio-visual aids, 64 items teaching equipments in general, 31 items of collecting' recycling materials, 38 items of field studies (collecting) materials, 17 items of breeding-cultivation materials, 58 items of manufacturing materials, 105 items of other materials. And we found out that there were 332 items of materials for the 3rd grade, 303 items for the 4th grade, 324 items for the 5th grade, and 254 items for the 6th grade. The result of this research could be useful for classroom activities for science teaching.

• The Journal of Korean Medicine
• /
• v.43 no.2
• /
• pp.27-41
• /
• 2022

Objectives: There should be an objective analysis on the academic competency for incorporating Computer-based Test (CBT) in the education of traditional Korean medicine (TKM). However, the Item Response Theory (IRT) for analyzing latent competency has not been introduced for its difficulty in calculation, interpretation and utilization. Methods: The current study analyzed responses of 390 students of 8 years to the herbology test with 14 items by utilizing Rasch model, and the characteristics of test and items were evaluated by using characteristic curve, information curve, difficulty, academic competency, and test score. The academic competency of the students across gender and years were presented with scale characteristic curve, Kernel density map, and Wright map, and examined based on T-test and ANOVA. Results: The estimated item, test, and ability parameters based on Rasch model provided reliable information on academic competency, and organized insights on students, test and items not available with test score calculated by the summation of item scores. The test showed acceptable validity for analyzing academic competency, but some of items revealed difficulty parameters to be modified with Wright map. The gender difference was not distinctive, however the differences between test years were obvious with Kernel density map. Conclusion: The current study analyzed the responses in the herbology test for measuring academic competency in the education of TKM using Rasch model, and structured analysis for competency-based Teaching in the e-learning era was suggested. It would provide the foundation for the learning analytics essential for self-directed learning and competency adaptive learning in TKM.

• Journal of Korean Academy of Nursing
• /
• v.35 no.5
• /
• pp.931-942
• /
• 2005

Purpose: The purpose of this study was to develop a meaning of life scale with high validity and reliability. Method: A conceptual framework composed of 4 phases of meanings of life was identified. And 49 preliminary items on a 4-points scale were developed through content validity. A reliability and validity test of the 49 items was conducted on 564 adults. By means of internal consistency of the 49 items, 1 item was deleted. To verify the 48 items, factor analysis, reliability test, and LISEREL were done. Result: Through exploratory factor analysis of the 48 items, 8 factors were extracted. These factors were labeled as 'self- awareness and self-acceptance', 'hope', 'responsibility awareness', 'love experience', 'self transcendence', 'relation experience', 'self contentedness', and 'Commitment'. Through LISEREL of the 48 items, 2 items were excluded and finally 46 itemsremained. Cronbach's Alpha of the 46 items was .94. The correlation coefficient of the Self-esteem scale was .79. Conclusion: By the above results, the researchers recommend the following: An exploratory study on the variables related to the meaning of life are needed for criterion validity of this scale. Studies on meaning of life of different groupa, and subjects are needed for reverification.

• Communications for Statistical Applications and Methods
• /
• v.17 no.3
• /
• pp.327-335
• /
• 2010

Item response theory provides a fixed results about students, regardless of the item difficulty and discrimina-tion and it is also a kind of item analysis methods which provides the same proper competence scores to students in spite of them taking different test repeatedly. In this paper, we researched item difficulty and item discrimina-tion and analyzed items in the national academic aptitude test which were given from 2000 to 2009 in the past 10 years through item response theory, especially, in connection with given items about statistical unit. As a result, we found that about 60 percents of the items were too difficult for high school students to solve, however, item discrimination proved to be great.

• Archives of Plastic Surgery
• /
• v.50 no.5
• /
• pp.468-477
• /
• 2023

Background This article describes the development of the Myanmar Articulation, Resonation, Nasal Emission, and Nasal Turbulence test for children with cleft lip and palate (CLP), and evaluation of its validity and reliability. Methods It was created by three Thai researchers and a Burmese research assistant based on Burmese phonology. The content validity was evaluated by six Burmese language experts. All test items were divided into three groups: high-pressure oral consonants, low-pressure oral consonants, and nasal consonants. Results All items (58-word and 32-phrase/sentence) gave an excellent level of the expert agreement (item-level content validity indexes = 1.00). The target items were illustrated as color pictures. Each picture was clearly drawn and easy to identify. As a pilot study of face validity, all pictures were administered to 10 typical-developing children. The actual testing was assessed by 10 CLP children, and the developed test was analyzed through consultation of the Burmese teachers and interpreters from a speech camp. Testing scores for a total including three groups of target items were shown acceptable for internal consistency reliability (ranged from 0.4 to 0.88). Conclusion The constructed test is valid in terms of its content.

• Journal of Fisheries and Marine Sciences Education
• /
• v.26 no.3
• /
• pp.597-610
• /
• 2014

The purpose of this study was to inquiry of influence of Meister high school and specialized vocational high school' students on career maturity in problem solving ability domain of test for enhanced employ ability & upgraded proficiency. Research subjects and region were sophomore students of each one of Meister high schools and specialized vocational high schools in Gwangju region. The sample(N=481) was drawn from 2 high schools and collected data were analyzed with SPSS using t-test, Pearson correlation and Levene's test. Items of problem solving ability domain of test for enhanced employ ability & upgraded proficiency were used test items developed in 2012. Career maturity test in Careernet site was used test items developed in 2001 which was made up 3 domains such as attitude, ability and action and 8 sub-regions such as planning, attitude on the vocation, independence, self-understanding, rational decision-making, explore of information, knowledge of hope vocation and career exploration and preparation of action, and constituted 64 items. The results were as follows. Findings of the analysis in specialized vocational high school students demonstrated the positive results of rational decision-making and explore of information in problem solving ability test for enhanced employ ability & upgraded proficiency. Comparing career maturity influence on Meister high school with specialized vocational high school students about problem solving ability domain of test for enhanced employ ability & upgraded proficiency, Meister high school students' score were more high grade than specialized vocational high school students grade.

• School Mathematics
• /
• v.1 no.1
• /
• pp.187-216
• /
• 1999

The purpose of this study is to develop mathematics performance assessment items for the 8th graders and to analyze their performance ability. First, five-themes were selected : 'Calculator', 'Cut and Paste', 'Rule finding', 'Place Assignment', 'My thinking'. Then, the assistance of Mathematics education specialists and Teachers, 10 P. A. items consisting of two subtasks and their evaluation rubric were developed. Then, items were revised by the results of pilot test. And, final version of items were administrated to the 8th graders of three regions(Seoul, Chongiu, Chungp$\acute{y}$ong). Through analyzing the performance ability of the subjects assessment items, the following conclusion were obtained: They were very insufficient in the ability to find some patterns in the given problem situation and to describe logically the patterns in terms of mathematical terminology. It is believed because they were familiar with the objective test to take one or short answer.

• The Korean Journal of Food And Nutrition
• /
• v.29 no.5
• /
• pp.818-827
• /
• 2016

This study was conducted to develop and validate the Sugar Intake Reduction Test (SIRT) for young children, and included eating behaviors, attitude, and nutritional knowledge about sugars. A draft version of the SIRT was developed after literature review. The final draft of the SIRT was established after two pilot tests of 5 year old children and an expert group's review, and is comprised of a one on one test between an investigator and a child using picture tools. It contained of 20 questions which included 3 components: eating behaviors (5 items), preference for sugar sweetened food (10 items), and nutritional knowledge about sugars (5 items). The final SIRT was conducted on 181 children 5 (n=100) to 6 (n=81) years old, to examine its item and test adequacies. The passing rate of most items significantly increased with increasing age, and most of the item discrimination also differed significantly between the below and upper score groups. The content validity was given a high score by professionals (mean score 3.9 out of 4). Reliability of all the items in the SIRT was high (Cronbach's ${\alpha}=0.82$). Moreover, the total component and the sub-component scores of the SIRT correlated significantly. Our results indicate that the SIRT is a valid tool to measure sugar intake reduction in young children aged 5~6 years.