• Journal of Korean Academy of Nursing
• /
• v.44 no.2
• /
• pp.129-138
• /
• 2014

Purpose: To develop a Critical Thinking Skill Test for Nursing Students. Methods: The construct concepts were drawn from a literature review and in-depth interviews with hospital nurses and surveys were conducted among students (n=607) from nursing colleges. The data were collected from September 13 to November 23, 2012 and analyzed using the SAS program, 9.2 version. The KR 20 coefficient for reliability, difficulty index, discrimination index, item-total correlation and known group technique for validity were performed. Results: Four domains and 27 skills were identified and 35 multiple choice items were developed. Thirty multiple choice items which had scores higher than .80 on the content validity index were selected for the pre test. From the analysis of the pre test data, a modified 30 items were selected for the main test. In the main test, the KR 20 coefficient was .70 and Corrected Item-Total Correlations range was .11-.38. There was a statistically significant difference between two academic systems (p=.001). Conclusion: The developed instrument is the first critical thinking skill test reflecting nursing perspectives in hospital settings and is expected to be utilized as a tool which contributes to improvement of the critical thinking ability of nursing students.

• Journal of Korean society of Dental Hygiene
• /
• v.14 no.2
• /
• pp.269-279
• /
• 2014

Objectives : The purpose of this study was to investigate the oral health center operation and to activate the program development of public oral health center. Methods : Delphi analyses were utilized by the recruited expert panel from August to September in 2012. Results : The difficulty in operation of the oral health centers is the human resources management. In order to solve the human resources operation, utilization of the local human resources is the best choice of the solution. The next choice was the designation of the oral health expert in Ministry of Health and Welfare. So the expert can activate the public oral health care system for the disabled and the underprivileged classes in the long term. Conclusions : In order to activate the oral health centers, Ministry of Health and Welfare should promote the public health center function connected with the cooperation of the Association of dental hygienists.

• KSCI Review
• /
• v.8 no.2
• /
• pp.33-42
• /
• 2001

The purpose of this study was to help retrieve and assess only what learner wants. The multiple-choice and short-answer types were selected. and a sort of a question bank was organized in consideration of the degree of difficulty and frequency of being questioned in such a way to have a discriminating power. For item retrieval the stored information was converted into XML data, instead of simply searching information from database. and that data were retrieved through Xpath. And it's designed to show the retrieval output by using XML on browser. Concerning item evaluation. evaluation items were produced by inputting the degree of difficulty and frequency of being questioned of the subject and unit learner wants. and then by inputting the number of individual item type. The learning outcome was offered in real time to learner. and learner could repeatedly drill what they gave a wrong answer.

• The Journal of Korean Medicine
• /
• v.38 no.2
• /
• pp.1-6
• /
• 2017

Objectives: Natural environment therapy is considered as an option for atopic dermatitis. This study was aimed to examine the beneficial effects of natural environment therapy among patients with atopic dermatitis who have moved in an atopy-free village. Methods: The questionnaire-based survey was conducted from parents of 20 children with atopic dermatitis (12 male and 8 female, median age 8 years, ranging from 6 to 13 years). The questionnaire consisted of 10 questions for the changes of two typical symptoms of pruritus and sleeping difficulty after moving into an atopy-free village. Results: 75.0% and 88.9% of patients have a family history (at least one parent and one of siblings respectively) of allergic disorders. The median staying period of patients was 27.6 months (ranging from 2 to 55 months). The score indicating pruritus was significantly improved from $6.2{\pm}2.8$ into $4.8{\pm}1.8$ (p<0.05), and sleeping difficulty was also improved from $5.7{\pm}2.9$ into $4.3{\pm}2.1$ (p<0.05) too. Conclusions: This study suggests that the natural environmental therapies could be a choice for patients with atopic dermatitis, which should be studied further for their scientific evidence and mechanisms.

• School Mathematics
• /
• v.19 no.1
• /
• pp.153-170
• /
• 2017

This study conducted an analysis of types of reasoning shown in students' solving a problem and processes of students' reasoning according to type of problem by posing an open-ended problem where students' reasoning activity is expected to be vigorous and a multiple-choice problem with which students are familiar. And it examined teacher's role of promoting the reasoning in solving an open-ended problem. Students showed more various types of reasoning in solving an open-ended problem compared with multiple-choice problem, and showed a process of extending the reasoning as chains of reasoning are performed. Abduction, a type of students' probable reasoning, was active in the open-ended problem, accordingly teacher played a role of encouragement, prompt and guidance. Teachers posed a problem after varying it from previous problem type to open-ended problem in teaching and evaluation, and played a role of helping students' reasoning become more vigorous by proper questioning when students had difficulty reasoning.

• Journal of the Korean Society of Safety
• /
• v.21 no.5 s.77
• /
• pp.103-111
• /
• 2006

The purpose of this study was to analyse the relationships between cognitive abilities and driving characteristics of elderly drivers. Driving characteristics of elderly and younger drivers who were driving a fixed base driving simulator vehicle were examined. Participants consisted of 12 drivers over age 65 (the 'older' group) and 12 drivers between the ages of 25 and 55 (the "younger" group). As indices of cognitive ability, critical flicker fusion frequency (CFF) tests and cognitive reaction tests were given before the driving task. CFF was also tested after the simulated driving task for both groups. Cognitive reaction tests, which were composed of speed estimation tests, multiple choice reaction tests and obstacle avoidance tests, were developed by the Korean Road Traffic Safety Authority in 2003. CFF values between the two groups exhibited significant differences both before and after the task, with a p-value less than 0.01 and a t-value of -3.01 before the test and a p-value less than 0.031 and a t-value of -2.35 after the test. Older drivers' CFF values were lower than those of the younger. However, there was no difference in older or younger driver CFF values before and after the task within the same group. Except for the multiple choice reaction test, there was no difference in cognitive reaction test results between the two groups. The elderly drivers made more errors though they did not differ from the younger drivers in reaction times. At the simulated driving task the reaction time of the elderly driver was longer than that of the younger; however, the driving speed of the elderly was lower and the number of collisions greater. There was a positive correlation (r=.496) between the number of errors in the multiple choice reaction test and the number of collisions in the driving task. Therefore, it was identified that critical attributes contributing to automobile crashes involving elderly drivers included cognitive difficulty in judging and responding to complex situations.

• Journal of Science Education
• /
• v.37 no.2
• /
• pp.278-293
• /
• 2013

The purpose of this study was to analyze the characteristics of multiple-choice test items used in assessment of high school integrated science according to 2009 revised curriculum. For the analysis of the tendency of item setting, we devised an analytic framework specific to integrated science, and analyzed the characteristics of items by applying the devised framework and item response theory. The results of the tendency of item setting revealed that most of items run counter to the intent of integrated science in terms of item resource, integration extent, and cognitive level, which means teachers are stick to separative method in teaching-learning and assessment of integrated science. The results of the analysis applying item response theory showed that item difficulty was appropriate and item discrimination was considerably high. However, there was no relevance between the tendency of item setting and qualitative characteristics of the items. We also discussed some agendas to improve the teaching-learning and assessment of integrated science based on the results of this study.

• Journal of Engineering Education Research
• /
• v.24 no.6
• /
• pp.30-39
• /
• 2021

The present study aims to demonstrate that it is possible to objectively evaluate the competency (referred to as graduate attributes or program outcomes) of graduates of engineering education programs. To strengthen the link between engineering education accreditation and the qualification/certification system of engineering professionals, referred to as K-Engineering Professional (K-EP), individually assuring the quality of accredited graduates using multiple-choice test as main assessment tool is proposed. Test questions related to the basic vocational skills of NCS are developed for seven of the 10 program outcomes of the ABEEK KEC2015. The three program outcomes, PO1, PO3, and PO5, which need to fully accommodate the characteristics of each disciplinary field, are excluded. A pilot test involving graduates of eight accredited programs is conducted. Applying on Rasch model based on Item Response Theory (IRT), the item difficulty, fit and discrimination of multiple choice test are demonstrated. The pilot study strongly suggests that individual competency evaluation is possible at a certain level for seven program outcomes tested. For PO1, PO3, and PO5, however, questions that address the characteristics of each disciplinary field need to be devised. If a suitable pool of questions is built, it can be used as a program outcomes assessment tool by the accredited programs.

• Journal of Science Education
• /
• v.36 no.2
• /
• pp.293-302
• /
• 2012

The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.

• The Korea Journal of Herbology
• /
• v.37 no.2
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.