• Journal of Korean language education
• /
• v.29 no.1
• /
• pp.163-197
• /
• 2018

The present study suggests ways to improve the Korean proficiency screening test through an analysis of WIDA tests. A review of WIDA Screener, WIDA MODEL, and W-APT reveals that each of these three tests consists of four or five tests, corresponding to grade-level clusters. In addition, the WIDA screening tests assess both English for social communication and academic English, according to WIDA's five English Language Development (ELD) standards. Thematic folders of the ELD standards have different ranges of item difficulty, and the WIDA screening tests are adaptive tests. Lastly, the writing tests consist of performance-based tasks, and the rubric is holistic. As suggestions for improvement for Korean screening tests of the KSL curriculum, this study proposes (a) to devise items to assess academic Korean, so as to evaluate students' overall proficiency more accurately, (b) to utilize an adaptive method to screen students' proficiency more efficiently, and (c) to revise the writing tasks and rubric of the current KSL screening tests.

• School Mathematics
• /
• v.5 no.1
• /
• pp.1-25
• /
• 2003

This study develops a performance assessment system to improve grade 4-9 students' creativity. First, this study discusses its educational meaning, its task types, scoring methods and practical application methods. Then, this study provides the typical examples of performance assessment task classified by each of the types and its scoring rubrics. Finally, this study analyzes students' achievement levels for each task. Each task includes item informations such as content area, evaluation goal, evaluation procedure, preparatory material, characteristics, considering points, scoring rubric etc. for grade 4-9 teachers to use them in their evaluation processes directly without difficulties.

• Korean Journal of Cognitive Science
• /
• v.30 no.4
• /
• pp.175-197
• /
• 2019

Writing is an activity known to enhance higher level thinking. It allows the writer to utilize, apply, and actively expand the acquired knowledge. One way to increase writing activity in classroom setting is to use peer assessment. In this study, we sought to increase the accuracy of peer assessment by having students discuss about the scoring rubric or by referring to an expert's assessment. One hundred and fifty college students participated in the experiment. In the group that referred to the expert's assessment, the accuracy of peer assessment increased when the same piece of writing was evaluated; however, no such increase was observed when another piece of writing was assessed. On the other hand, in the group that discussed about the scoring rubric, the accuracy of peer assessment remained the same when the same piece of writing was evaluated, but increased when another piece of writing was assessed. Also, in the discussion group, the accuracy increased in proportion to the number of comments during the discussion. The results suggest that active and voluntary participation of students increase the accuracy of peer assessment.

• Communications of Mathematical Education
• /
• v.27 no.4
• /
• pp.581-609
• /
• 2013

Students' learning processes and mathematical levels should be correctly diagnosed in many different methods of assessment to help students learn mathematics. The study developed the model for the process-based assessment while using manipulatives in the middle school in order to improve problem solving, reasoning and communication which are emphasized in 2009 reformed curriculum as the areas of mathematical process. Identifying the principles of assessment, we created the assessment model for each area and carried out a preliminary study. Based on this, we revised the representative items and the observation checklist and then conducted a main study. Through the results of assessment, we found that students' thinking processes were well presented in scoring rubric for their responses on each item. It meant that the purpose of the assessment as a criterion-referenced test was achieved.

• Journal of The Korean Association For Science Education
• /
• v.44 no.1
• /
• pp.119-130
• /
• 2024

This study explores the possibility of using a generative artificial intelligence, ChatGPT, for student assessment in science subjects. In order to achieve our goal, we developed assessment items, collected students' responses, and input them into ChatGPT to implement the assessment procedures. Subsequently, we shared the assessment results from ChatGPT with science teachers and compared them to the teachers' assessment process to investigate the use of ChatGPT in student assessment. Regarding the results, in terms of setting the scoring rubric, we found the rubric generated by ChatGPT to be generally appropriate. However, the consistency between the scoring results obtained from ChatGPT and those determined by the teachers was relatively low. This inconsistency was more pronounced in items with additional assessment components and a more intricate rubric. In regard to feedback on student responses, there were some instances where the feedback generated was scientifically incorrect or beyond the scope of the curriculum, but there were also some positives, such as the provision of exemplary answers to questions and additional examples that helped students learn further. From these results, the teachers perceived limitations in using ChatGPT to conduct assessment in terms of reliability, which is considered crucial in student assessment, but suggested that it could be used to support assessment. Finally, synthesizing these findings, implications for utilizing ChatGPT in student assessment were suggested.

• Education of Primary School Mathematics
• /
• v.16 no.3
• /
• pp.229-250
• /
• 2013

The purpose of this study is analyzing 'observation and recommendation letter by teacher', which is being submitted to screen and enhance the utilization of gifted students in accordance with recently introduced gifted students observation, recommendation and screening system. For the purpose, this study will provide with objective securing plan of 'observation and recommendation letter by teacher' by developing an optimum evaluation model. The research findings were as follows: First, the result of analysis on the mathematically gifted students behavior characteristic as appeared in 'observation and recommendation letter by teacher' suggested that the recommending teachers have the tendency of giving superficial statement instead of giving concrete case description. When it was analyzed for frequency by the 'observation and recommendation letter by teacher' analysis framework devised by the author, the teachers showed the tendency of concentrating on specific questions. Meanwhile, there was a tendency that teachers concentrate on specific gifted behavior characteristic or area for which concrete case had been suggested. The reason is believed that such part is easy to observe and state while others are not, or, teachers did not judge the other part as the characteristic of gifted students. Second, the gifted students behavior characteristics as appeared in 'observation and recommendation letter by teacher' were made into scores by Rubric model. When the interrater reliability was analyzed based on these scores, the correlation coefficient of 1st scoring was .641. After a discussion session was taken and 2nd scoring was done 3 weeks later, the correlation coefficient of 2nd scoring increased to .732. The reason is believed that; i) the severity among scorers was adjusted by the discussion session after the 1st scoring, ii) the scorers established detail judgment standard on various situations which can appear because of the descriptive nature, and, (iii) they found a consensus on scoring for a new situation appeared. It implies that thorough understanding and application of scorers on evaluation model is as important as the development of optimum model for the differentiation of mathematically gifted elementary students.

• Korean Journal of Adult Nursing
• /
• v.26 no.6
• /
• pp.653-667
• /
• 2014

Purpose: This study was aimed to develop frequently-used clinical scenarios and scoring rubrics to assess core basic nursing skills in adult health nursing clinical practice for clinical evaluation based on program learning outcomes (PO). Methods: This study was a methodological research combining focus group interviews and questionnaires to select and construct scenarios. Data were collected from clinical practitioners, adult health nursing professors, and new nurses from November, 2013 to April, 2014. The developed scenarios and rubrics were applied to nursing students by way of showing an example. Results: The 12 frequently-used clinical scenarios were developed. The proportion of the evaluation rubrics were 30% for clinical instructors where as 70% for college instructors. In order for students to achieve the important learning outcomes from the courses for clinical practice, four program outcomes (POs) were selected as well as a rubric for each POs was developed. Students who had situation-based clinical practices showed higher levels of satisfaction on mastery of core basic nursing skills and communication skills. Conclusion: This findings of the study suggested the strategies for complementing pitfalls in clinical setting and achieving PO during students' clinical practicum.

• Research in Mathematical Education
• /
• v.25 no.4
• /
• pp.285-309
• /
• 2022

A large body of previous studies investigated mathematical tasks by analyzing the design process prior to lessons or textbooks. While researchers have revealed the significant roles of mathematical tasks within written curricular, there has been a call for studies about how mathematical tasks are implemented or what is experienced and learned by students as enacted curriculum. This article proposes a mathematical task analytic framework based on a holistic definition of tasks encompassing both written tasks and the process of task enactment. We synthesized the features of the mathematical tasks and developed a task analytic framework with multiple dimensions: breadth, depth, bridging, openness, and interaction. We also applied the scoring rubric to analyze three multiplication tasks to illustrate the framework by its five dimensions. We illustrate how a series of tasks are analyzed through the framework when students are engaged in multiplicative thinking. The framework can provide important information about the qualities of planned tasks for mathematics instruction (proactive) and the qualities of implemented tasks during instruction (reactive). This framework will be beneficial for curriculum designers to design rich tasks with more careful consideration of how each feature of the tasks would be attained and for teachers to transform mathematical tasks with the provision of meaningful learning activities into implementation.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.3
• /
• pp.1874-1883
• /
• 2015

The purpose of this study was to verify clinical reasoning of nursing students as well as clarify the relevance between clinical reasoning and academic achievement. 87 students broke into 30 groups of two or three. The students performed post operative care for adult patients in the simulation practicum course of their final semester. Data were collected by evaluating the video-recorded nursing practicum using the clinical reasoning rubric. Clinical reasoning of 61(70.1%) students was limited to the beginning level and that of 6(6.9%) students of the highest scoring was at the third level among the four levels of ability. There was no significant correlation between clinical reasoning and the final cumulative GPA, while there was low level of significant correlation between clinical reasoning and GPA of adult health nursing course or adult health nursing practicum course. Therefore, it is necessary to improve the nursing curriculum to enhance nursing students' clinical reasoning.

• Journal of Educational Research in Mathematics
• /
• v.22 no.4
• /
• pp.535-555
• /
• 2012

The aim of this study is to analyze how the context problems by prospective teachers are solved. In order to achieve this aim, this study examined the conceptual nature of context based on previous studies. I developed context problems about linear programming with reference to the results of the examination about the natural characterization of context. These problems were given to 44 prospective teachers and qualitative methods were used to analyze the data obtained from the written solutions by the participants. This study also developed the framework descriptors for this analysis in the light of the Mathematics Scoring Rubric from Illinois Department of Education(2005). The data was analyzed and interpreted in terms of this framework and the specific characteristics shown in the process of problem solving by the teachers were categorized into four types as a result.