• Journal of Korean Home Economics Education Association
• /
• v.32 no.3
• /
• pp.135-159
• /
• 2020

The purpose of this study was to develop items of an essay response assessment that could align with the instructions and assessments in the high school home economics curriculum. The contents of the study were as follows. First, to establish an assessment plan, 14 achievement standards were analyzed in the assessment area, and the elements of the questions were developed including the content elements of a total of 29 questions. Second, to develop the assessment tools, preliminary questions suited to the structure of essay questions were developed, and the method of presenting data and scoring criteria to be utilized in the questions was selected. Third, to prepare the answers and the scoring criteria tables, the answers to the sample questions for each score were prepared in form of a scoring criteria table, and the objectives of the assessment, the scoring items, and the scores for each item were reviewed. Fourth, the developed questions and answers were revised and supplemented by teachers of the professional learning community through preliminary and mutual review on the components of the questions, the embodiment of the assessment objectives, the implementation of the assessment intent, and the grading. This study can be used as a foundational study for the development of essay-type questions and scoring criteria in essay assessment in the field of education. Furthermore, the results of this study could help teachers enhance their learners' ability to apply knowledge in the future.

• Communications of Mathematical Education
• /
• v.26 no.3
• /
• pp.273-299
• /
• 2012

The purpose of this study is to investigate how constructed-response assessments are currently defined and used to find an alternative way of developing well-defined constructed-response questions and an assessment system. Based on our review of the literature, we analyze constructed-response assessments developed and used in Gyeonggi-do, South Korea and Ohio, U.S.A. in terms of their definitions, types of questions, information and guidelines given by the government agencies in each place, and scoring rubrics and their use. The results provide meaningful implications for the development of constructed-response assessments in the future.

• Communications of Mathematical Education
• /
• v.28 no.4
• /
• pp.553-571
• /
• 2014

Mathematical process is an issue in current mathematics education. In this paper discuss how to assess the mathematical process using essay type questions. For this we first suggest the concept of Mathematical Process Oriented Question which is an essay type question and possible to assess mathematical processes, that is, the mathematical communication, reasoning, and problem solving as well as mathematics knowledge. And we develop a framework for developing the mathematical process oriented question and rubric, examples of assessment standards and those questions containing rubric for assessing mathematical processes. The results of this paper can serve as basic data and examples for follow up research about mathematical process assessment.

• Journal of Science Education
• /
• v.42 no.2
• /
• pp.198-213
• /
• 2018

In recent years, descriptive evaluation has been gaining importance at school. The purpose of this study is to analyse descriptive evaluation items which have been made by school teachers. 300 items for regular examinations are collected from 7 middle schools (grades 1 through 3) in Gyeongnam Province. Distribution and types of items are examined to compare educational objectives of standard achievements and those of evaluation according to Bloom's revised taxonomy of educational objectives. The result shows that there exist a majority of shared subject units for descriptive evaluation. Huge difference of frequency is also found among subject units and standard achievements. Less than 65% of evaluation items are descriptive and the rest is simple completion or short answers. In addition, it reveals only 40.3% of agreement between educational objectives of standard achievements and those of evaluation items. The interviews with 27 teachers indicate that lack of ability to develop proper items and grading are the major obstacles. In conclusion, systematic training courses are to be provided in order to resolve issues over descriptive evaluation.

• Journal of Educational Research in Mathematics
• /
• v.18 no.3
• /
• pp.335-352
• /
• 2008

The purpose of this research was to investigate the descriptive evaluation method that focuses on the problem solving process of the student. The goal was to evaluate the students' understanding of the subject rather than the students' ability to find the final answer. The descriptive evaluation is being suggested as a way of examining the thought process of the student by performing a structured analysis of the problem solving process. Today, there are not enough descriptive evaluation resources available for teachers to effectively carry out this alternative assessment method in the elementary school mathematics curriculum. This research is a case study on the development of resources for descriptive evaluation in grade 4 mathematics. We designed the development process for descriptive evaluation and its rubric for all 8 units of the 4-Na level of mathematics in the elementary school curriculum. Three descriptive problems were developed for each of the 8 units for a total of 24 problems. The rubric consisted of three areas of assessment, 1) understanding of the problem, 2) problem solving, and 3) mathematical communication. The problems were first pilot tested in two 4th grade classes. Modified problems were then tested in a different 4th grade classroom. The study showed that the three defined areas of evaluation framework (problem understanding, problem solving and mathematical communication) were measurable and analyzable using the developed grading rubric. We then conclude that he descriptive evaluation could be used as an effective tool for improving teacher performance in elementary school mathematics.

• Journal of the Korean School Mathematics Society
• /
• v.11 no.4
• /
• pp.543-567
• /
• 2008

The current 2007 Mathematics Curriculum in Korea emphasizes mathematical problem solving, advanced mathematical thinking and effective mathematical communicating. Therefore, in order to assess and evaluate these important thinking attributes, performance evaluation using descriptive and essay type of assessments are emphasized. In this paper, analysis of the elementary mathematics curriculum is used to develop descriptive assessment problems and grading rubrics that could be used objectively and consistently by teachers of the grade 6 school mathematics. The assessment problems were developed, pilot tested, revised, implemented and analyzed in detail to understand the overall effectiveness of the descriptive evaluation method in school mathematics.

• Journal of The Korean Association For Science Education
• /
• v.24 no.3
• /
• pp.519-531
• /
• 2004

In recent years, there has been an increased emphasis on performance assessment to evaluate students' abilities. Our nation has introduced a change in testing and assessment. Additional work on the efficacy, reliability, and comparability in order to develop the performance assessment item has been needed in the enforcement of the 7th National Science Curriculum. Also, criteria for professional and technical standards has been needed to be developed. The purpose of this study was to draw out various key concepts and to develop achievement standards, assessment standards and performance assessment items based on the 7th National Science Curriculum on the subject matter of reproduction(chapter 13) and biological accumulation(chapter 17). And also, this study examined the validity of completed performance assessment items based on classical test theory and polytomous item response theory. Twelve key concepts in chapter 13(reproduction) and four from chapter 17(biological accumulation) were abstracted. Twenty-six achievement standards in chapter 13(reproduction), and nine in chapter 17(biological accumulation) were developed. The achievement standards were determined in terms of knowledge(K), process skill(P) and attitude(A). Twenty-five assessment standards in chapter 13(reproduction) and nine in chapter 17(biological accumulation) were developed. Based on the developed achievement standards and assessment standards, twenty-two performance assessment items(seventeen open-ended questions, three essays, and two portfolios) with concrete grading criteria were developed. Eight open-ended items were applied to 240 10th graders to evaluate reliabilities of the test which consisted of four items per each chapter. The results would be suggested that the applied items were valid for performance assessment because item difficulties and item discriminations were proper. There was not much differences in item discrimination between interpretation from classical test theory and that from polytomous item response theory. However, there were some differences in item difficulties between the interpretations of two theories because the characteristics of examinees were reflected in classical test theory.

• Journal of the Korean School Mathematics Society
• /
• v.11 no.3
• /
• pp.377-397
• /
• 2008

In today's secondary school mathematics curriculum, assessment is to be focused on evaluating the student's mathematical thinking rather than finding the correct solution to the problem. A descriptive evaluation method is therefore introduced to the school districts and suggested as an alternative assessment method in K-12 school mathematics. Descriptive evaluation method is widely available for use in schools, but there are barriers to using it since the teachers are forced to use the method by the school districts. In this research, we surveyed 120 secondary school mathematics teachers in Seoul and the surrounding metropolitan area to understand the status and the perception about using descriptive evaluation. The goal of the study was to find and understand the direct implications of using the new assessment method in secondary mathematics classes. The study showed that most of the mathematics teachers used the descriptive assessment method during their regular exam periods which is given twice per semester. Most of the open-ended problems used for descriptive evaluation were medium or high level math questions which were graded by the teachers at least 3 times to ensure objective evaluation. The teachers stated that objectivity in grading, administrative situation, and development of descriptive problems were the difficult barriers in descriptive evaluation. The teachers in the survey also commented that teachers' administrative responsibility should be reduced and that school environment in general should be improved for the new assessment method to become successful. Finally, the study showed that development of more descriptive problems with specific grading guidelines need to be developed for each grade level.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.109-110
• /
• 2023

본 논문에서는 교육현장에서 서술평평가를 자동화하기 위한 시스템을 제안한다. 제안 시스템은 장문의 응답에서 단어를 추출하여 단어 간 네트워크를 생성하고 정답 네트워크와 비교를 통해 평가를 실시한다. 기존의 키워드 방식은 네트워크 관점에서 노드를 기준으로 채점하는 것이라면, 제안 시스템은 엣지를 기준으로 채점하게 되어 학습자의 답변에서 지식의 관계성을 채점할 수 있어 학습자에게 유용한 피드백을 줄 수 있을 것으로 기대한다.

• The Mathematical Education
• /
• v.46 no.2 s.117
• /
• pp.207-226
• /
• 2007

The purpose of this study was to design and develop the processes of tasks and assessment rubrics of open-ended tasks, and those for the 5th graders of elementary school mathematics. 7 tasks were finally developed, and 'problem understanding', 'problem solving process', 'communication' were selected as the criteria for assessment rubrics. The result was that the ability of mathematical power covering problem understanding ability, problem solving ability and mathematical communication ability was low. Specifically, problem understanding ability was the highest, problem solving ability was middle, and mathematical communication ability was the lowest.