• Communications of Mathematical Education
• /
• v.26 no.3
• /
• pp.273-299
• /
• 2012

The purpose of this study is to investigate how constructed-response assessments are currently defined and used to find an alternative way of developing well-defined constructed-response questions and an assessment system. Based on our review of the literature, we analyze constructed-response assessments developed and used in Gyeonggi-do, South Korea and Ohio, U.S.A. in terms of their definitions, types of questions, information and guidelines given by the government agencies in each place, and scoring rubrics and their use. The results provide meaningful implications for the development of constructed-response assessments in the future.

• Journal of The Korean Association For Science Education
• /
• v.28 no.2
• /
• pp.139-149
• /
• 2008

The purpose of this study is to develop a valid and reliable instrument for measuring scientific problem-finding ability for the scientifically-gifted student. On the basis of an operational definition of scientific problem-finding ability, this instrument consists of five sections(appropriateness, flexibility, originality, elaboration, and valuation) which are designed for measuring the ability of the scientifically-gifted. This instrument was checked the validity of content and evaluation criteria by the five experienced specialists in science education, and then was administered to 38 students of science high school. Because the validity of content and evaluation criteria, construct validity, inter-rater reliability, item difficulty, and item discrimination are suitable for the criteria of good test, this developed instrument in this study is considered valid and reliable.

• Education of Primary School Mathematics
• /
• v.16 no.3
• /
• pp.229-250
• /
• 2013

The purpose of this study is analyzing 'observation and recommendation letter by teacher', which is being submitted to screen and enhance the utilization of gifted students in accordance with recently introduced gifted students observation, recommendation and screening system. For the purpose, this study will provide with objective securing plan of 'observation and recommendation letter by teacher' by developing an optimum evaluation model. The research findings were as follows: First, the result of analysis on the mathematically gifted students behavior characteristic as appeared in 'observation and recommendation letter by teacher' suggested that the recommending teachers have the tendency of giving superficial statement instead of giving concrete case description. When it was analyzed for frequency by the 'observation and recommendation letter by teacher' analysis framework devised by the author, the teachers showed the tendency of concentrating on specific questions. Meanwhile, there was a tendency that teachers concentrate on specific gifted behavior characteristic or area for which concrete case had been suggested. The reason is believed that such part is easy to observe and state while others are not, or, teachers did not judge the other part as the characteristic of gifted students. Second, the gifted students behavior characteristics as appeared in 'observation and recommendation letter by teacher' were made into scores by Rubric model. When the interrater reliability was analyzed based on these scores, the correlation coefficient of 1st scoring was .641. After a discussion session was taken and 2nd scoring was done 3 weeks later, the correlation coefficient of 2nd scoring increased to .732. The reason is believed that; i) the severity among scorers was adjusted by the discussion session after the 1st scoring, ii) the scorers established detail judgment standard on various situations which can appear because of the descriptive nature, and, (iii) they found a consensus on scoring for a new situation appeared. It implies that thorough understanding and application of scorers on evaluation model is as important as the development of optimum model for the differentiation of mathematically gifted elementary students.

• Journal of Korean Home Economics Education Association
• /
• v.21 no.1
• /
• pp.35-49
• /
• 2009

The purpose of this study was to examine the effect of instruction for the development of analytical rubrics based on teacher-student compromise, which would be applied to performance assessment about the ninth-grade housing unit of the 7th national curriculum. In order to find out the influence of the rubric development instruction on learning motivation, two different third-year classes in a middle school were selected respectively as an experimental group and a control group. The way of presenting the rubrics and learning motivation were respectively selected as independent and dependent variables. Both groups took two lessons and a pretest-posttest on learning motivation. As for the analytic rubric for the individual task performance in the housing unit, three evaluation items were selected. As a result, the instruction for the learner-involved development of analytical rubrics for the housing segment had a positive effect on the confidence and satisfaction of the middle schoolers, which were two out of four sub-factors of learning motivation. Open-ended questions showed that the instruction got to build confidence in the course of being aware of the evaluation criteria and fulfilling the given tasks.

• Proceedings of the KAIS Fall Conference
• /
• 2011.12a
• /
• pp.25-28
• /
• 2011

본 연구는 반도체 산업에서 반도체장비유지보수에 사용되어지는 반도체장비 유지보수 분야의 전문기술인력을 효과적으로 양성할 수 있는 반도체장비 유지보수의 자격종목을 개발하고자 하는데 그 목적이 있다. 연구의 목적을 달성하기 위하여 반도체장비 유지보수 분야의 국내외 실태 조사, 문헌조사를 통하여 반도체장비 유지보수 관련 교육훈련기관 및 검정 수요 예상 인력을 파악했으며, 유사자격제도(전자부품장착기능사, 전자부품장착산업기사, 생산자동화기능사, 생산자동화산업기사 등)를 분석하였고, 직무분석을 통하여 반도체장비유지보수기능사의 직무 및 교육내용을 분석하였다. 또한 반도체장비 유지보수 자격종목 신설에 대한 설문조사를 실시했으며, 반도체장비유지보수기능사 자격종목의 출제기준 및 채점 방법을 제시했고, 필기시험과 실기시험에 대한 모의 검정시험도 실시하였다. 이러한 결과를 토대로 반도체장비유지보수기능사에 대한 교육프로그램을 만들었으며, 자격검정을 실시할 수 있는 출제기준을 제시하였다.

• Journal of Korean Home Economics Education Association
• /
• v.20 no.3
• /
• pp.85-105
• /
• 2008

The purpose of this study was to develop a narrative analytic scoring rubric through teacher-students negotiations, as an assessment of tasks using methods of experiment and practice for home economic(HE) in the middle school. In this study. an analytic rubric had been developed in the following three stages: In the first stage, all the things for rubric development were defined and prepared, by selecting tasks used for rubric application through a questionnaire survey, providing detailed directions on methods and procedures and needed items, and selecting a class for rubric negotiation and setting the development schedule. In addition, the method suggested by Ainsworth and Christinson(1998) in Student Generated Rubrics was used. In the second stage, performance criteria for tasks in terms of knowledge, skills, and attitude were developed, setting scoring framework and scales depending on assessment areas. Referring to selected scoring framework and assessment criteria, observable and assessable behaviors were used to describe rubric based on A, B, and C scale. Then, a primary rubric was developed through teacher-students negotiations, using rubrics made by group. In the last stage, the developed primary rubric was reviewed by an expert of HE education to test the validity. Moreover, the analysis to test the suitability of the final rubric assessment tool employed 46 copies of questionnaire collected from incumbent home economics teachers selected by way of random sampling mainly focusing on those teachers who were in the Master's degree program or completed the program at one university. As a result, the average of suitability of aa the rubrics were over 4.0 in th 5-point scale.

• Korean Journal of Social Welfare
• /
• v.60 no.2
• /
• pp.5-28
• /
• 2008

This study tried to develop an test tool of social workers' ethical sensitivity(SWEST) on base of realization about the importance of ethical sensitivity of social worker who are required more ethicalities than the other professionals. Nevertheless, there has been no tool that can measure ethical sensitivity of social workers in our country up to now. Through analysis of existing ethical sensitivity tests in other professions, a paper and pencil method about unstructured question with cases including ethical issues and structured scoring system was chosen as an appropriate method for the SWEST. This study progressed in order : 1st collecting cases, 2nd composing cases, 3rd consulting cases, 4th pilot study, 5th making scoring standards, 6th determining case examples and scoring standards. With the result, the tool consists of 3 case examples with ethical issues : 1) self-determination and confidentiality, 2) equality and double relationship, 3) informed consent and conflict interest. And ethical sensitivities of social work major students and social workers were measured with the SWEST, to see practical utility of this test. The agreement degrees between two independent raters were above 90%. And respondent's ethical sensitivity displayed the most definite difference according to taking or not taking a course 'Social work values and ethics'. Through these results, it can be drawn that the SWEST is reliable and valid to test relevant differences in Korean social workers' ethical sensitivity. The SWEST is expected to activate studying, educating, and practicing ethics in social work.

• Journal of the Korean Geographical Society
• /
• v.47 no.6
• /
• pp.934-954
• /
• 2012

Constructed-response items are useful to estimate a higher-order thinking abilities such as sense of place, graphicacy, and geographical imaginations which are aimed by geography education. This study aims to identify the conception of the constructed-response items, to classify those feasible items in geography education, and to propose some comments and suggestions for development and application in Korea. The author tries to classify the constructed-response items by analyzing the NAEP items in the formal aspect and the aspect of cognitive dimension respectively. In the formal aspect, they are classified as 'question-standalone' type and 'material-presenting' type. In the aspect of cognitive dimension, they are classified into three types as 'knowledge-requirement', 'understanding-requirement', and 'applying-requirement'. Some comments and suggestions are as follows. First, it is necessary to develope the constructed-response items that coherent to both content and cognitive dimensions. Second, it is required for students who take an examination to use a great variety of graphics, photos, thematic maps related to geography. Third, we need to inquire the rubric, grade, process to scoring because they are vital to success of the constructed-response items.

• Journal of the Korean School Mathematics Society
• /
• v.11 no.3
• /
• pp.377-397
• /
• 2008

In today's secondary school mathematics curriculum, assessment is to be focused on evaluating the student's mathematical thinking rather than finding the correct solution to the problem. A descriptive evaluation method is therefore introduced to the school districts and suggested as an alternative assessment method in K-12 school mathematics. Descriptive evaluation method is widely available for use in schools, but there are barriers to using it since the teachers are forced to use the method by the school districts. In this research, we surveyed 120 secondary school mathematics teachers in Seoul and the surrounding metropolitan area to understand the status and the perception about using descriptive evaluation. The goal of the study was to find and understand the direct implications of using the new assessment method in secondary mathematics classes. The study showed that most of the mathematics teachers used the descriptive assessment method during their regular exam periods which is given twice per semester. Most of the open-ended problems used for descriptive evaluation were medium or high level math questions which were graded by the teachers at least 3 times to ensure objective evaluation. The teachers stated that objectivity in grading, administrative situation, and development of descriptive problems were the difficult barriers in descriptive evaluation. The teachers in the survey also commented that teachers' administrative responsibility should be reduced and that school environment in general should be improved for the new assessment method to become successful. Finally, the study showed that development of more descriptive problems with specific grading guidelines need to be developed for each grade level.

• Journal of Engineering Education Research
• /
• v.11 no.4
• /
• pp.46-57
• /
• 2008

The core of accreditation for engineering education is to improve the ability and quality of graduates through CQI system based on outcomes. For the program outcomes of the engineering education accreditation criterion, it is necessary to understand the relationship among education assessment, objective and curriculum. This study has focused on the program outcomes and the assessment. First the measure for improving the general problems of the program outcomes associated with assessment tool have been stated. And the detailed measure for practicing the program outcome, the assessment system and the assessment tool, which makes use of Rubrics, have been discussed. Therefore it is expected that the program outcome and the assessment may be conducted at universities with the assessment tool established in this study.