• Title/Summary/Keyword: Assessment Item Development

Search Result 228, Processing Time 0.024 seconds

The Development of Assessment Scales for Day Care Programs (어린이집 프로그램 평가척도의 개발을 위한 예비연구)

  • Rhee, Unhai;Song, Hye Rin;Shin, Hye Young;Choi, Hye Yeong
    • Korean Journal of Child Studies
    • /
    • v.23 no.4
    • /
    • pp.199-213
    • /
    • 2002
  • This preliminary study aimed to develop 3 assessment scales for self-evaluation by day care directors and teachers. The development of major areas of evaluation and items as well as evaluation criteria for each item was based on the analysis of related research and major evaluation instruments. A panel of experts in early childhood education examined the contents. The 3 preliminary scales were administered in 87 day care centers; data were analyzed by item response distribution, item discrimination, and reliability of the scales. Items indicating low item discrimination were deleted and minor revisions were made to improve psychometric characteristics of each scale. The final version of the 3 scales is valid for use as self-evaluation instruments by day care directors and teachers.

  • PDF

A Study on Pre-service and In-service Teachers' of Primary School, Competence in Designing Mathematical Assessment Item Development (초등 예비교사와 현직교사의 수학 평가문항 개발사례 연구)

  • Park, Mi-Yeong
    • East Asian mathematical journal
    • /
    • v.32 no.2
    • /
    • pp.217-232
    • /
    • 2016
  • The purpose of this study is to investigate the assessment expertise of Mathematics' teachers, focusing on the competence in designing assessment item development. In this present research, I analysed how the teachers' competence appears in designing assessment items development when they generated problems the given problem into a new one. To examine this assumption, the following research questions were posed and investigated in the present study : How do Pre-service and In-service Teachers in primary schools develop the assessment item when generating problems the given problems into new problems? The result from the case study of metamorphosing the given problem into a new problem teachers used similar patterns switching numbers or changing units in order to develop new problems. Also, teachers in primary schools tend to develop problems as commonly as in the mathematics workbooks. In-service teachers tend to have better skills developing assessment items, but there were quite much of variability between individuals.

An Analysis of Assessment Item on the Fraction Computation Ability for Fifth Grade Student (초등학교 5학년 학생들의 분수 연산능력 평가 문항에 대한 분석)

  • Lee Kang Sup;Kim Kyou Sang
    • Education of Primary School Mathematics
    • /
    • v.8 no.2 s.16
    • /
    • pp.61-68
    • /
    • 2004
  • The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

  • PDF

Development of a Competency-Based Assessment Framework for High School Home Economics (고등학교 가정과의 역량 기반 평가 프레임워크 개발)

  • Young Sun Choi;Mi Jeong Park
    • Human Ecology Research
    • /
    • v.62 no.2
    • /
    • pp.197-216
    • /
    • 2024
  • The dual aims of this study were i) to explore the effectiveness of an assessment method that can measure the competencies learned through high school home economics and ii) develop a competency-based assessment framework for high school home economics, including components of competency-based assessment, item development system, and other elements. The study involved the following stages: literature analysis, draft development, concretization, validity verification, and final version. Based on the results of the literature analysis and expert deliberation, a competency-based assessment framework for high school home economics was developed which comprised three dimensions: 'core idea' × 'process' × 'context and value'. Based on this, an item analysis table was presented to systematize various activities for the competency-based assessment of high school home economics, following which a holistic rubric suitable for competency assessment tasks was proposed by referring to the newly developed 'process' dimension assessment criteria. This study is significant in that it is the first to propose a competency-based assessment framework that systematically presents a variety of assessment activities. These will facilitate the development of assessment standards and tools that teachers can refer to or trust in the changing school environment due to the introduction of the standard-based assessment system based on a high school credit system, and the guarantee of a minimum achievement level.

Development and Validation of an Observation Scale for Day Care Programs (어린이집 프로그램 관찰척도의 개발과 타당화)

  • Rhee, Unhai;Choi, Hye Yeong;Song, Hye Rin;Shin, Hye Young
    • Korean Journal of Child Studies
    • /
    • v.24 no.3
    • /
    • pp.135-149
    • /
    • 2003
  • This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

  • PDF

Issues Related to the Objectivity of Student Assessment in Medical Education (의학교육 학생평가의 객관성에 대한 쟁점)

  • Min, Kyung-Seok;Yang, Kil-Seok
    • Korean Medical Education Review
    • /
    • v.15 no.3
    • /
    • pp.105-111
    • /
    • 2013
  • This paper addressed various issues related to the objectivity of student assessment in medical education. The objectivity of assessment was related to all the steps of test development, administration, and results reporting in terms of reliability and validity. Specifically, the objectivity of item formats, representativeness of test content, standardization of test administration, consistency of scoring procedures, and appropriateness of reporting test results were discussed by comparing performance assessment with traditional paper-and-pencil tests. The conclusions were derived from current measurement theories such as standards-based assessment, evidencebased design, and outcome-based assessment. Further, based on Shepard's propositions (2006), the objectivity of student assessment could be achieved by improving the concordance between educational objectives and assessment components such as item types, test contents, and test administration, scoring, and reporting.

Development of Conformance Testing Criteria for STEP AP218 (Ship Structure) (선체구조 모델 데이터의 교환 표준에 따른 적합성 시험 기준의 개발)

  • Hwang, Ho-Jin
    • Journal of Ocean Engineering and Technology
    • /
    • v.24 no.2
    • /
    • pp.74-81
    • /
    • 2010
  • Ship STEP is the international standard for the exchange of ship modeling data between heterogeneous systems. It is expected that STEP AP218 can be used for seamless data exchange between various CAD/CAM/CAE systems used in the shipbuilding design process. Although the conformance assessment for standards would maximize the performance and confidence about data exchanges, most research has been directed toward interoperability testing. ISO SC4/TC184 only provides the method for conformance testing, and it can be used with test cases on application protocols. Even though standards have been defined for conformance assessment and testing, there is no organization or association. CAD vendors have focused on interoperability testing for evaluation of the performance of their systems. In this paper, the conformance testing criteria for AP218 have been developed with abstract test cases of ship structures. The requested STEP translator was also reviewed with a developed item pool of testing criteria. The criteria methodology would be a guideline for the development of translators and interfaces. The item pool method of testing criteria for conformance assessment would increase performance and efficiency of data translators for Ship STEP and other standards.

The Development of Science Item on the Computer-Based Performance Assessment: A Experiment on Constructing Circuits with an Ammeter and a Voltmeter (컴퓨터 기반 과학 수행평가 문항 개발 : 전류계와 전압계 회로 연결 실험)

  • Choi, Hyukjoon
    • Journal of Science Education
    • /
    • v.37 no.2
    • /
    • pp.348-358
    • /
    • 2013
  • The purpose of this study is to develop the science item on computer-based performance assessment which is able to replace the assessment with actual experimental apparatus. The survey on the necessities and the difficulties of the assessment with actual experimental apparatus was conducted with 57 physics teachers. By reflecting the results of the survey, the computer-based assessment items which are related with constructing circuits with an ammeter and a voltmeter were developed. The developed computer-based assessment items were organized in similarity to assessment conducted with actual experimental apparatus, proper feedback was provided by students' performance in the process of assessment so as to grading performance results automatically. To achieve them, the algorithm was developed so that computer can judge the accuracy of students' performance results.

  • PDF

The study of development on CFT(Cognitive Function Test) in mild cognitive impairment (경도인지장애 대상자의 인지기능평가도구(CFT) 개발 연구)

  • Lee, Seon-Myeong;Ju, Eun-U;Song, Jin-Seok;Park, Sin-Jun;Kim, Heon-Mo;Jeong, Eun-Seung;Im, Chae-Ho;Son, Seong-Min;Ha, Hye-Jeong
    • Journal of Korean Clinical Health Science
    • /
    • v.8 no.2
    • /
    • pp.1426-1435
    • /
    • 2020
  • Objective: This study aims to develop CFT, a screening test for dementia that can be conducted on patients with mild cognitive impairment or early dementia. Methods: This study was conducted on therapists working at occupational therapy hospital in Gyeongsangnam-do. The data collection period is two months from July to September 2020, and the research participants were briefed on the purpose, significance, and anonymity of the research in consideration of ethical issues. A total of 33 copies of the data were finally analyzed, excluding those containing insufficient answers and errors, by distributing 40 copies of the data. SPSS Data Access pack 8.0 was used for data analysis, Cronbach's α value was evaluated for internal consistency reliability of each item, and Pearson Correlation coeffient between the lower scales of the assessment tool was measured. Results: The Cronbach's α value of the CFT was shown as .892 and the reliability of the assessment paper was shown to be quite high. The Cronbach's α value for each item in the cognitive assessment tool was the highest at .899 in the subtraction item, with exercise control (mook Chi Pa) at 888, visual memory, plus .887. The correlation of each item of cognitive assessment tools was found to be most correlated with the number of sustained concentrates and word2 to .934; in the stop word-numeric item and visual memory to be .85; and in the addition to the auditory memory item .739. Conclusion: Therefore, this study developed cognitive evaluation tools that can distinguish the diversity and cognitive level of screening tests and clarify standards, which are different from the existing dementia screening tools in Korea. Furthermore, the cognitive assessment tools of this study can be verified by applying them to patients with mild cognitive impairment and early dementia, and the criteria for generalization can be established.

Development of Buildng LCCO2 Assessment System through Data Mapping Technology. (데이터 맵핑기술을 이용한 건축물 LCCO2 평가시스템 개발)

  • Keum, Won-Seok;Tae, Sung-Ho;Roh, Seung-Jun;Bang, Jun-Sik
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2012.05a
    • /
    • pp.151-152
    • /
    • 2012
  • Recently, there are growing interests in building LCCO2 Assessment to reduce carbon emissions. However, existing methods of assessment system include inefficiency in the process of CO2 calculation requiring considerable data input. Therefore, the purpose of this study is to develop an efficient building assessment system appropriate to material production in construction stage. To that end, quantity input technology was limited to data mapping. Also quantity calculation based on work breakdown structure and item codes consisted of hierarchical structure that is based on facet classification were analyzed. As a result, connectivity links of quantity calculation and CO2 functional units through item codes for data mapping, and assessment system including calculation and database parts were developed.

  • PDF