• 아동학회지
• /
• 제23권4호
• /
• pp.199-213
• /
• 2002

This preliminary study aimed to develop 3 assessment scales for self-evaluation by day care directors and teachers. The development of major areas of evaluation and items as well as evaluation criteria for each item was based on the analysis of related research and major evaluation instruments. A panel of experts in early childhood education examined the contents. The 3 preliminary scales were administered in 87 day care centers; data were analyzed by item response distribution, item discrimination, and reliability of the scales. Items indicating low item discrimination were deleted and minor revisions were made to improve psychometric characteristics of each scale. The final version of the 3 scales is valid for use as self-evaluation instruments by day care directors and teachers.

• East Asian mathematical journal
• /
• 제32권2호
• /
• pp.217-232
• /
• 2016

The purpose of this study is to investigate the assessment expertise of Mathematics' teachers, focusing on the competence in designing assessment item development. In this present research, I analysed how the teachers' competence appears in designing assessment items development when they generated problems the given problem into a new one. To examine this assumption, the following research questions were posed and investigated in the present study : How do Pre-service and In-service Teachers in primary schools develop the assessment item when generating problems the given problems into new problems? The result from the case study of metamorphosing the given problem into a new problem teachers used similar patterns switching numbers or changing units in order to develop new problems. Also, teachers in primary schools tend to develop problems as commonly as in the mathematics workbooks. In-service teachers tend to have better skills developing assessment items, but there were quite much of variability between individuals.

• 한국수학교육학회지시리즈C:초등수학교육
• /
• 제8권2호
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• Human Ecology Research
• /
• 제62권2호
• /
• pp.197-216
• /
• 2024

The dual aims of this study were i) to explore the effectiveness of an assessment method that can measure the competencies learned through high school home economics and ii) develop a competency-based assessment framework for high school home economics, including components of competency-based assessment, item development system, and other elements. The study involved the following stages: literature analysis, draft development, concretization, validity verification, and final version. Based on the results of the literature analysis and expert deliberation, a competency-based assessment framework for high school home economics was developed which comprised three dimensions: 'core idea' × 'process' × 'context and value'. Based on this, an item analysis table was presented to systematize various activities for the competency-based assessment of high school home economics, following which a holistic rubric suitable for competency assessment tasks was proposed by referring to the newly developed 'process' dimension assessment criteria. This study is significant in that it is the first to propose a competency-based assessment framework that systematically presents a variety of assessment activities. These will facilitate the development of assessment standards and tools that teachers can refer to or trust in the changing school environment due to the introduction of the standard-based assessment system based on a high school credit system, and the guarantee of a minimum achievement level.

• 아동학회지
• /
• 제24권3호
• /
• pp.135-149
• /
• 2003

This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

• 의학교육논단
• /
• 제15권3호
• /
• pp.105-111
• /
• 2013

This paper addressed various issues related to the objectivity of student assessment in medical education. The objectivity of assessment was related to all the steps of test development, administration, and results reporting in terms of reliability and validity. Specifically, the objectivity of item formats, representativeness of test content, standardization of test administration, consistency of scoring procedures, and appropriateness of reporting test results were discussed by comparing performance assessment with traditional paper-and-pencil tests. The conclusions were derived from current measurement theories such as standards-based assessment, evidencebased design, and outcome-based assessment. Further, based on Shepard's propositions (2006), the objectivity of student assessment could be achieved by improving the concordance between educational objectives and assessment components such as item types, test contents, and test administration, scoring, and reporting.

• 한국해양공학회지
• /
• 제24권2호
• /
• pp.74-81
• /
• 2010

Ship STEP is the international standard for the exchange of ship modeling data between heterogeneous systems. It is expected that STEP AP218 can be used for seamless data exchange between various CAD/CAM/CAE systems used in the shipbuilding design process. Although the conformance assessment for standards would maximize the performance and confidence about data exchanges, most research has been directed toward interoperability testing. ISO SC4/TC184 only provides the method for conformance testing, and it can be used with test cases on application protocols. Even though standards have been defined for conformance assessment and testing, there is no organization or association. CAD vendors have focused on interoperability testing for evaluation of the performance of their systems. In this paper, the conformance testing criteria for AP218 have been developed with abstract test cases of ship structures. The requested STEP translator was also reviewed with a developed item pool of testing criteria. The criteria methodology would be a guideline for the development of translators and interfaces. The item pool method of testing criteria for conformance assessment would increase performance and efficiency of data translators for Ship STEP and other standards.

• 과학교육연구지
• /
• 제37권2호
• /
• pp.348-358
• /
• 2013

과학교육에서 컴퓨터는 교수 학습 뿐 아니라 평가의 목적으로도 활용되고 있다. 죽, 컴퓨터의 장점을 살린 컴퓨터 기반 평가가 실시되고 있다. 그러나 이와 같은 평가는 주로 과정 중심이 아닌 결과 중심의 평가이며, 피험자의 수만큼 컴퓨터가 있어야 하므로 학교의 정규 시험으로 활용하기 곤란하다. 그러나 수행평가의 경우 일반적으로 평가 과제가 미리 공개되므로 학급별 또는 학생별로 평가 시간이 다르게 평가를 실시하는 것이 가능하다. 따라서 본 연구에서는 실제 실험기구를 사용한 실험평가를 대체할 수 있는 컴퓨터 기반 수행평가 문항을 개발하였다. 이를 위해 먼저 물리 교사를 대상으로 과학교육에 있어 이러한 기능에 대한 평가의 필요성 및 어려운 점 등에 대한 설문조사를 실시하였고, 이를 반영하여 전류계와 전압계를 포함한 회로를 구성을 하는 평가 문항을 개발하였다. 개발된 컴퓨터 기반 문항은 실제의 실험기구를 사용하여 진행되는 평가와 유사하게 구성하였으며 평가 과정에서 학생들의 수행에 따라 적절한 피드백을 제공하고, 수행 결과를 자동적으로 채점할 수 있도록 하였다. 이를 위해 컴퓨터가 학생들의 수행 결과의 정확성을 판단할 수 있는 알고리즘을 개발하였다.

• 한국임상보건과학회지
• /
• 제8권2호
• /
• pp.1426-1435
• /
• 2020

Objective: This study aims to develop CFT, a screening test for dementia that can be conducted on patients with mild cognitive impairment or early dementia. Methods: This study was conducted on therapists working at occupational therapy hospital in Gyeongsangnam-do. The data collection period is two months from July to September 2020, and the research participants were briefed on the purpose, significance, and anonymity of the research in consideration of ethical issues. A total of 33 copies of the data were finally analyzed, excluding those containing insufficient answers and errors, by distributing 40 copies of the data. SPSS Data Access pack 8.0 was used for data analysis, Cronbach's α value was evaluated for internal consistency reliability of each item, and Pearson Correlation coeffient between the lower scales of the assessment tool was measured. Results: The Cronbach's α value of the CFT was shown as .892 and the reliability of the assessment paper was shown to be quite high. The Cronbach's α value for each item in the cognitive assessment tool was the highest at .899 in the subtraction item, with exercise control (mook Chi Pa) at 888, visual memory, plus .887. The correlation of each item of cognitive assessment tools was found to be most correlated with the number of sustained concentrates and word2 to .934; in the stop word-numeric item and visual memory to be .85; and in the addition to the auditory memory item .739. Conclusion: Therefore, this study developed cognitive evaluation tools that can distinguish the diversity and cognitive level of screening tests and clarify standards, which are different from the existing dementia screening tools in Korea. Furthermore, the cognitive assessment tools of this study can be verified by applying them to patients with mild cognitive impairment and early dementia, and the criteria for generalization can be established.

• 한국건축시공학회:학술대회논문집
• /
• 한국건축시공학회 2012년도 춘계 학술논문 발표대회
• /
• pp.151-152
• /
• 2012

Recently, there are growing interests in building LCCO₂ Assessment to reduce carbon emissions. However, existing methods of assessment system include inefficiency in the process of CO₂ calculation requiring considerable data input. Therefore, the purpose of this study is to develop an efficient building assessment system appropriate to material production in construction stage. To that end, quantity input technology was limited to data mapping. Also quantity calculation based on work breakdown structure and item codes consisted of hierarchical structure that is based on facet classification were analyzed. As a result, connectivity links of quantity calculation and CO₂ functional units through item codes for data mapping, and assessment system including calculation and database parts were developed.