• Journal of Korean Home Economics Education Association
• /
• v.32 no.3
• /
• pp.135-159
• /
• 2020

The purpose of this study was to develop items of an essay response assessment that could align with the instructions and assessments in the high school home economics curriculum. The contents of the study were as follows. First, to establish an assessment plan, 14 achievement standards were analyzed in the assessment area, and the elements of the questions were developed including the content elements of a total of 29 questions. Second, to develop the assessment tools, preliminary questions suited to the structure of essay questions were developed, and the method of presenting data and scoring criteria to be utilized in the questions was selected. Third, to prepare the answers and the scoring criteria tables, the answers to the sample questions for each score were prepared in form of a scoring criteria table, and the objectives of the assessment, the scoring items, and the scores for each item were reviewed. Fourth, the developed questions and answers were revised and supplemented by teachers of the professional learning community through preliminary and mutual review on the components of the questions, the embodiment of the assessment objectives, the implementation of the assessment intent, and the grading. This study can be used as a foundational study for the development of essay-type questions and scoring criteria in essay assessment in the field of education. Furthermore, the results of this study could help teachers enhance their learners' ability to apply knowledge in the future.

• Journal of The Korean Association For Science Education
• /
• v.28 no.1
• /
• pp.32-46
• /
• 2008

The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

• Journal of the Korean School Mathematics Society
• /
• v.25 no.3
• /
• pp.261-278
• /
• 2022

The purpose of this study is to develop an assessment to diagnose difficulties in learning mathematics and misconstructions that elementary students have. With thorough theoretical background and analysis of mathematics curriculum documents, we established learning trajectories for the following content areas in grades 3 to 6: number and operation, regularity, data and chance, geometry, and measurement. Then, the research team created the assessment items targeting a specific stage in the learning trajectories and including item options to identify possible misconceptions. Based on the unified validity theory, we reported the detailed procedure of the assessment development and the evidence for the content, substance, and structural validity of the assessment. We collected the data of 675 elementary students. Rasch measurement modeling was applied, and Cronbach's alpha was estimated. We considered how to report students' assessment results to teachers appropriately and immediately, which suggested important implications for supporting teaching and learning mathematics in elementary schools. We also suggested how to use the assessment developed in this study in online and distance learning environments due to the COVID-19 pandemic.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.20 no.6
• /
• pp.188-200
• /
• 2019

The purpose of this study is to extend the research on the development of the performance indicators for the Education Welfare Priority Support Project and to secure the content validity for the application to the school site. The performance index of the Education Welfare Priority Support Project used in this study was originally consisted of 6 area, 33 sub-area, and 233 items. Two expert meetings were held for five doctoral professionals in the field of educational welfare. Delphi surveys were conducted for a group of 99 educational welfare workers who worked at the site for more than five years. The item selection criteria ($CVR{\geq}.29$, $CVI{\geq}.80$, convergence <.50, agreement ${\geq}.05$, stability ${\leq}.80$, $M{\geq}3.00$, SD <.80, reliability ${\geq}.6$) were applied. The 6 area, 23 sub-areas, and 93 items were verified and finally 90 items were selected from removing 3 items with low level of reliability. Providing suggestions and follow-up studies for the better use of the performance indicators for the Education Welfare Priority Support Project in the field.

• Korean Journal of Social Welfare
• /
• v.67 no.2
• /
• pp.5-31
• /
• 2015

This study aims to develop the corporate philanthropy scale focusing on the guidelines of ISO26000 and to test its reliability and validity. For the purpose of this study, author conducted focus group interview, individually interview, consult and pilot test in order to clarify description and relevance of scale items. To test reliability and validation of scale, 94 staffs in charge of the corporate philanthropy work in the companies were surveyed as research subjects. The results of the explanatory factor analysis on scale found the six factor structure and 27 items. The construct validity and discriminant validity were confirmed through the confirmatory factor analysis. The reliability of the scale also remained at a high level. Based on these results, implications for corporate philanthropy was suggested.

• Journal of The Korean Association of Information Education
• /
• v.11 no.2
• /
• pp.147-155
• /
• 2007

Paper & pencil test provides limited informations about student. So many web-based computerized test systems are developed and tried. But These systems have drawbacks that cannot visit previous or next problems freely. So These systems cannot get deep informations such as elapsed time of each problem, history of answer modification, the number of visit time of each problem. These deep informations are very important in educational evaluation area. Therefore we develop educational evaluation system can get these deep informations including basic informations. And then we apply paper & pencil test and our system to 67 students, and execute survey. The reason of survey is to ascertain availabilty of our system.

• Korean Educational Research Journal
• /
• v.38 no.1
• /
• pp.29-39
• /
• 2017

This study analyzes the items of acid base and redox unit in the middle school science textbook based on the 2009 revised science curriculum using Bloom's taxonomy of educational objectives. As a result of the analysis, the elements of knowledge area appeared the most in textbook items of all publishing companies, and those elements were less in order of understanding, application, analysis, synthesis and evaluation. And the sub-domain of cognitive domains were not evenly distributed by the publisher. Therefore, schools need to refer to the evaluation items of the textbooks of various publishing companies and use them in class.

• Journal of The Korean Association For Science Education
• /
• v.33 no.2
• /
• pp.229-248
• /
• 2013

The purpose of this study is to develop sequential concept tests (ConcepTest) for teachers' conceptual change on the straight propagation of light through in-service training of science teachers by peer instruction. We revised the ConcepTests for attaining the goal concept by implementing similar training courses for teachers three times and analyzing the results using both Hake gain and verbal protocol. The final form helped most teachers to reach the goal concept. While teachers are solving a given concept problem test, they had shown not only significant cognitive conflict to select one among candidate answers, but also used the concept obtained through the previous problem. The sequential ConcepTests developed in this study can be useful for training elementary and secondary teachers or pre-service teacher education.

• Journal of Gifted/Talented Education
• /
• v.25 no.6
• /
• pp.817-836
• /
• 2015

This research focuses on the development of gifted child behavior checklist which feasibly has application on the nation-wide gifted children observation-recommendation method. Corresponding measure has significance as it reflects actual observations of teachers teaching gifted children first-hand and involves measure of importance regarding each characteristic. An open survey on gifted children behavior characteristics lists and specific behavior patterns has been acquired from teachers in gifted education, and the checklist was developed through expert group review, pre-test, and confirmatory factor analysis process. The former checklists have shown several difficulties on application of observation-recommendation on the field due to behaviors that can't be observed in school, less important behaviors, and collide and duplicate behaviors etc. With regard to such problems, problematic clauses were removed based on the observation probability and importance of the behaviors. Ultimately, total of 32 behavior characteristic checklist consisting of ten sub factors(logical thinking, high achievement, originality, perfectionism, creative problem solving, curiosity, task commitment, conversation ability, creativity, passion) and two to three questions on each factor had been drawn. Through internal consistency test and item-total score correlation, each item of the measure has been analyzed to be consistently evaluating corresponding variables. In addition, the result of confirmatory factor analysis showed every item to be weighed appropriately on its sub-factor, strongly suggesting its feasibility on observation-recommendation of elementary gifted children as an appropriate checklist.

• Journal of the Korean earth science society
• /
• v.24 no.3
• /
• pp.150-159
• /
• 2003

This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.