• Title/Summary/Keyword: constructed-response item

Search Result 28, Processing Time 0.024 seconds

A Preliminary Study on the Development of a Developmental Test for Toddlers and Preschoolers (영유아용 (만 2세~5세) 발달검사 개발을 위한 예비연구)

  • Rhee, Unhai;Park, Juhee;Choi, Hye-Yeong
    • Korean Journal of Child Studies
    • /
    • v.26 no.6
    • /
    • pp.73-88
    • /
    • 2005
  • This study aimed to develop a reliable and valid developmental test for toddlers and preschoolers. A trial form of the test with 230 items in 5 domains(cognitive, physical, language, social, and self-help) was constructed and administered to 200 children from 2 to 5-year-olds. Item analysis indicated that most items selected in cognitive, physical, and indicated domain were acceptable in terms of item response rate and item discrimination. However, some items in social and self-help domain did not show clear age trends in item response, but mostly were adequate in item discrimination. Based on item analysis, 112 items were selected for the final form : 24 items each for the cognitive, physical, and language domain; 20 items each for the social and self-help domain. Reliability indicated by internal consistency coefficients(KR-20) were high in all domains. Validity of the test was supported by inter-correlations among 5 domains(.61 to .93), and significant age differences in domain scores.

  • PDF

Exploring 6th Graders Learning Progression for Lunar Phase Change: Focusing on Astronomical Systems Thinking (달의 위상 변화에 대한 초등학교 6학년 학생들의 학습 발달과정 탐색: 천문학적 시스템 사고를 중심으로)

  • Oh, Hyunseok;Lee, Kiyoung
    • Journal of the Korean earth science society
    • /
    • v.39 no.1
    • /
    • pp.103-116
    • /
    • 2018
  • The purpose of this study was to explore $6^{th}$ graders learning progression for lunar phase change focusing astronomical systems thinking. By analyzing the results of previous studies, we developed the constructed-response items, set up the hypothetical learning progressions, and developed the item analysis framework based on the hypothetical learning progressions. Before and after the instruction on the lunar phase change, we collected test data using the constructed-response items. The results of the assessment were used to validate the hypothetical learning progression. Through this, we were able to explore the learning progression of the earth-moon system in a bottom-up. As a result of the study, elementary students seemed to have difficulty in the transformation between the earth-based perspective and the space-based perspective. In addition, based on the elementary school students' learning progression on lunar phase change, we concluded that the concept of the lunar phase change was a bit difficult for elementary students to learn in elementary science curriculum.

Dialog-based multi-item recommendation using automatic evaluation

  • Euisok Chung;Hyun Woo Kim;Byunghyun Yoo;Ran Han;Jeongmin Yang;Hwa Jeon Song
    • ETRI Journal
    • /
    • v.46 no.2
    • /
    • pp.277-289
    • /
    • 2024
  • In this paper, we describe a neural network-based application that recommends multiple items using dialog context input and simultaneously outputs a response sentence. Further, we describe a multi-item recommendation by specifying it as a set of clothing recommendations. For this, a multimodal fusion approach that can process both cloth-related text and images is required. We also examine achieving the requirements of downstream models using a pretrained language model. Moreover, we propose a gate-based multimodal fusion and multiprompt learning based on a pretrained language model. Specifically, we propose an automatic evaluation technique to solve the one-to-many mapping problem of multi-item recommendations. A fashion-domain multimodal dataset based on Koreans is constructed and tested. Various experimental environment settings are verified using an automatic evaluation method. The results show that our proposed method can be used to obtain confidence scores for multi-item recommendation results, which is different from traditional accuracy evaluation.

An In-depth Analysis of the Result of the International Comparative Study of Mathematics (학업 성취도 국제 비교 연구에 나타난 우리나라 학생들의 수학 성취도 심층 분석)

  • Park Kyung Mee
    • Journal of Educational Research in Mathematics
    • /
    • v.14 no.4
    • /
    • pp.387-401
    • /
    • 2004
  • The recent international comparative studies such as PISA(Program for International Student Assessment) and TIMSS-R(Third International Mathematics and Science Study-Repeat) provide results of relative mathematics achievement of participating countries. The purpose of this paper is to compare the mathematics results of PISA and TIMSS-R. To make PISA and TIMSS-R results comparable, they were standardized. The close investigation of these standardized results reveals that the two Asian countries(Korea and Japan) and several English speaking countries have the commonality in mathematics achievement. Thus this study looks for patterns and similarities within a group of Asian countries(Korea and Japan) and Western countries(the U.S and Australia) by in-depth analysis of PISA mathematics achievement based on item response theory. As a result, it was noted that Western countries tend to perform well on open constructed items and are likely to perform better when an item involves less formal mathematics. On the other hand, Asian countries perform well when an item involves numeric or algebraic computation related to curriculum-based content, but they are relative poor at an item calls for verbal explanations or interpretations of graphs.

  • PDF

A Study on the Classification of Constructed-Response Items in Geography Education: In Case of 4th Grade Items of the NAEP (지리과 서답형 문항의 주요 유형에 관한 연구 -NAEP의 지리과 4학년 문항을 사례로-)

  • Jang, Eui-Sun
    • Journal of the Korean Geographical Society
    • /
    • v.47 no.6
    • /
    • pp.934-954
    • /
    • 2012
  • Constructed-response items are useful to estimate a higher-order thinking abilities such as sense of place, graphicacy, and geographical imaginations which are aimed by geography education. This study aims to identify the conception of the constructed-response items, to classify those feasible items in geography education, and to propose some comments and suggestions for development and application in Korea. The author tries to classify the constructed-response items by analyzing the NAEP items in the formal aspect and the aspect of cognitive dimension respectively. In the formal aspect, they are classified as 'question-standalone' type and 'material-presenting' type. In the aspect of cognitive dimension, they are classified into three types as 'knowledge-requirement', 'understanding-requirement', and 'applying-requirement'. Some comments and suggestions are as follows. First, it is necessary to develope the constructed-response items that coherent to both content and cognitive dimensions. Second, it is required for students who take an examination to use a great variety of graphics, photos, thematic maps related to geography. Third, we need to inquire the rubric, grade, process to scoring because they are vital to success of the constructed-response items.

  • PDF

Construction of Parent attachment Scale for Children (초등학생용 부모애착척도의 구성)

  • Lee, Hyun-Sook;Hong, Sang-Hwang
    • The Korean Journal of Elementary Counseling
    • /
    • v.9 no.2
    • /
    • pp.143-162
    • /
    • 2010
  • The purpose of this study is to construct Parent Attachment Scale for Children. Adapting the item consisting method used in Experiences in Close Relationships-Revised(ECR-R), Parent Attachment Scale for Children was constructed to measure child's attachment style with their parent, reliably and validly. Also, reliability and item trait informations based on item response theory were reviewed. First preliminary items were derived from the original items of ECR-R and existing Attachment Inventories. These items were modified and complemented to be easier and keep the original meaning of each item. Second preliminary items were administrated to 4~6th grades students(N=576). Finally, Parent Attachment Scale for Children were consisted with 30 items based on two-parameter graded response model. Internal consistency ranges of the scales of Parent Attachment Scale for Children are as follows : Avoidance scale is .94~.96; Anxiety scale is .85~.88. Test-retest reliability ranges are as follows; Avoidance scale is .71~.80; Anxiety scale is .53~.68. Item discrimination and item information value were within an appropriated range. Hierarchical cluster analysis with Ward's Method revealed four types of attachment style : Secure, Dismissing, Preoccupied, Fearful. Other implications and limitations of this study were discussed.

  • PDF

A Proposal of Curriculum and Teaching Sequence for Seasonal Change by Exploring a Learning Progression (학습 발달과정 탐색을 통한 계절의 변화 교육과정 및 교수 계열 제안)

  • Heo, Jaewan;Lee, Kiyoung
    • Journal of the Korean earth science society
    • /
    • v.39 no.3
    • /
    • pp.260-274
    • /
    • 2018
  • The purpose of this study was to propose curriculum and teaching sequence for seasonal change by exploring a learning progression. For the purpose, 4 steps of construct modeling approach (specifying construct, item design, outcome space, and measurement model) proposed by Wilson (2005) was applied. In the stage of specifying construct, 'length of shadow according to seasons', 'position of constellation according to seasons', 'seasons of the southern hemisphere and northern hemisphere', 'cause and phenomenon of seasonal change' were selected as the subconstructs of seasonal changes, and constructed a construct map showing the level of development from level 1 to level 4 for each subconstruct based on the results of the previous research. In the item design stage, we developed five assessment items consisting of 3 items in the form of C-E (choose and explain) and two items in the form of CR (constructed response), applied it to 383 elementary, middle and high school students. In the outcome space stage, the students' responses to the assessment items were categorized based on the construct map. The categories were classified into 4 levels according to student ability and scores of 1-4 were given. In the measurement model stage, we applied the partial credit model of the Rasch model and compared whether the learning pathway created from the results of students' response coincides with the construct map. Based on the results of the research, we modified the construct map and finally created hypothetical learning progression on seasonal change. Finally, we proposed an orientation of curriculum amendment and effective teaching sequence for seasonal change.

Development of a Rubric for Assessing Middle School Students' Conceptual Understanding about Dew Point (이슬점에 대한 중학생들의 개념 이해 평가 루브릭 개발)

  • Lee, Kiyoung;Lee, Jaebong;Oh, Hyunseok
    • Journal of the Korean earth science society
    • /
    • v.41 no.6
    • /
    • pp.684-694
    • /
    • 2020
  • In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

Development a Korean Scale of Paternal Involvement in the Early Adolescence of Their Children (중학생 자녀를 둔 한국 아버지의 양육참여 척도의 개발 - 중학생 자녀와 아버지간의 상호작용을 중심으로 -)

  • Kim, Hee Hwa
    • Korean Journal of Child Studies
    • /
    • v.26 no.1
    • /
    • pp.107-121
    • /
    • 2005
  • The preliminary Korean Paternal Involvement Scale of 84 items was constructed from items collected from free-response surveys with 106 middle school students and 33 fathers followed by consultation with experts. Those items were tested on a sample of 339 middle school students. The 82 items selected through item analysis were analyzed by factor analysis. Of these, 54 items were categorized into seven factors : leisure-life, proffering information, discipline, academic support, tradition-inheritance, material support, and everyday life. Leisure-life, proffering information, and academic support correlated with grade level of adolescents and fathers' education. The alpha coefficients of this scale ranged from .68 to .90.

  • PDF

A Study on the Classification of Student's Bluffing on Geographical Terms (지리 용어에 대한 학습자의 블러핑(Bluffing) 유형에 관한 연구)

  • Jang, Eui-Sun
    • Journal of the Korean Geographical Society
    • /
    • v.49 no.4
    • /
    • pp.615-632
    • /
    • 2014
  • This study aims to explore 'bluffing', one of the most important topics in order to ensure the objectivity, validity, reliability of scoring of constructed-response items. The author identifies the conception of bluffing, and classifies major types of bluffing on the basis of previous studies on the theoretical level. Next, the author analyzes empirically the bluffing strategies and types of learners on key terms of Korean Geography subject. Compared with the existing research reports, the result of this study shows a significantly lower average bluffing score. On the other hand, it is consistent in results of previous studies reported that average bluffing score is similar between genders and that those students who got highest grades did least bluffing. Actually bluffing types are classified into four categories: 'repeating the question' type, 'depending on a well-known or existing knowledge' type, 'applying some basic concepts regardless of understanding' type, and 'inducing scorer's basic beliefs' type. Some comments and suggestions are as follows. First, it is necessary to continue researches of the relations among bluffing and age, gender, grade, intelligence and learning styles. Second, it is required for scorers who score constructed-response items to develop and supply the scoring guide including analysis contents of bluffing types and cases, and increase opportunity for training. Third, we need to inquire the domain-specific bluffing types in geography subject based on the generalizable sample size.

  • PDF