• Title/Summary/Keyword: 문항 적합도

Search Result 408, Processing Time 0.028 seconds

Effects of Systems Thinking on High School Students' Science Self-Efficacy (시스템 사고가 고등학생의 과학 자기 효능감에 미치는 영향)

  • Lee, Hyundong;Lee, Hyonyong
    • Journal of the Korean earth science society
    • /
    • v.37 no.3
    • /
    • pp.173-185
    • /
    • 2016
  • The purpose of this study is to investigate the effects of systems thinking on high school students' self-regulatory efficacy and self-confidence that constitute science self-efficacy. We set self-regulatory efficacy as a factor of students' systems thinking affects their self-confidence on science through self-regulatory efficacy. A total of 210 students were sampled from general high schools and 188 valid cases were analyzed. The instrument has 39 items that consist of 20 items measuring systems thinking and 19 items of science self-efficacy. The result of the exploratory factor analysis indicated that 20 items for systems thinking, 8 items for self-regulatory efficacy, 4 items for self-confidence are reasonable. Testing the goodness of fit of a structural equation model, it turn out to be appropriate (${\chi}^2$=344.498, df=242, TLI= .921, RMSEA= .044) using 24 items (mental model, personal mastery, systems analysis, self-regulatory efficacy, and self-confidence were constructed). In addition, the mental model, which is one factor of systems thinking, is mediated by self-regulatory efficacy that affects self-confidence directly and/or indirectly. The results suggest that systems thinking affects science self-efficacy directly and indirectly. Utilizing systems thinking in science education can produce a theoretical basis in improving students' confidence and self-efficacy about science.

Development of a Measure for the Dance Giftedness (무용영재성 판별도구 개발)

  • Lee, Jin-Hyo;Lee, Jin-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.3
    • /
    • pp.161-170
    • /
    • 2012
  • Based on the qualitative analysis, 4 factors of dance giftedness were operationally defined and test items were initially developed accordingly. The preliminary test data obtained from 206 dancers was analyzed, using item analysis and a series of reliability analyses. In order to dancer the construct validity, four exploratory factor analyses were conducted for 54 items, resulting in 20 items of 4 factors; physique, dance attitude Expressiveness and creativity, movement ability. A confirmatory factor analysis conducted for 292 dancers to test the goodness-of-fit of 4 factor model revealed a satisfactory level of $x^2$, Q, root mean square residual(RMR), goodness of fit index(GFI), Tucker-Lewis index(TLI), comparative fit index(CFI), root mean square error of approximation(RMSEA). The concurrent and cross validity indices proved the validity of 20 items of 4 factors.

Developing and Applying the Questionnaire to Measure High School Students' Unskeptical Attitude in Science Inquiry (과학탐구 상황에서 고등학생들의 반회의주의적 태도 측정도구 개발 및 적용)

  • Rachmatullah, Arif;Ha, Minsu
    • Journal of Science Education
    • /
    • v.42 no.3
    • /
    • pp.308-321
    • /
    • 2018
  • The purpose of the study is to develop a questionnaire that examines unskeptical attitudes in scientific inquiry context. The questionnaire items were developed through literature research, expert review, and statistical analyses for validity and the differences in scores were identified by gender and tracks. A total of 363 high school students participated in the study. To explore the validity evidence of items, the Rasch analysis and the reliability of internal consistency were performed, and the two-way ANOVA was performed to compare the scores of the unskeptical attitudes between gender and academic track. Self-reporting and Likert-scaling 23 items were developed to measure unskeptical attitudes in scientific inquiry context. The items were developed in the sub-domain of scientific inquiry: 'questioning and hypothesis generating,' 'experiment designing,' and 'explaining and interpreting.' Second, the validity and reliability of the unskeptical were identified in a rigorous method. The validity of items were identified by multi-dimensional partial score model analysis through the Rasch model, and all 23 items were found to be fit to model. Various reliability evidences were also found to be appropriate. It was found that there were no significant differences of unskeptical attitude score between the gender and academic track except one comparison. The developed questionnaire could be used to check an unskeptical attitude in the course of scientific inquiry and to compare the effects of scientific inquiry classes.

A Study on Developing and Validating the Modern Physics Conceptual Diagnostic Survey for Pre-Service Physics Teachers based on the 2015 Revised National Science Curriculum (2015 개정 과학과 교육과정에 기초한 예비 물리교사를 위한 현대물리 개념 진단지 개발 및 타당화 연구)

  • Kim, Wanseon;Kim, Sung-Won
    • Journal of The Korean Association For Science Education
    • /
    • v.40 no.3
    • /
    • pp.253-269
    • /
    • 2020
  • This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

Goodness-of-Fit of Job Burnout Scale in Private Security Guards (민간경비원을 위한 직무소진 척도 문항의 적합도)

  • Lee, Jun-Woo;Lee, Jong-Hwan;Kim, Eui-Young
    • Korean Security Journal
    • /
    • no.39
    • /
    • pp.161-183
    • /
    • 2014
  • The job burnout of the private security guards who provide services through contact with customers can affect the overall the private security industry. So the managers need to make efforts to diagnose and evaluate the job burnout and provide continuous provision for the repatriation effect. However, up to the present, the job burnout measure for the private security guards has not been provided, so the objectivity of the information is questionable. For this reason, in order to establish the goodness of fit of the job burnout scale for private security guards based on the contents of the job burnout scale that was being provided to other service employees, this research aims to provide the scale to provide objective information compared with that of the past by applying the Rasch model of the item response theory. To achieve this purpose, the data on 379 private security guards working for the private security guard companies in the Gyeonggi region were collected, and the data were processed to suit the research purpose using SPSS 18.0 and AMOS 18.0, Winsteps programs. Through these research procedures, the following conclusion was obtained. With regard to the private security guards' measure of job burnout, as a result of factor analysis through the collected data, 4 questions were deleted, and as a result of the analysis of the goodness of the fit based on 18 questions, 4 questions were found to be inappropriate questions that did not satisfy the standard value, and the scope of the difficulty level of the questions from - 98 to 1.30 and the response reaction of a 5-point scale were found to suit the final private security guards' job burnout scale. In other words, the conclusion that it is appropriate to measure the private security guards job burnout scale with 3 factors and 13 questions was obtained. So if private security guards companies collect systematic data using the scale established in this research, and practice refresher training accordingly, they can reduce the private security guards' job burnout.

  • PDF

Qualitative and Quantitative Analysis of Paper-Pencil Test Items for Exploring its Appropriateness as a Selection Tool of the Gifted in Science (과학 영재 선발 도구로서 지필 검사의 적합성 탐색을 위한 질적 및 양적 문항 분석)

  • Lee, Ki-Young;Dong, Hyo-Kwan;Hong, Jun-Eui;Kim, Hyun-Kyung;Jo, Bong-Jae
    • Journal of The Korean Association For Science Education
    • /
    • v.28 no.1
    • /
    • pp.32-46
    • /
    • 2008
  • The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

수학과 수행평가 문항 개발에 관한 연구

  • Kim, Yun-Yeong
    • Communications of Mathematical Education
    • /
    • v.9
    • /
    • pp.115-152
    • /
    • 1999
  • 본 연구에서는 새로운 평가 방안으로 소개되는 수행평가의 정의 및 의의, 특징과 수행평가의 여러 가지방법 등을 간략히 살펴보고, 수행평가의 채점방법, 수행평가에 적합하다고 생각되는 문항을 예시한다. 특히, 수행평가의 예시 문항들은 수행평가의 여러 가지 방법에 따라 개발하되, 어떤 한 가지 방법에 의하지 않고 여러 가지 방법으로 평가가 가능한 문항, 학생들의 조작과 생활 속에 관련된 수학을 발견하도록 하는 문항들을 개발 예시하였다.

  • PDF

Reactive and Proactive Aggression, the Validation of the Reactive-Proactive Questionnaire (RPQ): Focusing on ESEM and Rasch (반응적 공격성과 주도적 공격성, Reactive-Proactive Questionnaire(RPQ) 타당화 연구: ESEM과 Rasch를 중심으로)

  • Seonyoung Park;Jonghan Sea
    • Korean Journal of Culture and Social Issue
    • /
    • v.30 no.2
    • /
    • pp.159-192
    • /
    • 2024
  • The purpose of this study is to validate the Reactive-Proactive Aggression Questionnaire (RPQ), a tool for measuring reactive-proactive aggression, in the context of South Korea. A thorough translation was conducted in collaboration with the original author. An exploratory factor analysis (EFA), exploratory structural equation modeling (ESEM), rating scale model (Rasch), differential item functioning (DIF), and convergent validity were performed on a sample of 510 South Korean individuals. The results revealed a two-factor structure of reactive and proactive aggression after removing one item showing dual loading. Rating scale analysis based on the Rasch model indicated the appropriateness of the 3-point Likert scale, with all items meeting fit criteria. Although the separation index and separation reliability of proactive aggression was marginally lower, the overall discrimination between participants and items was satisfactory. Examination of participant-item distribution indicated a suitable alignment between reactive aggression and participant ability levels, whereas proactive aggression exhibited slightly elevated item difficulty. Furthermore, three items were found to function differently based on gender. A moderate but statistically significant positive correlation was found between the Barratt Impulsiveness Scale-11-R (Korean version) and RPQ from the results of the convergent validity evaluation. Overall, this study employed rigorous statistical methods to validate the suitability of the RPQ for use in Korea, taking cultural nuances into account, and introduced the concepts of reactive and proactive aggression to the Korean general population.

Exploring the constructs of school happiness of elementary students (초등학생의 학교 행복감 구성요인 탐색)

  • Kang, Young-Ha
    • The Korean Journal of Elementary Counseling
    • /
    • v.11 no.2
    • /
    • pp.219-235
    • /
    • 2012
  • The purpose of this study was to identify the factors of school happiness of elementary students by implicit theory. For this purpose, 192 items for happiness were constructed based on 76 5th and 6th elementary students' free descriptions. Then 75 items were selected for preliminary factor analysis based on item appropriateness by evaluation of 28 elementary teachers. The happiness inventory composed 136 items was administered to 155 students and 36 items were selected based on exploratory factor analysis results. 4 factors-optimism, positive peer-relationship, self-esteem, consideration, and teacher-relationship-were extracted by principal component analysis. The confirmatory factor analysis indices indicated that 4 factor model of happiness was fit. The reliability(Cronbach's ${\alpha}$) was .996.

  • PDF

An Examination of the Alignment between 2007 Mathematics Curriculum and Constructed-Response Assessment (서술형 평가 문항 분석 : 수학과 교육과정의 성격 및 목표와의 적합성을 중심으로)

  • Lee, JiHyun;Kim, Gooyeon
    • Journal of the Korean School Mathematics Society
    • /
    • v.16 no.4
    • /
    • pp.899-925
    • /
    • 2013
  • The purpose of this study was to examine how constructive-response questions in regular test was in aligned with the nature and goals of 2007 Curriculum Amendment. For this purpose, data were collected and analysed by using the framework for mathematical task and the cognitive demand of tasks suggested by Smith & Stein(1998) and mathematical proficiency suggested by National Research Council(2001). In particular, it aimed to reveal the overall picture of the level of cognitive demand and the proportion of mathematical proficiency of constructed-response items created by secondary mathematics teachers. The findings from the analysis showed that 70 percent of the constructed-response items were at low-level and the rest at high-level in terms of cognitive demand. Also, the constructed-response assessment focused on conputing (89%), understanding(45%), applying(30%) and least reasoning(17%). Most of the constructed-response items included computing and were algorithmic.

  • PDF