• Title/Summary/Keyword: Generalizability Index

Search Result 4, Processing Time 0.015 seconds

Calculation of Cronbach's Alpha Coefficient, Generalizability Index (GI), and Dependability Index (DI) in the Model Types of Survey Design (서베이 설계 모형별 Cronbach's Alpha 계수와 GI, DI 산출방안)

  • Choi, Sung-Woon
    • Proceedings of the Safety Management and Science Conference
    • /
    • 2011.04a
    • /
    • pp.701-705
    • /
    • 2011
  • The paper reviews Cronbaha's coefficient to measure a single source of error. On the contrary to classical measurement theory, the generalizability study can be used in the social survey design to calculate Generalizability Index (GI) and Dependability Index (DI) for measuring multiple sources of errors of behavior evaluation. The study proposes application guidelines to implement R:($A{\times}B$) mixed models that are composed of random factor and fixed factor.

  • PDF

Analysis of Korea Earth Science Olympiad Items for the Enhancement of Item Quality (한국 지구과학 올림피아드 문항 분석을 통한 문항의 질 향상 방안)

  • Lee Ki-Young;Kim Chan-Jong
    • Journal of the Korean earth science society
    • /
    • v.26 no.6
    • /
    • pp.511-523
    • /
    • 2005
  • The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

An Application of Multivariate Generalizability Theory to Teacher Recommendation Letters and Self-introduction Letters Used in Selection of Mathematically Gifted Students by Observation and Nomination (관찰·추천제에 의한 수학영재 선발 시 사용되는 교사추천서와 자기소개서 평가에 대한 다변량 일반화가능도 이론의 활용)

  • Kim, Sung Yeun;Han, Ki Soon
    • Journal of Gifted/Talented Education
    • /
    • v.23 no.5
    • /
    • pp.671-695
    • /
    • 2013
  • This study provides an illustrative example of using the multivariate generalizability theory. Specifically, it investigates relative effects of each error source, and finds optimal measurement conditions for the number of items within each content domain that maximizes the reliability-like coefficients, such as a generalizability coefficient and an index of dependability. The method is based on teacher recommendation letters and self-introduction letters, using an analytic scoring method in the context of selection of mathematically gifted students by observation and nomination. This study analyzed data from the 2011 academic year in the science education institute for the gifted, which is attached to the university located in the Seoul metropolitan area. It should be noted that the optimal scoring structures of this study are not generalizable to other selection instruments. However, the methodology applied in this study can be utilized to find optimal measurement conditions for the number of raters, the number of content domains, and the number of items in other selection instruments self-developed by many institutions including: the education institutes for the gifted at provincial offices of education, gifted classes, and the science education institutes for the gifted attached to universities in general. In addition, the methodology will provide bases for making informed decisions in selection instruments of the gifted based on measurement traits.

Effects of Electromagnetic Acupuncture Combined with Integrative Korean Medicine Treatment on Pain and Dysfunction in a Patient with Knee Osteoarthritis: A Case Report

  • Jihun Kim;Taewook Lee;Sookwang An;Geun Hyeong, An;Yoona Oh;Gi Young Yang
    • Journal of Acupuncture Research
    • /
    • v.41 no.2
    • /
    • pp.129-134
    • /
    • 2024
  • Knee osteoarthritis (KOA) is a prevalent degenerative joint disease causing significant pain and dysfunction. This case report presents the use of electromagnetic acupuncture utilizing a Whata 153 device generating a magnetic field to enhance acupuncture stimulation for the treatment of KOA. A 69-year-old female diagnosed with KOA experienced a reduction in pain (numerical rating scale score from 7 to 4), improved gait, and decreased stiffness and swelling after daily electromagnetic acupuncture treatments during hospitalization. In addition, the Korean Western Ontario and McMaster Universities Osteoarthritis Index scoreimproved from 20 to 14, and the patient rated her overall improvement as "significantly improved" on the patient's global impression of change scale. Although these findings suggest potential benefits of electromagnetic acupuncture for KOA, the case report design limits its generalizability. More controlled trials are warranted to confirm the efficacy and safety of electromagnetic acupuncture as a treatment of KOA.