• 제목/요약/키워드: item validity

검색결과 830건 처리시간 0.031초

국가영어능력평가시험(NEAT)의 검사지 구성의 원칙과 절차: 문항 유형 확정 모델 (A blueprint for designing and developing the listening and the reading test of National English Ability Test (NEAT): Item-types decision-making model)

  • 김용명
    • 영어어문교육
    • /
    • 제16권4호
    • /
    • pp.153-184
    • /
    • 2010
  • On the bases of the 5 principles and the 4 criteria for designing and developing of the listening and the reading test of National English Ability Test (NEAT), this study presents Item-Types Decision-Making Model as a blueprint for designing and constructing the two tests. It sets up the criteria for validating item types, designs a modular type of test specifications, constructs an item-types bank, and specifies a complementary type of test specifications of the two tests. To gather all these threads up, it constructs Item-Types Decision-Making Model which consists of such components as the item-type pool, the validity criteria and the procedures of testing item types, the item-types bank, the modular and the complementary type test specification. Thus, it shows how the Model works in developing and constructing the two level-differentiated listening and reading tests (the 2nd and the 3rd rank) of NEAT. Finally, it discusses some implications and applications of the Model to the two level-differentiated tests (the A and the B type) of 2014 CSAT (College Scholastic Ability Test) systems, National Assessment of Educational Achievement (NAEA), and classroom testing. In conclusion, Item-Types Decision-Making Model functions as a testing template in an item development system and as a matrix in an item-types bank system.

  • PDF

핵에너지 태도 측정도구의 개발 (Development of Nuclear Energy Attitude Scale)

  • 장우정;우형택
    • 한국환경과학회지
    • /
    • 제11권9호
    • /
    • pp.829-842
    • /
    • 2002
  • The purpose of this study was to design a reliable and valid Likert-type scale to measure nuclear energy attitudes of various groups. 8 tests were applied to the construction of a 26-item long form, a 12-item middle form, and a 6-item short form of the scale. Three scales were field tested on 760 respondents representing a diverse range of subjects. The 26-item scale appeared to be reliable, content valid and construct valid. Scale reliability and homogeneity were evidenced by 0.95 coefficient alpha and positive interitem correlations ranging from 0.18 to 0.74. The results of factor analysis and known-groups comparison revealed that this scale had high validity. Reliability of the middle form and short form were evidenced by coefficient alpha of 0.92 and 0.90 respectively. The long and middle forms were strongly correlated, r-value of 0.98 and the long and short forms were also highly correlated, r-value of 0.93. Consequently, long form, middle form and short form scales were evidenced very reliable and valid in measuring nuclear energy attitudes of various groups in general. They can be used for a variety of purpose of measuring and testing nuclear energy attitude.

학령기 아동의 의복행동 측정도구 개발에 관한 연구 -4, 5, 6학년 아동을 중심으로- (A Study on the Measurement of Clothing Behavior of Elementary School Children)

  • 이명희
    • 한국의류학회지
    • /
    • 제11권2호
    • /
    • pp.1-11
    • /
    • 1987
  • The purpose of this study was to develope a questionaire measuring clothing behavior of elementary school children. At first, after pretest, the clothing behavior questionaire consisted of 70 items which were devidad. into 7 subscales i.e. Clothing interest. Clothing satisfaction. Clothing management, Clothing sex-role. Clothing comfort. Clothing conformity. and Clothing independence. Each item was rated on a 3-point scale. Samples were 447 boys and girls (4 th, 5 th, 6 th grade) of three elementary schools in Seoul. Korea. The data were analyzed by item analysis and factor analysis. Factor analysis was useful in attempting to establish contruct validity. Item validity was examined based on the correlation coefficients and item discriminating power through the chi-square. Reliability was examined based on the Cronbach's Alpha Reliability Coefficient and test-retest method. With this analysis the subscales were reconstructed to following 6 factors. Clothing conformity items were not clustered by the factor analysis. 52 items of 6 factors selected by the analysis. The factors characteristics were as follows: 1. Clothing interest (10 items) 2. Clothing satisfaction (11 items) 3. Clothing management (8 items) 4. Clothing sex-role (12 items) 5. Clothing comfort (6 items) 6. Clothing independence (5 items)

  • PDF

자폐스펙트럼 장애 아동에 대한 단축형 감각 프로파일-2(Short Sensory Profile-2)의 구성타당도 연구 (Construct Validation of the Short Sensory Profile-2 (SSP-2) for Children With Autism Spectrum Disorder)

  • 박아름;유두한;홍덕기
    • 대한감각통합치료학회지
    • /
    • 제18권2호
    • /
    • pp.15-28
    • /
    • 2020
  • 목적 : 본 연구는 자폐스펙트럼 장애 아동을 대상으로 단축형 감각프로파일-2(Short Sensory Profile-2; SSP-2)의 구성타당도를 검증하고자 하였다. 연구방법 : 자폐스펙트럼 장애 아동을 양육하는 부모 120명을 대상으로 SSP-2의 자료를 수집하였다. 원자료는 라쉬분석을 적용하여 SSP-2의 대상자 및 항목 적합도, 난이도, 평정척도, 분리신뢰도 분석을 실시하였다. 결과 : 연구 대상자 중 감각처리 영역은 7명, 행동반응 영역은 8명이 부적합 판정을 받아 분석에서 제외하였다. 항목 적합도 분석에서는 모든 항목이 적합한 기준을 충족하였다. 감각처리 영역에서의 난이도 분석은 13번 항목(.48 logit)이 높았으며, 10번 항목(-.54 logit)이 낮았다. 행동반응 영역에서는 25번 항목(1.58 logit)이 높았으며, 30번 항목(-.68 logit)이 낮게 분석되었다. 평정척도 분석에서는 5점 척도 보다 3점 척도가 적합한 것으로 나타났다. 분리신뢰도는 감각처리 영역 .90, 행동반응 영역 .95로 분석되었다. 결론 : 본 연구를 통해 SSP-2의 구성타당도를 검증하였으며, 임상에서 자폐스펙트럼 장애 아동에게 유용한 평가도구로 활용되기를 기대한다.

지역사회 노인의 신체기능 평가도구 개발 (The Development of Physical Functioning Scale for Community-Dwelling Older Persons)

  • 이경종;한근식;윤수진;이연경;김찬호;김정림;이윤환
    • Journal of Preventive Medicine and Public Health
    • /
    • 제35권4호
    • /
    • pp.359-374
    • /
    • 2002
  • Objectives : To develop a physical functioning instrument for older adults living in the community. Methods : A representative sample of 979 people aged 65 years or over were interviewed in-person. Of these, 199 people also completed a detailed in-hospital examination. The scale items were selected based on the frequency of endorsement, along with the item-total and inter-item correlations. The associations of the scale with their physical performance and clinical examination were analyzed to evaluate the criterion-related validity. Construct validity was assessed using factor analysis, and internal consistency through Cronbach's alpha and item-total correlations. Test-retest reliability was measured by agreement between the household survey and the repeat survey at the in-hospital examination. Results : Initially, 23 items on the level of difficulty, ranging from no difficulty to an inability to complete a task, with the specific mobility and self-care tasks were included. Those with a high frequency of endorsement and a low inter-item or item-total correlations were excluded, resulting in a 10-item Physical Functioning (PT) scale. Equal weights were given to each item and a summated score was calculated. Significant associations were found between the PF scores and the physical performance, surrey and clinical data. The scale revealed a 2-factor (mobility and self-care) structure. Cronbach's alpha was 0.92 and the item-total correlations were in the 0.63 to 0.78 range. Pearson's correlations for the test-retest ranged between 0.56 and 0.61. Conclusions : The newly developed Physical Functioning (PF) scale showed good psychometric properties in older people. Further work, however, is needed to improve its sensitivity to discriminate higher levels of functioning, in addition to assessing its predictive value in detecting changes in health.

한국어판 노인음성지수의 신뢰도와 타당도 (Validity and Reliability of Korean Version of the Aging Voice Index (KAVI))

  • 배인호;성의숙;이진춘
    • 대한후두음성언어의학회지
    • /
    • 제30권1호
    • /
    • pp.21-27
    • /
    • 2019
  • Background and Objectives : Voice disorder is recognized as a major problem because it negatively affects the elderly's social participation and quality of life. The purpose of this study was to examine the validity and reliability of Korean aging voice index (KAVI), which assesses the quality of life related to the voice of the elderly. Materials and Method : This study was conducted on 211 elderly people aged 65 years or older : 111 patients with voice disorder (mean age 69.8, range 65-80 years) and 100 nomorphonic participants (mean age 70.6, range 65-82 years). Aging voice index was translated into Korean and used and Korean voice-related quality of life (KVQOL) was conducted to verify KAVI. The validity (item validity, concurrent validity, and construct validity) and reliability (test-retest reliability and internal consistency reliability) of KAVI. Results : The item validity (ICC=0.895) and construct validity (r=0.765) showed a high correlation, respectively. And concurrent validity (r=0.748), test-retest reliability (0.851), and internal consistency reliability (${\alpha}=0.832$) were statistically significant in voice disorder group. In addition, there was a significant difference between the voice disorder and the nomorphonic group in AVI total score. Conclusion : KAVI is a validated and reliable quality of life tool that will be useful for assessing the presence and effectiveness of interventions in clinical settings.

수학과 평가 문항의 역량 및 표현 형식 특성 분석 (Feature analysis for competency and representation type of mathematics assessment)

  • 박지현
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제60권2호
    • /
    • pp.209-228
    • /
    • 2021
  • 본 연구의 목적은 수학과 교육과정에 기반한 평가 문항을 출제할 때 핵심적으로 고려되는 수학 역량 및 표현 형식 특성을 규명하고, 수학과 평가 문항에서 수학 역량 및 표현 형식 특성이 나타나는 양상을 밝히는 것이다. 선행 연구 분석 및 2차에 걸친 타당성 조사를 통해, 수학과 교육과정에 기반한 평가 문항의 특성으로 수학 역량 범주는 12가지, 표현 형식 범주는 8가지를 추출하고, 이 특성들로 구성된 문항 특성 분석틀을 개발하였다. 또한 문항 특성 분석틀을 활용하여 2019년 국가수준 학업성취도 평가 문항을 분석한 결과, 중 고등학교의 수학 역량 및 표현 형식 특성에 대한 출제 경향에 차이가 있음을 밝혔다.

과학 창의성 검사지 개발 (A development of the test of creativity level for science field)

  • 김희수;김종헌;육근철;이희권;김정민;이봉재
    • 영재교육연구
    • /
    • 제12권4호
    • /
    • pp.26-44
    • /
    • 2002
  • 본 연구에서는 과학 창의성 수준을 측정하기 위한 검사지와 답지를 함께 개발하였다. 이 검사지에는 창의성을 이루고 있는 7 가지 창의성 요소를 반영하였다. 개발 과정에서 타당도와 문항의 명료성 등에 대한 검증을 받았다. 개발된 검사지는 332명의 중학생들에게 투입되어 타당도, 신뢰도 등 검사분석과 난이도, 변별도 등의 문항 분석을 실시하였다. 검사분석 결과 타당도: 92%, 신뢰도: 0.84으로 문항분석 결과 난이도:$42%{\sim}73%$, 변별도: $0.22{\sim}0.70$ 를 보여 과학 창의성 수준 검사 과정에서 활용 가능함이 확인되었다.

D 유형 성격 측정 도구의 타당도와 신뢰도 검증 (Verification for the Validity and Reliability of the Type D Scale-14)

  • 손행미
    • 기본간호학회지
    • /
    • 제15권3호
    • /
    • pp.312-320
    • /
    • 2008
  • Purpose: The purpose of this study was to verify the validity and reliability of the Type D Scale-14 (DS14). Methods: The participants were 288 patients who were diagnosed with angina pectoris, myocardial infarction, and hypertension. DS14 was developed by Denollet(2005) and consists of two domains, 7 items on negative affectivity (NA) and 7 items on social inhibition (SI). The Korean version of DS14 was developed through translation-reversed translation and a preliminary test. Data were collected using a self-report questionnaire. Cronbach $\alpha$ and Guttman split-half were used to test reliability and item analysis and factor analysis for validity. The SPSS program was used. Results: 35.8% of the participants were classified as Type D. Mean score for NA was 16.80 and for SI, 14.10 in Type D participants. For reliability of NA, Cronbach $\alpha$=0.771, and for SI, 0.707. Factor analysis on 12 items(numbers 1 & 3 were excluded as the corrected item-total correlations were below r=0.3) yielded two factors for NA (6 items) and SI (6 items). Number 7 in the NA domain was sorted into the SI domain. Conclusion: The results indicate, the cultural differences were between Europeans and Koreans. Repetition of the research is needed for generalization of DS14.

  • PDF

골다공증에 대한 인지측정도구 개발 (Development of an Osteoporosis Awareness Scale for Women)

  • 최의순;김주후;정미영;황경혜
    • 대한간호학회지
    • /
    • 제38권6호
    • /
    • pp.813-821
    • /
    • 2008
  • Purpose: This study was conducted to develop an instrument measuring awareness of osteoporosis. Methods: The process included construction of a conceptual framework, generation of 86 preliminary items, verification of content validity, selection of secondary items, verification of construct validity and extraction of final items. The 86 items were reviewed for content validity by two groups of experts and were tested to evaluate inter item correlation coefficient by two groups of adult women. From June to August 2007, data were collected from 383 adult women who lived in Seoul and provinces in Korea. Data were analyzed by performing item analysis, Varimax factor analysis and Cronbach's alpha. Results: There were 31 items in the final instrument categorized into 5 factors. The factors were labeled as "preventive behaviors (10 items)", "risk factors (5 items)", "characteristics of osteoporosis (6 items)", "improving bone health (5 items)", and "bone physiology (5 items)". Cumulative percent of variance was 60.92% and eigen values ranged from 1.20 to 12.44. Cronbach's alpha was .948 and ranged from .804 to .917. Conclusion: Validity and reliability of the scale are confirmed in this study showing its utility for measuring awareness of osteoporosis for women. Utilization of the scale will also contribute to designing an appropriate prevention program for osteoporosis.