• 제목/요약/키워드: Measurement Domains and Items

검색결과 37건 처리시간 0.022초

예비수학교사의 교직 적성·인성 검사에서 분할점수 변화에 따른 다양한 신뢰도 탐색 (Investigation of Various Reliability Indices of Pre-service Mathematics Teachers' Teaching Aptitude and Personality Test based on Setting Cut Scores)

  • 김성연
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제57권1호
    • /
    • pp.55-74
    • /
    • 2018
  • The purpose of this study is first to examine the relative influence of each error source and to investigate the optimal measurement conditions to ensure satisfactory multiple reliability coefficients based on the teaching aptitude and personality test for pre-service teachers. Participants were 33 students enrolled in mathematics education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was highest, followed by nesting of items within domains, graduate students, interactions of graduate students with domains, and domains. Second, total 96 items, with 12 domains containing 8 items in each domain, with cut score of 598, and original 210 items, with 14 domains containing 15 items in each domain, with cut scores of 615 or 716 were optimal measurement conditions to reach acceptable reliability levels based on the joint consideration of dependability coefficients, cut score dependability coefficients, adjusted dependability coefficients, and standard errors of measurement. Third, larger deviations between the arithmetic mean and the cut score indicated higher reliability coefficients of the test results. Finally, this study suggests ways for practitioners to consider how to apply generalizability theory for criterion-referenced tests and how to develop future research based on limitations.

일개 노인보건센터에서의 자가관리능력 측정도구 검증 - 델파이기법을 중심으로 - (Testing for Self-care Ability Measurement in an Aged Health Center - A Delphi Technique -)

  • 권명순
    • 지역사회간호학회지
    • /
    • 제17권4호
    • /
    • pp.573-582
    • /
    • 2006
  • Purpose: To find out whether the self-care ability measurement used for visiting health care provide an appropriate standard to select service methods using a Delphi survey and to offer basic data that can improve the measurement. Method: A Delphi survey was done with 39 people consisting of theoretical professionals, field managers, and practitioners engaged in visiting health care. Result: It was found that items and weighted points in the currently used self-care ability measurement needed adjustment. Therefore, a modified evaluation standard was presented by domains, items and detailed items. Finally, the self-care ability measurement is composed of 4 domains, 11 items and 19 detailed items. Conclusion: This study is significant in that it presented an evaluation standard applicable directly to business practice by supplementing problems in the existing self-care ability measurement. This study suggests the need to develop various measurements for elderly households based on community.

  • PDF

정보 환경하에서 개인정보역량 측정모형 개발에 관한 연구 (Development of a Measurement Model of Personal Information Competency in Information Environment)

  • 윤취영
    • 정보처리학회논문지D
    • /
    • 제14D권1호
    • /
    • pp.131-138
    • /
    • 2007
  • 본 연구는 정보환경에 있는 기업에서 근무하는 개인의 정보역량 측정을 위한 효율적인 측정모형을 개발하였다. 본 모형은 4 개의 측정영역과 12개의 측정요인 그리고 구체적인 측정항목을 포함한다. 개발된 모형의 타당성과 신뢰성은 SPSS software 를 적용한 Pilot Test 를 통한 Factor Analysis and Reliability Analysis 에 의해 검증되었고, 개인 정보역량을 효율적으로 측정할 수 있는 구체적인 측정항목들을 제시하였다. 개발된 측정모형의 실용성과 활용성을 검증하기 위해 실제 기업에서 근무하는 264 명의 인력에 대해 개인 정보역량을 측정하여 그 결과를 제시하였다. 본 측정모형은 산업현장에 있는 인력의 정보역량 향상에 기여할 것이다.

병원 간호조직의 지적자본 측정도구 개발 (Development of a Measurement of Intellectual Capital for Hospital Nursing Organizations)

  • 김은아;장금성
    • 대한간호학회지
    • /
    • 제41권1호
    • /
    • pp.129-140
    • /
    • 2011
  • Purpose: This study was done to develop an instrument for measuring intellectual capital and assess its validity and reliability in identifying the components, human capital, structure capital and customer capital of intellectual capital in hospital nursing organizations. Methods: The participants were 950 regular clinical nurses who had worked for over 13 months in 7 medical hospitals including 4 national university hospitals and 3 private university hospitals. The data were collected through a questionnaire survey done from July 2 to August 25, 2009. Data from 906 nurses were used for the final analysis. Data were analyzed using descriptive statistics, Cronbach's alpha coefficients, item analysis, factor analysis (principal component analysis, Varimax rotation) with the SPSS $PC^+$ 17.0 for Windows program. Results: Developing the instrument for measuring intellectual capital in hospital nursing organizations involved a literature review, development of preliminary items, and verification of validity and reliability. The final instrument was in a self-report form on a 5-point Likert scale. There were 29 items on human capital (5 domains), 21 items on customer capital (4 domains), 26 items on structure capital (4 domains). Conclusion: The results of this study may be useful to assess the levels of intellectual capital of hospital nursing organizations.

평가 문항을 활용한 중학교 수학 교육과정의 내용 및 인지행동의 위계성 조사 (Investigating the Hierarchical Nature of Content and Cognitive Domains in the Mathematics Curriculum for Korean Middle School Students via Assessment Items)

  • 송미영;김선희
    • 대한수학교육학회지:학교수학
    • /
    • 제9권2호
    • /
    • pp.223-240
    • /
    • 2007
  • 본 연구는 중학생들의 수학 성취를 국가수준에서 평가한 경험적 자료를 활용하여 우리나라 중학교 수학과 교육과정의 내용과 수학에서의 인지행동이 위계적으로 구성되어 있는지를 조사하였다. 전반적으로 교육과정의 내용 제시 순서는 난이도 순위와 통계적으로 유의한 상관관계가 나타나지 않은 반면, 인지행동의 위계는 난이도 순위와 통계적으로 유의한 상관관계가 있었다. 이러한 결과에서 검사 문항의 난이도 순위가 학교에서 배운 수학 교과 내용의 순서보다는 문항에서 요구하는 인지행동의 수준과 더 관련이 있음을 알 수 있었다. 그리고 내용 위계와 인지행동의 위계 간 상관관계가 유의하게 나타나, 교육과정에서 늦게 등장하는 내용일수록 요구되는 인지 행동도 높은 수준임을 발견할 수 있었다. 내용 및 인지행동의 위계와 난이도 순위 간 상관분석에서 특이한 양상을 나타낸 문항에 대해서는 그 특성을 분석하였다.

  • PDF

Application of AIG Implemented within CLASS Software for Generating Cognitive Test Item Models

  • SA, Seungyeon;RYOO, Hyun Suk;RYOO, Ji Hoon
    • Educational Technology International
    • /
    • 제23권2호
    • /
    • pp.157-181
    • /
    • 2022
  • Scale scores for cognitive domains have been used as an important indicator for both academic achievement and clinical diagnosis. For example, in education, Cognitive Abilities Test (CogAT) has been used to measure student's capability in academic learning. In a clinical setting, Cognitive Impairment Screening Test utilizes items measuring cognitive ability as a dementia screening test. We demonstrated a procedure of generating cognitive ability test items similar as in CogAT but the theory associated with the generation is totally different. When creating cognitive test items, we applied automatic item generation (AIG) that reduces errors in predictions of cognitive ability but attains higher reliability. We selected two cognitive ability test items, categorized as a time estimation item for measuring quantitative reasoning and a paper-folding item for measuring visualization. As CogAT has widely used as a cognitive measurement test, developing an AIG-based cognitive test items will greatly contribute to education field. Since CLASS is the only LMS including AIG technology, we used it for the AIG software to construct item models. The purpose of this study is to demonstrate the item generation process using AIG implemented within CLASS, along with proving quantitative and qualitative strengths of AIG. In result, we confirmed that more than 10,000 items could be made by a single item model in the quantitative aspect and the validity of items could be assured by the procedure based on ECD and AE in the qualitative aspect. This reliable item generation process based on item models would be the key of developing accurate cognitive measurement tests.

교육대학원 예비공학교사의 교직 적성·인성 검사에서 일반화가능도 분석 (Generalizability Analysis of Teaching Aptitude and Personality Test for Pre-service Engineering Teachers in a Graduate School of Education)

  • 김성연
    • 한국산학기술학회논문지
    • /
    • 제19권5호
    • /
    • pp.323-330
    • /
    • 2018
  • 본 연구는 측정학적 특성을 바탕으로 교육과학기술부에서 표준안으로 보급한 교직 적성 인성 검사를 교육대학원의 예비공학교사에게 실시하는 것이 적절한지를 살펴보며, 교직 적성 인성 검사가 적정 수준의 신뢰도에 도달할 수 있는 효율적인 측정 조건을 제시하였다. 이를 위해 수도권에 소재한 한 교육대학원에서 2013년부터 2017년까지 공학교육전공의 예비공학교사 99명을 대상으로 실시한 교직 적성 인성 검사자료에 일반화가능도 분석을 수행하였다. 주요 분석결과는 다음과 같다. 첫째, 교직 적성 인성 검사점수에 미치는 요인의 상대적인 영향력은 일반적으로 잔차, 영역 내 문항, 피험자, 피험자와 영역의 상호작용, 영역, 그리고 시행횟수 크기의 순으로 나타났다. 둘째, 고전검사이론을 바탕으로 한 Cronbach's ${\alpha}$는 측정 구조를 적합하게 반영하지 못함으로써 과대추정 될 수 있으므로 준거참조검사에서는 의존도계수와 같은 보다 정밀한 신뢰도를 추정할 필요가 있다. 셋째, 교직 적성 인성 검사 표준안은 의존도계수를 바탕으로 교육대학원의 예비공학교사에게 적용 가능하다는 경험적 근거를 제시하였다. 넷째, 교직 적성 인성 검사가 적정 수준의 신뢰도에 도달할 수 있는 효율적인 측정 조건은 총 문항 수를 기준으로 시행횟수는 2회, 영역은 12개, 그리고 영역 내 문항은 8개로 원자료인 총 210개 문항을 96개로 축소할 수 있는 것으로 나타났다. 마지막으로 본 연구의 제한점과 후속 연구를 위한 방향을 제시하였다.

한국 초등학생들의 성차: TIMSS 2011 2015 수학 학업성취도 평가를 통한 분석 (Gender differences in Korean elementary students: An analysis of TIMSS 2011 and 2015 fourth grade mathematics assessment)

  • 황성환;여승현
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제59권3호
    • /
    • pp.217-235
    • /
    • 2020
  • 본 연구는 TIMSS 2011와 2015 수학 성취도 평가를 바탕으로 초등학교 4학년 남녀 간의 성차가 드러나는 문항들을 내용과 인지영역에 따라 분석하였다. 연구결과, 성차가 유의미하게 차이나는 20% 문항들에서 내용 영역별 성차를 보면 남학생은 수와 측정영역에서 여학생은 도형영역에서 상대적으로 우위에 있는 것으로 나타났다. 또한 인지 영역별 성차를 보면, 남학생이 지식, 적용, 추론 영역에서 여학생보다 상대적인 우위에 있는 것으로 드러났다.

The level of food literacy and its association with food intake and obesity status among Seoul citizens: results from Seoul Food Survey 2021

  • Hyelim Yoo;Eunbin Jo;Hyeongyeong Lee;Eunji Ko;Eunjin Jang;Jiwon Sim;Kirang Kim;Sohyun Park
    • Nutrition Research and Practice
    • /
    • 제17권5호
    • /
    • pp.945-958
    • /
    • 2023
  • BACKGROUND/OBJECTIVES: Food literacy (FL) is a crucial skill for selecting sustainable and healthy food options, necessitating the identification of vulnerable groups in the community using valid measurement tools. Identifying weak domains in FL is essential for enhancing the overall FL. This study examined the FL levels of Seoul citizens based on their sociodemographic characteristics and assessed the relationship between FL, food intake, and weight status. SUBJECTS/METHODS: This study utilized the data from the Seoul Food Survey, a cross-sectional study employing representative samples of Seoul citizens. Data collection occurred from September to October 2021, with 4,039 citizens aged 18 yrs and above participating in face-to-face surveys. Thirty-three FL items were assessed, comprising 14 items in the nutrition and safety (NS) domain, eight items in the cultural and relational (CR) domain, and 11 items in the socio-ecological (SE) domain. In addition, data on food intake sufficiency and obesity status were collected. The descriptive statistics, t-tests, analysis of variance, and logistic regression analysis were used for analysis. RESULTS: Men, students, young adults, older citizens, and people experiencing food insecurity had the lowest scores for all the FL domains. The highest quartile group of NS scores had a higher probability of consuming adequate servings of vegetables and fruits, with significant linear trends observed (P for trend < 0.05). In all three FL domains, the odds ratio for obesity was significantly lower in the groups with high FL scores (P < 0.05). CONCLUSIONS: A close relationship was observed between low FL, obesity, and food intake, even after controlling for other covariates. Vulnerable groups with low FL were also identified. Therefore, it is essential to develop programs to improve FL and the health and well-being of these groups.

간호사의 법의간호 역량 측정도구 개발 (Development of the Forensic Nursing Competency Scale for Nurses)

  • 조나영;김민혜;이윤미
    • 중환자간호학회지
    • /
    • 제13권3호
    • /
    • pp.24-40
    • /
    • 2020
  • Purpose : This study aims to develop the Forensic Nursing Competency Scale suitable to South Korea. Methods : The initial items were generated through literature review and interviews. Items were evaluated by experts for content and face validity. By conducting a pilot test, 74 measurement items were developed. In total, 333 copies of the questionnaire were analyzed regarding the validity and reliability of the study. Data were analyzed using SPSS 23.0 program and AMOS 18.0 program. Results : The study selected 53 questions after testing the content, face, and construct validity of the scale. The final 53 questions were composed of 15 sub-components in eight domains. These eight domains encompassed nursing practice, communication, critical thinking, human caring and relationships, evidence management, active information collection, professional development, and knowledge integration. Conclusions : In order to verify the effectiveness of the scale, future studies need to compare the forensic nursing competency in two groups to assess differences in these competency. Moreover, it is necessary to develop a forensic nursing educational program and validate its effectiveness by using this scale.