• Title/Summary/Keyword: 타당도 평가

Search Result 847, Processing Time 0.021 seconds

수학교육 평가에서 고사 타당도의 측정에 관한 연구

  • Hong, Seok-Gang
    • Communications of Mathematical Education
    • /
    • v.13 no.2
    • /
    • pp.641-653
    • /
    • 2002
  • 수학 교육평가에서 고사 타당도의 측정은 매우 중요하다. 그것은 평가자가 목적하는 바의 준거에 따라 수험자들의 문제해결력 변별을 위한 고사들 간의 타당도 크기 측정과 또는 고사 문항의 선정, 배치를 통하여 한 고사의 타당도를 높이기 위한 문항별 타당도 계수를 측정 계산하는 것이다. 이 연구에서는 이 두 가지 고사 타당도의 크기 측정법을 이용하여 수학교육 평가 현장에서 직접적으로 적용할 수 있는 고사 타당도의 제고에 유효한 연구 결과를 제시한다.

  • PDF

Issues in clinical evaluation tools to measure and evaluate nursing student clinical performance (간호학생의 임상실습평가와 측정에 관한 도구의 신뢰도와 타당도)

  • Kim, Hea-Sook
    • Journal of Korean Academy of Nursing
    • /
    • v.22 no.1
    • /
    • pp.42-48
    • /
    • 1992
  • 이 연구는 현존해 있는 다양한 임상평가도구의 신뢰도와 타당도에 관한 분석 서술 연구이다. Rines(1974)에 의하면 평가는 학습경험을 통하여 목적을 달성하는 지의 여부를 측정하는 것이라고 하였고 평가의 목적은 교육증진을 도모하며, 목표를 설정하고, 학생의 학습진행과정을 사정하여 학생들을 위한 프로그램을 사정, 개발시키는데 있다고 피력 하였다. 간호교육에는 실무교육이 많은 비중을 차지하고 있다. 또한 많은 간호교육자들은 실습평가에 있어 많은 어려움을 경첩하고 있다. 이러한 난해한 실습평가도구를 개발하기 위하여 선행된 우선순위로써 현존해 있는 다양한 평가도구의 신뢰도와 타당도를 평가하는 것이 의의 있는 일이라 사료된다. 이 논문은 실습평가도구의 신뢰도와 타당도에 관심을 가진 임상지도교수나 간호교육자들을 대상으로 한 서술적 연구이다. 우선 간호교육평가에 있어서의 문제점을 분석하고 평가도구에 대한 전문가(Authority)의 의견을 피력한 다음 저자의 의견을 서술하였다. 결론적으로 현재까지 개발된 완전한 임상실습평가의 방법은 없다. 그러므로 현존해 있는 평가방법을 서술평가하고 문제점을 지적하므로써 질적인 평가도구개발에 도움을 줄 수 있다. 앞으로 간호교육자들이 각 문제점들을 보완하여 교육목적을 달성시킬 수 있는 효율적인 평가도구를 개발하는 것이 급선무이다.

  • PDF

A Preliminary Study on a Performance-Based Cognitive Function Test : With the Normal Elderly (수행기반 인지기능평가를 위한 예비연구 : 정상 노인을 대상으로)

  • Kwak, Ho-Soung;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.8 no.3
    • /
    • pp.43-55
    • /
    • 2019
  • Objective: The purpose of this study is to conduct a preliminary research for the development of a Performance-Based Cognitive Function Test (PCFT) to screen the elderly for cognitive function impairment, and examine the reliability and validity of the test. Methods: A draft version of the Performance-Based Cognitive Function Test (PCFT) was developed and utilized in nine healthy elderly individuals. In order to verify its reliability, we analyzed the internal consistency of the PCFT. In order to verify the concurrent validity of the PCFT, this study analyzed the correlation between motor-cognitive dual task assessments and the Korean version of the Mini-Mental State Examination (MMSE-K). Results: The internal consistency of the PCFT for motor and cognitive tasks was 0.871 and 0.959 (Cronbach's ${\alpha}$), respectively. Concurrent validity of the PCFT, which was performed through motor-cognitive dual task assessments, ranged from 0.755 to 0.964 (Spearman's rho statistic, p < 0.05). In addition, correlation between the cognitive assessment tool and the MMSE-K ranged from 0.849 to 0.943 (p < 0.01). Conclusion: This study verified, and established the reliability and validity of the PCFT. Further studies are required to examine other psychometric properties in a modified PCFT, for screening cognitive function impairments in the elderly.

Validity of the Self-report Assessment Forecasting Elderly Driving Risk (SAFE-DR) Applicable to Community Health Convergence (지역사회 보건 융합에 활용 가능한 노인 운전자용 자가-보고식평가(SAFE-DR)의 타당도 연구)

  • Choi, Seong-Youl
    • Journal of Convergence for Information Technology
    • /
    • v.9 no.6
    • /
    • pp.175-182
    • /
    • 2019
  • This study was conducted to test the assessment validity and examine the cut-off scores for driving risk as a part of the Self-report Assessment Forecasting Elderly Driving Risk (SAFE-DR) development project. The 132 senior drivers were categorized as either risky of 58 or safe of 74 drivers through the Drivers 65 Plus. Based on this initial assessment, we analyzed the risk prediction cut-offs. Furthermore, we tested the construct, content, and predictive validity. The cut-off score for the prediction of driving risk was found to be 74.5 points. The positive predictive value was 88.6%, and the negative predictive value was 86.3% about the cut-off score, signifying an excellent level of discrimination. Convergent validity, nomological validity, and content validity were found to be appropriate. Therefore, this study confirms that SAFE-DR is an appropriate assessment that can be used to screen dangerous elderly drivers.

The Development of Infants and Toddlers: A Rating Scale for Teachers (교사 평정용 영아발달 평가도구)

  • Lee, Young Ja;Lee, Jong Sook;Shin, Eun Soo;Kwak, Hyang Lim;Lee, Jeong Wuk
    • Korean Journal of Child Studies
    • /
    • v.22 no.2
    • /
    • pp.255-275
    • /
    • 2001
  • The purpose of this study was to construct a rating scale of infant and toddler development for the use of teachers in their observations of children during daily activities. The scale consists of 201 items measuring motor, self-help, socio-communicative, socio-emotional, and cognitive development. Quality, reliability and validity were examined with the use of a nation-wide sample of 1,245 children from classes of 1- and 2-year-olds. Tests on validity and reliability were high in terms of content validity evaluated by early childhood professionals, concurrent validity with the Bayley Scale, internal consistency among raters, and test-retest reliability. Factor analysis showed that the developmental areas of infants and toddlers are not clearly differentiated but are interrelated with each other. The scale was standardized by providing nation-wide norms with raw scores, percentiles, and standardized scores.

  • PDF

Development and Evaluation of a Brief Fruit and Vegetable Food Frequency Questionnaire for Higher-Grade Elementary School Children (초등 고학년 아동의 과일 및 채소 섭취 수준 평가를 위한 간단한 식품 섭취 빈도 조사지의 개발과 평가)

  • Lee, Seung-Min
    • Journal of the East Asian Society of Dietary Life
    • /
    • v.18 no.5
    • /
    • pp.675-683
    • /
    • 2008
  • 본 연구는 초등 고학년 아동의 과일과 채소 섭취 수준 측정을 위한 간단한 식품 섭취 빈도 조사지를 개발 및 평가하고자 실시되었다. 2001년도 국민건강영양조사에 참가한 만 $9{\sim}11$세 아동의 24-시간 회상 자료에 기초하여 식품섭취빈도 조사지의 항목 선정을 위한 기초 조사를 하였다. 각 과일과 채소 식품의 일일 평균 섭취량을 전체 아동 및 섭취량의 4분위 집단 별로 산출한 후, 이 자료를 바탕으로 전체 인구 집단의 섭취량을 대변할 수 있을 뿐만 아내라 고 섭취군과 저 섭취군 간의 차이도 나타낼 수 있는 항목을 선정하였다. 총 9개의 과일 항목과 11개의 채소 항목이 식품 섭취 빈도지에 포함되도록 선정되었으며, 섭취 빈도에 대한 응답 항목은 지난 7일 간의 섭취에 대하여 1개의 선택 범주가 제시되었다. 개발된 조사지의 신뢰도와 상대적 타당도에 대한 평가는 서울에 위치한 한 공립 초등학교에 재학 중인 153명의 $4{\sim}6$학년 학생들을 대상으로 실시하였다. 한 달간의 간격을 두고 2회에 걸쳐 조사를 실시한 자료를 이용하여 검사-재검사 신뢰도를 평가하였으며, 두 번째 방문 시에 28개의 과일 및 채소 항목을 추가로 포함하고 있는 식품섭취빈도 조사지를 더불어 실시한 자료를 바탕으로 상대적 타당도를 평가하였다. 상관 분석과 항목 별 빈도 응답 및 섭취 수준에 따른 집단내 순위 분류의 일관성에 대한 분석을 실시한 결과, 본 연구에서 개발된 20개 항목의 과일 채소 식품 섭취빈도 조사지의 신뢰도와 상대적 타당도가 적정 수준 이상으로 나타났다. 신뢰도를 살펴보기 위한 개별 항목 및 과일, 채소, 과일+채소 섭취 빈도에 대한 상관계수는 $0.22{\sim}0.64$(p<0.001)이었으며, 항목별 빈도 응답의 일관도는 평균 69.3%(<=1 빈도 응답차이)와 81.3%(<=2 빈도 응답 차이)로 나타났다. 상대적 타당도를 살펴보기 위한 과일, 채소, 과일+채소 섭취 빈도에 대한 상관계수는 $0.91{\sim}0.93$(p<0.0001)로 높게 나타났다. 따라서 본 연구를 통하여 개발된 식품섭취빈도 조사지는 초등고학년 아동의 과일채소 섭취 수준을 간단히 심사하거나 평가하는 도구로서 유용하리라 사료된다.

  • PDF

Early Identification of 2- and 3-Year-Old Children for Social and Emotional Problems: A Preliminary Study of the Ages and Stages Questionnaires: Social-Emotional (ASQ:SE) (2, 3세 유아의 사회 정서 문제 조기발견: ASQ:SE 선별 평가서의 표준화 연구)

  • Heo, kay Heoung
    • Korean Journal of Child Studies
    • /
    • v.21 no.4
    • /
    • pp.123-141
    • /
    • 2000
  • 본 연구 논문은 영 유아를 대상으로 한 사회 정서 문제의 선별 평가서인 Ages and Stages Questionnaire: Social-Emotional (ASQ:SE)의 표준화(신뢰도 및 타당도)연구이다. 특히, ASQ:SE 질문지 가운데에서도 24개월과 36개월용을 이용하여 ASQ:SE 의 내적 일치도 (internal consistency reliability), 재검사 신뢰도 (test-retest reliability), 절선 점수 (cutoff points), 공인 타당도 (concurrent validity)에 대해 연구하였다. 전체 447명의 부모가 참여한 가운데, 237명은 24개월용 질문지를 작성했고, 210명은 36개월용 질문지를 작성했다. 내적 일치도는 24개월 질문지에서 71, 36개월 질문지에서는 .73이었다. 재검사 신뢰도는 24 개월 질문지에서 100%, 36개월 질문지에서 97%이었다. 마지막으로 공인 타당도는 24개월과 36개월 설문지에서 95%이었다. 끝으로, 추후 다양한 대상으로 연구될 것이 추천되며 또한 이 연구에서 제외되어졌던 연령의 ASQ:SE 질문지의 내적 일치도, 신뢰도 및 타당도가 연구되어져야 할 것이다.

  • PDF

A Systematic Review on Measurement Instruments of Bilateral Upper Extremity Function (양측 상지 기능 평가도구에 관한 체계적 고찰)

  • Lee, Joo-Hyun;Lee, Ye-Jin;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.5 no.1
    • /
    • pp.7-22
    • /
    • 2016
  • Objective : This study was conducted to review about instrument for bilateral upper extremity assessment. Methods : We searched published papers in Medline database. The keywords used in the search were 'upper extremity' and 'motor activity', 'activities of daily living' and 'assessment', 'instrument', 'disability evaluations'. In total of 68 papers, 44 assessment instruments was extracted. We analyzed about numbers, subjects, methods, reliability, validity, responsiveness of assessment instruments about bilateral upper limb function comparing unilateral, combined bilateral and unilateral instruments. Results : The numbers of bilateral measurement tool were 2 in a total of upper extremity measurement tools. Also, subjects were patients with stroke and measurement was based on performance. The reliability, validity and responsiveness of tools were high. Conclusions : Futher study will be needed to development and research about instrument of bilateral upper extremity.

An Analysis of Content Validity of Third-Grade Mathematics Achievement Tests (학업 성취도 평가도구의 내용 타당도 분석 - 수학과 3-가를 중심으로-)

  • Kim, Eun-Ah;Kang, Wan
    • Journal of Elementary Mathematics Education in Korea
    • /
    • v.14 no.2
    • /
    • pp.177-196
    • /
    • 2010
  • The purpose of this study is to find out whether Achievement Tests are fully performing their role as an objective standard that measures student's educational achievement level by analysing the content validity of Achievement Tests developed by KICE and teachers at elementary school. In the study, the content validity of achievement tests were analyzed in the behavioral content objective dimensions. 60 instructional objectives from the Unit one to the Unit six contained in the teachers' guidebook for the elementary third-grade Math subject were analyzed into dimensions of behavior and content. And the Achievement Test developed by KICE and teachers in five elementary schools randomly chosen were collected and analyzed. Then, differences of the proportion between instructional objectives and evaluative objectives in each dimension statistically were verified. The results of the study are as follows : 1. In the dimension of behavior, as analysing and comparing the content validity of achievement tests, there was no significant difference in all domains(knowledge, comprehension, application, analysis, synthesis and evaluation). (p<.05) Therefore, it could be concluded that content validity of the Achievement Test is very high. 2. In the dimension of content, similarly there is no significant difference in all domains between achievement tests by both KICE and teachers. (p<.05) Therefore, the content validity of all tests are very high. In conclusion, it could be concluded that content validity of achievement tests is considerably high in content and behavior dimension. The study suggest the followings : 1. By expanding to the other subjects, there are needs to analyze and verify the content validity of achievement tests. 2. Even the content validity of achievement tests is considerably high however, achievement items are focused on evaluation 3 domains(knowledge, comprehension, application). Therefore evaluation evenly among 6 cognitive domains is required. And further to reduce the deviation of schools, there are needs to active interchange between teachers.

  • PDF

Reliability and Validity of the Korean Version of Melbourne Low-Vision ADL Index (한국판 맬버른 저시력 일상생활지수(Melbourne Low-vision ADL Index: MLVAI)의 신뢰도 및 타당도)

  • Yoo, Yeon Hwan;Park, Ji-Hyuk;Jung, Min-Ye;Park, Hae Yean
    • Therapeutic Science for Rehabilitation
    • /
    • v.7 no.2
    • /
    • pp.51-61
    • /
    • 2018
  • Objective: The purpose of this study was performed to modify the performance-based assessment tool, Melbourne Low-Vision ADL Index (MLVAI) had been developed in Australia to suit the Korea culture to verify the reliability and validity. Methods: The subjects were only over the age of 20 living in communities, 26 with low-vision and 42 normal persons. The Korean MLVAI was completed through the expert translation verification and validation of the configuration tool. The validity of the Korean MLVAI was established through the content, discriminant, and convergent validity. Also, the reliability was analyzed through internal consistency reliability for the items, test-retest, and interrater reliability. Results: The Content Validity Index(CVI) was more than .78. There was a statically significant low in low-vision. Also, there was a statically significant low in low-vision. The convergent validity was determined the correlation coefficient of .751 analyzing LVQOL and Korean MLVAI total score, had a significant correlation(p<.05). Cronbach's ${\alpha}$ coefficient indicated an internal consistency of .983(p<.05). Test-retest reliability had a high, significant correlation of .976 and interrater reliability had a high, an intraclass correlation coefficient of .91(p<.05). Conclusion: The results of this study mean that the Korean MLVAI which was modified to fit the Korean is the ADL assessment tool with both validity and reliability. Based on this study, the Korean MLVAI can be used as a useful ADL assessment for OT interventions in low vision.