• 컴퓨터교육학회논문지
• /
• 제9권6호
• /
• pp.11-18
• /
• 2006

본 연구는 2005년, 2006년 대학수학능력시험 직업탐구영역의 "컴퓨터 일반" 문항을 질적 연구와 양적연구로 분석하였다. 질적 연구로 내용 타당도 검사를 실시하고, 양적연구로 2-모수 문항 반응 모형에 근거한 베이지안(Bayesian) 1.0을 이용하여 문항의 난이도 및 변별도를 측정하였으며 고전검사이론 프로그램인 테스트안(Testan) 1.0을 이용하여 문항의 신뢰도 및 오답지를 분석하였다. "컴퓨터 일반" 영역의 문항들을 분석하여 문항의 질을 높이고 난이도의 정확한 예측을 하여 보다 신뢰도와 변별력 있는 문항을 개발하기 위한 자료로 제시하고자 한다.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅲ
• /
• pp.1371-1374
• /
• 2003

This paper designs and implements of Item pool-Based Program using Visual Basic, a sort of self- study system. This paper is implemented the system which makes and remakes the test items using item-pool data with different method from an ordinary fixed form of evaluation. This system helps teachers to make a various test type of items by searching data through the item-pool and accounting it to the test items. This system will also improve the learner's understanding of the problems and desire for self-solving a problem.

• 아동학회지
• /
• 제26권6호
• /
• pp.73-88
• /
• 2005

This study aimed to develop a reliable and valid developmental test for toddlers and preschoolers. A trial form of the test with 230 items in 5 domains(cognitive, physical, language, social, and self-help) was constructed and administered to 200 children from 2 to 5-year-olds. Item analysis indicated that most items selected in cognitive, physical, and indicated domain were acceptable in terms of item response rate and item discrimination. However, some items in social and self-help domain did not show clear age trends in item response, but mostly were adequate in item discrimination. Based on item analysis, 112 items were selected for the final form : 24 items each for the cognitive, physical, and language domain; 20 items each for the social and self-help domain. Reliability indicated by internal consistency coefficients(KR-20) were high in all domains. Validity of the test was supported by inter-correlations among 5 domains(.61 to .93), and significant age differences in domain scores.

• 사상체질의학회지
• /
• 제35권1호
• /
• pp.35-45
• /
• 2023

Objectives We tried to examine the change in the test-retest response for the questionnaire itself regarding the QSCCII. Methods Tests were conducted twice times with an interval of 6 months between tests for test-retest reliability analysis. We examined the test-retest answer agreement rate (%) in all items of QSCCII . We conducted NcNemar analysis to examine test-retest reliability for 77 items selected from the QSCCII. Results The body shape-multiple-choice items showed a tendency of low test-retest agreement rate and most of the questions about when I was not well and when I felt my body condition improve showed an high test-retest agreement rate tendency in all items of QSCCII. As a result of the research on the selected 77 items, there was a significant change in the answer in item No.25, 58(in the item of Soeumin) item No.45, 103(in the item of Taeumin) and item No.87 (in the item of Soeumin) (Table.3, 4, 5, 6). Conclusion The QSCCII is shown as a questionnaire composed of mostly no significant response changes in test-retest in each item through this study. Some items were appropriately deleted in the process of developing the advanced model, but there are also items that should be considered further. It is thought that some items should be used after being refined in content and form.

• 대한가정학회지
• /
• 제20권2호
• /
• pp.135-140
• /
• 1982

As a step preliminary to the factor-analysis of a child-rearing attitude scale under construction, its preliminary form containing a total of 368 self-answered questions was administerd to 88 married women with one or more children in the grade school age. all graduates of colleges and in possession of a home telephone and a house, twice from one week apart. The test-retest correlation coefficients, calculated for each test item based on the subject's choice among the three response alternatives on two test ocasions, ranged from .80 to .10. The cut-off point of r=.41 or lower led to the elimination of 48 items. As a point of incidental interest, the rate of response concordance. The namber of subjects giving the same categroy response on two occasions was calculated for each item and it was correlated with its test. retest correlation coefficient. The two different indices of item test-retest reliability were found not related to each other. Empirical evidence, as well as rational justifications, was presented to show that the correlation coefficient is the better of the tow indices of item test-retest reliability.

• 공학교육연구
• /
• 제26권6호
• /
• pp.40-50
• /
• 2023

This study is to examine the validity of assessing basic-level proficiency in physics among incoming engineering freshmen through item analysis and standard setting. For empirical analysis, we examined the physics subject taken by the freshman class of 2021 at K University, considering its significance for engineering students. In this study, we initially performed item analysis utilizing both classical test theory and item response theory. Subsequently, leveraging the item and test information, we employed a modified Angoff method and the Bookmark method for standard setting. Consequently, the difficulty level initially set during item development was found to be higher than the actual performance level exhibited by the students. This study highlights a discernible disparity between the expected university standard and the real proficiency level of incoming freshmen in terms of basic academic ability in physics. Based on these research findings, a comprehensive discussion on the fundamental academic competence of engineering students was conducted, underscoring the necessity for formulating a tailored learning approach leveraging the outcomes from the basic ability test.

• Journal of Korean Biological Nursing Science
• /
• 제20권1호
• /
• pp.11-19
• /
• 2018

Purpose: The purposes of this study were to perform items analysis using the classical test theory (CTT) and the item response theory (IRT), and to establish the validity and reliability of the Korean version of pressure ulcer prevention knowledge. Methods: The 26-item pressure ulcer prevention knowledge instrument was translated into Korean, and the item analysis of the 22 items having an adequate content validity index (CVI), was conducted. A total of 240 registered nurses in 2 university hospitals completed the questionnaire. Each item was analyzed applying CTT and IRT according to 2-parameter logistic model. Response alternatives quality, item difficulty and item discrimination were evaluated. For testing validity and reliability, Pearson correlation coefficient and Kuder Richardson-20 (KR-20) were used. Results: Scale CVI was .90 (Item-CVI range= .75-1.00). The total correct answer rate for this study population was relatively low as 52.5%. The quality of response alternatives was found to be relatively good (range= .02-.83). The item difficulty of the questions ranged form .10 to .86 according to CTT and -12.19 to 29.92 according to the IRT. This instrument had 12-low, 2-medium and 8-high item difficulty applying IRT. The values for the item discrimination ranged .04-.57 applying CTT and .00-1.47 applying IRT. And overall internal consistency (KR-20) was .62 and stability (test-retest) was .82. Conclusion: The instrument had relatively weak construct validity, item discrimination according to the IRT. Therefore, the cautious usage of a Korean version of this instrument would be recommended for discrimination because there are so many attractive response alternatives and low internal consistency.

• 한국콘텐츠학회논문지
• /
• 제13권12호
• /
• pp.321-327
• /
• 2013

이름대기 능력의 손상은 신경학적 질환을 지닌 환자뿐만 아니라, 정상적인 노화과정에 있는 노인에게서도 빈번하게 관찰된다. 이름대기 능력을 평가하기 위해 가장 널리 사용되고 있는 한국판 보스톤 이름대기 검사(Korean version-the Boston Naming Test, K-BNT)는 60문항으로 구성되어 있다. 일반노인들은 노화에 따른 주의력 감소로 인하여 검사 소요시간이 길면 검사에 대한 집중이 어려워지므로, 검사 결과에 대한 타당도 및 신뢰도를 확보하기 위해서는 문항축소가 바람직하다. 본 연구의 목적은 '문항반응이론(Item Response Theory)'을 적용하여, 60개 문항의 K-BNT를 일반노년층의 이름대기 능력을 가장 잘 평가할 수 있는 15개 문항의 검사(즉, K-BNT-15)를 개발하는 것이었다. 이를 위하여, 일반노인 175명을 대상으로 라쉬분석을 실시하여, 문항적합도, 성별 차이, 문항난이도 등을 평가하였다. K-BNT-15의 실시 결과, 일반 노년층은 10년 단위로 수행력이 감소하였고, 경도인지장애(mild cognitive impairment, MCI) 환자는 일반 노년층에 비해 유의하게 낮은 수행력을 보였다. 본 연구에서는 언어 평가도구의 단축형 개발 시, 특정 집단의 언어적 능력과 문항의 응답 결과의 관계를 규명하여 그 집단에게 적합한 문항을 선별할 수 있다는 점에서 문항반응이론이 유용함을 보여주었다. 또한, K-BNT-15가 노화에 따른 대면이름대기 감소 및 환자군과의 차이를 잘 보여주는 검사임을 검증하였다.

• 한국수학교육학회지시리즈C:초등수학교육
• /
• 제8권2호
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• 컴퓨터교육학회논문지
• /
• 제10권4호
• /
• pp.39-49
• /
• 2007

본 연구는 대학수학능력시험 직업탐구영역의 "정보기술기초" 교과의 문항 특성 및 문항 양호도 분석을 통해 양질의 문항을 개발하기 위한 분석 자료로 제시하고자 한다. 질적 연구로 내용 타당도 분석을 하였고, 양적 연구로 문항의 난이도, 변별력, 신뢰도 및 오답지 분석을 하였다. 2005년, 2006년 "정보기술기초" 교과 문항 분석결과, 교과 내용이 골고루 출제되었으나 행동영역에 대한 기준이 제고될 필요가 있었다. 또한 "정보기술기초" 교과 문항이 대학수학능력시험에 적합하도록 양질의 문항 개발이 필요하였다. 그러기 위해서는 적절한 난이도와 변별력 있는 문항 개발에 대한 연구가 필요함을 알 수 있다.