• Journal of the Korean School Mathematics Society
• /
• v.10 no.1
• /
• pp.113-127
• /
• 2007

This study explored the possibility of building a statistical model predicting difficulty of mathematics test items through the analysis of nation-wide scholastic ability test results for the past 5 years. Multiple linear regression analysis was conducted in predicting difficulty of mathematics test items. We adopted three major areas for independent variables: the content area, the behavior area, and the test item format area, each of which was categorized into more detailed sub-areas. For the dependent variable, the proportion of correct answer was used to represent the item difficulty. Statistically significant independent variables were included in the regression model based on the stepwise selection method. Several important factors affecting difficulty of mathematics test items for each area were identified. R-squares for the final regression model were fairly high, implying that the regression equation can be used to predict difficulty of test items at an acceptable level. Lastly, the regression model was cross-validated using independently collected data. We believe that this study will provide basic but very critical information for predicting the proportion of correct answer by showing the factors that should be considered for developing mathematics test items for the college entrance examination or high school classroom test.

• Journal of the Korean Chemical Society
• /
• v.52 no.3
• /
• pp.295-302
• /
• 2008

In this study, the test that were used in entrance examination for chemistry class in a Science-Gifted Education Center for middle school students were analyzed by using criteria for identification and measurement of scientific giftedness and a classical test theory. The result of analysis exhibited that most of problems measured more than two elements of scientific giftedness and required applications of scientific knowledge of middle school level to solve problems. In the analysis of sub-elements of scientific giftedness, originality, fluency in creativity and finding problems/formulating hypothesis, planning inquiry, interpreting data in science process skills were dominant while drawing conclusion and generalization processes were lacking. In correlation analysis between total score and each type of problems, total score was most influenced by the problems measuring science inquiry linked with scientific knowledge. Item difficulty is moderately high and item discrimination is moderate.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.5
• /
• pp.295-302
• /
• 2011

The purpose of this study was to develop Korean Consonant Perception Test (KCPT), that is a phonemic level including elementary data to evaluate speech and consonant perception ability of the normal and the hearing impaired qualitatively and quantitatively. KCPT was completed with meaningful monosyllabic words out of possible all Korean monosyllabic words, considering articulation characteristics, the degree of difficulty, and the frequency of the phonemic appearance, after assembling a tentative initial and final consonants testing items using four multiple-choice method which were applied to the seven final consonant regulation and controlled with the familiarity of the target words. Conclusively, the final three hundred items were developed including two- and one-hundred items for initial and final testing items, respectively, with the evaluation of the 20 normal hearing adults. Through this process, the final KCPT was composed upon the colloquial frequency following identification of no speakers' variances statistically and elimination of the highly difficult items. The 30 hearing impaired were tested with KCPT and found that the half lists, A and B, were not different statistically and the initial and final testing items were appropriate for evaluating initial and final consonants, respectively.

• Communications of Mathematical Education
• /
• v.18 no.1 s.18
• /
• pp.191-199
• /
• 2004

본 연구에서는, 6년 전에 개발된 수학 창의적 문제 해결력 검사(MCPSAT; 한국교육개발원(김흥원 외, 1997))에 대한 현시점의 적합성여부를 알아보기 위하여 이 검사의 중학교 1-3학년용 A형 1부 검사와 고등학교 1-2학년용 A형 1부 검사를 해당 학년 학생들에게 적용하여 분석하였다. 검사도구의 양호도는 비교적 좋은 것으로 나타났다. 즉, 중학교와 고등학교 모두 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수가 약간 떨어져 있지만 비교적 양호한 것으로 볼 수 있으며 변별도는 점이연 상관 계수가 0에 가까운 문항이 없는 것으로 나타났다. 따라서 모든 문항이 학생들의 수학 창의적 문제 해결력을 변별해 줄 수 있을 것으로 생각한다. 내적 타당도는 중학교의 경우 관대하게 본다면 수용할 만 하고, 고등학교의 경우 아직은 우려할 수준은 아니다. 즉, 중학교 문항 1과 문항 4는 적합도 지수 1.2를 상회하였으나 Infit과 Outfit 모두 1.5를 넘는 문항은 없었다. 고등학교의 문항 4는 문항의 적합도 지수 1.2를 상회하는 것으로 나타나고 있으나 Infit과 Outfit 모두 1.2를 상회하지 않았다. 난이도 측면에서 볼 때, 이 검사의 계속 사용은 염려스러운 면이 있다. 즉, 중학교에서는 6년 전 보다 쉬운 것으로 나타나고 있는 바 이것은 현재의 학생들이 이러한 유형의 문항을 많이 접하였을 것으로 추측할 수 있다. 고등학교에서는 6년 전 보다 조금 더 어려워 졌다고 볼 수 있다. 위의 사항을 종합할 때, 수학 창의적 문제 해결력 검사에서 중학생용은 현재의 학생들의 수준을 고려하여 재 표준화하는 것이 바람직하고, 고등학생용은 개발 당시의 신뢰도, 난이도, 변별도 등에서 유사하므로 당분간 계속 사용하여도 될 것이다.

• The Journal of Korean society of community based occupational therapy
• /
• v.9 no.2
• /
• pp.43-58
• /
• 2019

Objective : The purpose of this study was to develop an assessment tool to measure Korean occupational balance. Methods : From March 2017 to July 2019, preliminary questionnaire was prepared through analysis of previous research and expert focus meeting, and preliminary questions were selected through the Delphi survey. In order to verify the validity of the items, Rash analysis was conducted to analyze the persons and items fitness, the distribution of item difficulty, separation reliability, and the appropriateness of the rating scale. Results : Among 141 subjects, 9 (6.38%) in time use and 11 (7.80%) in the occupation area were inappropriate subjects. As a result of analyzing the appropriateness of the items except for the inappropriate subjects, the 3 items were judged as ineligible items, but 1 item of the occupation characteristics was finally deleted based on the theoretical and clinical grounds. In the analysis of the scale, 4 points were more appropriate than the 5 point scale, and the separation reliability was .86~.94. Finally, 3 categories (time use, occupation area, occupation characteristics) and 18 items were selected. Conclusion : The occupational balance assessment tool was selected three categories and 18 questions finally, three categories and 18 questions, and was developed on a four-point Likert scale. Further research needs to prove the concurrent validity of the K-OBA and to analyze the factors that influence the occupational balance.

• Journal of the Korean Data and Information Science Society
• /
• v.22 no.3
• /
• pp.487-494
• /
• 2011

The purpose of this study was to investigate self-esteem item goodness-of-fit in sports talented children with socio-psychological aspect, which may be a basis of developing global sports leaders. Fifty children who were selected by 2010 sports talent identification program at Korea National Sport University participated in this study. All participants were asked to answer the questionnaire using Rogenberg (1965) self-esteem scale. Total 8 questions were used with 4 point Likert scale and high point stands for higher self-esteem status. Reliability of Cronbach's ${\alpha}$ was.785 in this study. Frequency analysis, descriptive statistics, and reliability analysis were conducted with SPSS 18.0. WINSTEPS 3.70 (Linacre, 2010) was used for calculating item goodness-of-fit and subject reliability, scale propriety, item goodness-of-fit and item level of difficulty, and level of difficulty were calculated. Statistical analysis showed results as follows. First, it was reported to be suitable for subject reliability in self-esteem as 1.01~1.03 and item reliability as 1.01~1.01. Second, 4 scale was suitable for scale propriety resulting from stage index judgment. Third, 2,7,8 and 3 question showed problems in item goodness-of-fit and item level of difficulty. Finally, scale propriety was reported to be inappropriate for considering sports talented children's ability distribution and scale level of difficulty.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2000.05a
• /
• pp.268-273
• /
• 2000

기존의 웹 기반 학습 평가 시스템은 학습자의 선택 기회가 없는 상태에서 일방적으로 제시된 문제지로 평가하게 되거나, 문제 은행에서 임의로 추출한 문제도 단순히 무작위로나 난이도만을 고려하여 문제지를 구성하였고, 그 결과에 대한 성취도의 분석도 한 문제지에 대한 정오표 또는 점수로 단순하게 제시하기 때문에 학습자의 지속적인 학습 관리가 이루어지지 못하고 있다. 본 논문에서는 문제유형, 과목 및 단원 난이도, 문항 형태, 문항당 배점, 문항당 배당 시간등의 다양한 정보를 가진 유형별 문제 은행을 구축하였다. 학습자는 마치 문제집을 풀고 싶은 유형의 문제를 선택하듯이 문제 은행에서 문제를 자율적으로 구성하여 평가할 수 있는 유형별 문제지나 대학수학능력시험의 기준에 맞추어 자동 구성되는 종합 문제지로 다양하게 평가할 수 있다. 또한, 한문제지에 대한 결과뿐만 아니라 유형별, 월별 성취도 분석을 통하여 평가한 총점에 대한 획득한 점수의 누적 통계를 그래프로 일목요연하게 보여주어 한 학습자에 대한 지속적인 성취도 분석이 가능하도록 구축하였다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2005.07a
• /
• pp.94-96
• /
• 2005

e-Learning 교육관리시스템은 다양한 교육 정보와 평가를 바탕으로 빠르게 확산되고 있다. 학습자의 학습 동기와 평가 성취도를 높이기 위한 연구와 기술들이 많이 적용되었다. 그러나 대부분의 교육관리시스템은 동일한 학습 내용을 일방적으로 제공하며, 학습 영역에 맞는 난이도별 문제를 추출해 제공하고 있다. 본 연구에서는 학습자의 사전진단평가와 설문조사를 바탕으로 하여 수준을 결정하고, 그에 따른 학습 영역의 내용과 문제를 난이도별 문항수를 적용, 추출하여 학습 동기와 학습 성취도를 극대화할 수 있을 것이다. 또한 본 연구의 시스템은 학습자 수준에 따른 난이도별 문항수 비율을 비례하게 적용하여 흥미도를 최대화하여, 학습 내용과 문제를 재사용하여 피드백 학습을 할 수 있도록 하였다.

• Journal of the Korean earth science society
• /
• v.26 no.6
• /
• pp.511-523
• /
• 2005

The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

• Journal of Music and Human Behavior
• /
• v.10 no.1
• /
• pp.67-83
• /
• 2013

Assessment in music therapy is a vital part for both the therapist and client in the process of therapy. Based on what is assessed, objectives are identified to formulate specific action procedures and strategies. The existing assessment tools involve lists of skills and behaviors in developmental domains without the music assessment protocol. In this study, the authors attempted to develop an assessment protocol using rhythm production for assessing skills in cognitive and emotional-behavior domain, namely Music Therapy Assessment for Cognitive and Emotional Behaviors (MACEB). The test items of the MACEB-Rhythm were developed using rhythmic patterns varying in terms of item difficulty, which are based on the various degree of clarity in the grouping/gestalt, saliency in part-whole relationship, and complexity in repetition vs. variability. Also the developed tool purported to examine one's level of emotional behavior trait by analyzing performance of musical parameters such as tempo, pacing, and loudness in the reproduced output. In order to verify the logical sequencing of test items, firstly 61 subjects participated in verifying the item difficulty for the selected 15 pilot items. The test items were revised and re-sequenced based on the gathered scores of item difficulty. In the second procedure, seven experts in the fields of music education, music therapy and music psychology whose research interest lie in music cognition revised the developed rhythm protocol items focusing on learning sequence, cognitive process and feasibility for skills assessment. The study attempted to provide foundations for using rhythm as an assessment protocol prior to its verification of assessment validity and reliability.