• 한국항공운항학회지
• /
• 제28권4호
• /
• pp.12-20
• /
• 2020

The purpose of this study was to analyze the face validity of the revised EPTA (English Proficiency Test for Aviation) to see if the tests actually contribute to the enhancement of aviation safety and achieve the purpose of the assessment. In order to reach the above objectives, 103 pilot test takers were surveyed, and nine in-depth interviewees were selected and interviewed. In addition, detailed research results were derived by dividing the participants into the pilot's flight experience (31 captain pilots, 42 first officer pilots, and 30 general commercial pilots). As a result, pilot participants were generally aware that EPTA was more reasonable because the revised EPTA properly implemented the aviation situation and gave participants motivation to learn aviation English. It was also seen that first officer pilots had a higher face validity of EPTA than captain and general commercial pilots. The reason was that first officer pilots considered air traffic control job was more important than other pilots did.

• 응용통계연구
• /
• 제30권4호
• /
• pp.503-512
• /
• 2017

선다형 문제의 경우 특정 위치의 답을 선호하는 수험생의 응답경향이 시험 결과에 미치는 영향을 최소화하기 위하여 정답배열을 특정위치에 편중되지 않고 고르게 분포할 필요가 있다. 이는 정답배열이 특정 번호에 편중되어 있으면 정답을 모를 때 중앙 또는 외곽 번호에 응답경향이 있는 수험생이 추측으로 문항의 답을 맞힐 수 있으므로 시험점수가 학생의 능력을 제대로 반영하지 못하는 결과를 초래할 수 있기 때문이다. 본 논문에서는 2017학년도 대학수학능력시험의 영역별 정답배열에 대하여 Bartels rank test, Wald-Wolfowitz runs test, turning point test, Cox Stuart trend test, difference sign test, Mann-Kendall rank test 등을 실시하여 정답배열이 고르게 분포되었는지 확인하였다. 또한 정답 번호와 배점 사이에 독립성이 지켜지지 않을 경우에도 특정 번호를 정답으로 선호하는 경향을 가진 수험생의 점수는 학생의 능력을 제대로 반영하지 못할 수 있기 때문에 정답의 위치와 배점 사이의 독립성 검정을 추가로 실시하였다.

• Journal of information and communication convergence engineering
• /
• 제10권1호
• /
• pp.5-10
• /
• 2012

The cyber class has many advantages because it removes the limitations of sharing the same time and space of a class in a classroom. However, most instructors still hesitate to use it because it is more vulnerable to academic misconduct than a faceto- face class. To overcome this problem, we identified suspected cheaters out of a group of test-takers through several objective data, and verified whether or not the suspects were actually cheaters. By investigating the status of academic cheating, we also implement our assessment system with Skinner’s reinforcement theory in order to eliminate or reduce cyber misconducts.

• International Journal of Contents
• /
• 제15권4호
• /
• pp.97-106
• /
• 2019

EMI (English as a Medium of Instruction) classes are now accepted policy at Korean universities, yet students often struggle with required academic English writings. The present study examined an EMI class that used direct instruction and access to online assistive English writing software. From preliminary analysis, 26 students expressed interest in how an EMI academic writing class could facilitate improved English writing skills. Study participants completed a survey on self-efficacy and learning needs and assignments for an EMI academic writing class. To establish inter-rater reliability, three trained raters assessed the written essays of students prior to and after instructional intervention. Fleiss' Kappas statistics showed moderate reliability. Students' opinions on the use of online software were also analysed. Paired t-test was run on the quality of students' pre- and post-instruction assignments, and there was significant difference in the rated scores. Self-efficacy was found to have moderate positive association with improved post-essay writing scores.

• 한국과학교육학회지
• /
• 제24권1호
• /
• pp.17-28
• /
• 2004

The purpose of this study is to determine the patterns of differences between genders in science achievement. Eleventh grade, 140 female and male students were sampled from a school in Seoul. According to the analysis results of pilot study, 20 items were finally selected for the main study. To sharpen our interpretations of the factors and provide some confirmation, we supplemented the statistical analysis with a more detailed cognitive study of the items using think-aloud protocols and interviews with student test takers. The analysis of this study took into account the different item formats, contexts, and presentation styles. The findings are as follows: First, there was no significant gender difference between multiple-choice and open-ended items. Second, male students achieved significantly better in the context of everyday life in multiple-choice items. Third, male students favored items presented as written texts. Fourth, in problem-solving process, female students tend to apply their science concepts, whereas male students tend to apply their everyday experiences. The results of this investigation indicate that gender difference in science achievement depends heavily on item characteristics.

• Journal of Korean Dental Science
• /
• 제12권2호
• /
• pp.58-65
• /
• 2019

Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

• 말소리와 음성과학
• /
• 제9권1호
• /
• pp.19-26
• /
• 2017

The main objective of this study is to investigate the influence of utterance internal pause in English speaking evaluation. To avoid possible confusion with other errors caused by segmental and prosodic inaccuracy, stem utterances with two different length obtained from a native speaker were manipulated to make a set of stimuli tokens through insertion of pauses whose length and position vary. After a total of 90 participants classified into three proficiency groups rated the stimuli, the scored data set was statistically analyzed in terms of the mixed effects model. It was confirmed that predictors such as pause length, pause position and utterance length significantly influence raters' evaluation scores. Especially, a dominating effect was found in such a way that raters gradually deducted scores in accordance with the increase of pause duration. In another experiment, a tree-based statistical learning technique was utilized to check which of the significant predictors played a more influential role than others. The findings in this paper are expected to be practically informative for both the test takers who are preparing for an English speaking test and the raters who desire to develop more objective rubric of speaking evaluation.

• 한국산학기술학회논문지
• /
• 제12권1호
• /
• pp.195-199
• /
• 2011

영어 능력평가를 위한 테스트는 평가자, 과제, 인터뷰의 주제, 그리고 평가 받는 사람의 성별 등 여러 가지 이유 때문에 그 평가 결과가 아주 다양할 수 있다. 이전의 자료는 평가자가 외국어로서의 영어구술 능력 평가 결과에 아주 중요한 영향을 끼친다는 것을 증명해 왔다. 이렇게 영어 능력 구술 평가에 영향을 미치는 평가자에 대한 많은 조사는 있었지만 평가 과정에 잠재적으로 영향을 줄 수 있는 평가자의 가변성에 대한 조사는 극히 드물었다. 시험 환경이 달라지면 그에 따라 구술 평가가 달라지고 그 평가 기준은 또 완전히 달라진다. 그러므로 다양한 시험 수행 과제에 대해 똑같은 평가 기준을 적용하는 것은 적당치 않다. 즉 평가 과정에 대한 더 많은 원안 분석과 심도 있는 연구가 필요하다. 제 2외국어로서 영어 능력평가를 위한 구술시험은 보다 더 현실적이고 효율적인 장치가 만들어져야 할 것이다.

• Clinical and Experimental Pediatrics
• /
• 제59권12호
• /
• pp.483-489
• /
• 2016

Purpose: We investigated the number of test takers of the Korean-Developmental Screening Test (K-DST) in a single children's hospital within a year, according to age, referral rate, and follow-up percentage. Methods: For this study, 4,062 children who visited and received K-DST at Woorisoa Children's Hospital between January and December 2015 were enrolled. Seven test sets were used according to the Korean National Health Screening Program for infants and children in the following age groups: 4 to 6, 9 to 12, 18 to 24, 30 to 36, 42 to 48, 54 to 60, and 66 to 71 months. The results of the K-DST were categorized into 4 groups as follows: further evaluation (<-2 standard deviation [-2SD]), follow-up test (-2SD to -1SD), peer level (-1SD to 1SD), and high level (>1SD). Results: The test participants' population and follow-up population were concentrated before the age of 24 months (2,532, 62.3%). The children most commonly referred for further evaluation were those in the 30- to 41-month age group. A mismatch was found between the results of the K-DST and the additional questions. Most of the infants and children with suspicious developmental delays showed catch-up development in their follow-up tests (43 of 55, 78.2%). Conclusion: The use of K-DST should be encouraged, especially among children aged over 24 months. Multiple-choice question format for the additional questions is recommended to avoid confusion. We suggest a nationwide study to evaluate and revise the K-DST.

• 치위생과학회지
• /
• 제14권3호
• /
• pp.371-378
• /
• 2014

본 연구는 비타민 또는 무기질 보충제 복용과 칼슘 및 인의 섭취에 따른 유치의 우식 발생과의 연관성을 파악하고자, 제4기 국민건강영양조사 자료에서 만 3~6세 아동 1,139명을 대상자로 선정하여 성별과 연령에 따른 우식경험 유치지수를 조사하여 비타민 또는 무기질 복용 여부와 칼슘과 인의 섭취 정도, 기타 사회경제적요인 및 구강관리 행동요인에 대한 통계분석을 수행하였다. 1. 연령이 증가할수록 우식경험 유치지수가 증가하였다. 2. 칼슘 섭취에 대해서는 성별에 따라 통계적으로 유의한 차이가 있었으며, 인 섭취는 3세 아동에서 성별에 따른 차이가 나타났다. 3. 만 4세 아동의 우식경험 유치지수는 비타민 및 무기질보충제를 복용하는 경우가 비복용자보다 1.206개 적었다. 이상의 단면연구 결과를 종합해 볼 때, 칼슘과 인, 비타민 및 무기질과 같은 영양섭취가 유치의 치아우식증에 영향을 줄 수 있는 주요한 요인임을 확인할 수는 없었으나. 비타민 및 무기질 보충제를 섭취하는 만 4세의 아동은 유의하게 낮은 우식경험 유치지수를 나타내었다.