• 수산해양교육연구
• /
• 제13권1호
• /
• pp.99-116
• /
• 2001

Testing is a procedure used to measure a sample of behaviour in order to discover how well a seafarer performs, usually in comparison with others, or compared with identified performance criteria. In this context It is important that the test, in whatever form it is being used, yields consistent results by being valid, reliable and practical. Whilst we can only take a sample of a person's knowledge or comprehension about topic in this way, testing methods do provide a more reliable estimate of performance than most other observational techniques; unsystematic or irregular observation being too unreliable. The method of examination has been specified in the provisions of Regulation 12 of the Decree of the ship officers act as followings. Other necessary matters for conducting oral and written examinations have been set out by the Minister. But written examination is too shortage of period and small number of question to cover the qualification of each level and oral test is just simple and namely Traditionally, written examinations have been provided as the only means for determining the acquisition of knowledge by the mariner. Typically, the examination formats have taken the format of either an essay or multiple choice examinations. Essay items, used in the vast majority of subject examination(not in Korea), consisted of three basic types: situational, descriptive and computational. The level of certificate being examined determined the number and mix of the type of essay questions selected. Oral question has again been used by assessors of seafarer in a wide variety of contexts. Also, oral questioning is often used when observation of performance is undertaken to ask why a certain action has been taken, or to be broaden the scope of what has been observed. At end, Each techniques have their own advantage and disadvantage, so we have to choose some or all of the following techniques, depending upon the certificate, qualification or job for which the trainee is aiming. But in high lank, we have to use both of essay type and multiple choice and with enough time of oral test at least 30 minutes. Who would be the assessor? According to the STCW Code Section A-I/6, instructors, supervisor and assessors are appropriately qualified for particular types and levels of training or assessment of competence of seafarers either on board or ashore, as required under the Convention, in accordance with the provisions of this section.

• 한국문헌정보학회지
• /
• 제47권2호
• /
• pp.181-200
• /
• 2013

정보활용교육을 효과적으로 전개하기 위해서는 피교육자의 능력을 진단, 측정하고 교육목표의 도달 여부를 판단할 수 있는 검사도구가 필수적이다. 그럼에도 불구하고 초 중등 학생들의 정보활용능력을 종합적으로 측정할 수 있는 검사도구가 미흡한 실정이다. 이에 본 연구에서는 중학생의 정보활용능력 측정을 위한 웹기반의 표준화된 검사도구를 개발하고, 검사도구의 신뢰도와 타당성을 검증하였다. 검사도구의 개발을 위해서 우선 정보활용능력의 구성요인을 추출하고, 길포드의 지능구조모형과 메이커의 학습능력 측정도구를 바탕으로 정보활용능력 검사도구의 프레임을 개발하였다. 본 연구를 통해 개발한 검사도구는 웹 기반의 선다형 30문항으로 구성되어 있으며, 794명의 중학생들을 대상으로 검사를 시행하여 문항의 난이도, 신뢰도, 변별력 지수, 타당도 등을 분석하였다. 또한, 검사도구를 이용하여 학생들의 정보활용능력을 진단하고, 평가하기 위한 표준 점수를 제시하였다.

• 한국과학교육학회지
• /
• 제30권4호
• /
• pp.452-471
• /
• 2010

수능이 1994학년도에 처음 시행된 이후 17년 동안 시행되어 오면서 기출을 피하면서 사고력을 측정하는 참신한 문항을 출제하는 것이 점점 어려워지고 있다. 그러므로 수학능력 측정을 위한 양호한 문항의 개발을 위한 지속적인 연구가 필요하다. 이러한 맥락에서 수능 문항 개발에 필요한 시사점을 도출하기 위해 수능과 같은 국가 수준의 선다형 대입 관련 시험 분석의 일환으로 일본 센터시험을 분석하였다. 이 연구에서는 센터시험의 체제와 이과 출제 과목 및 응시과목의 수나 응시자 현황을 파악하고, 2009년 1월에 시행한 '이과' 시험의 검사지 구성, 문항 유형, 특이 사항 등을 분석하였다. 또한 센터시험 문항을 수능과 관련하여 내용 요소 및 행동영역에 따라 분석하였고, 아울러 우리나라 수험생의 관점에서 예상 정답률을 추정하였다. 분석 결과, 센터시험 문항은 고급 사고력보다는 지식 측정 또는 낮은 사고력을 주로 측정하고 있다. 또한 문항 당 배당되는 시간이 수능보다 길며 문항 수가 고정되지 않았고, 배점과 답지 수도 다양하다. 그리고 실생활 소재를 많이 사용하면서 문장 표현을 엄격하게 하지 않는 경향이 있다. 센터시험에서 원점수를 사용하는 것으로 보아 선택 과목 간 유 불리 문제가 크지 않은 것으로 보인다. 또한 문과나 이과의 계열 구분 없이 대부분의 학과에서 선택 과목으로 과학과목 성적을 요구하고 있다.

• 한국어교육
• /
• 제25권1호
• /
• pp.169-201
• /
• 2014

The purpose of this research is to analyze the problems of the way of the 32th TOPIK(advanced)'s management for the disabled examinee and to prescribe the management of the TOPIK for them. Since the TOPIK started in 1997, the number of examinee who take it as a qualifying exam for the university entrance have gradually increased. The first disabled examinee who wants to use the result of the TOPIK for entrance into the post graduated university took the 32th TOPIK(advanced level). However, there was no examination regulations and detailed management method for the disabled. The biggest problem was the examinee could not have braille test and answer. The exam supervisor read all that is printed on the test sheet. It caused two big problems. 1) The essay question in writing test became an oral test. 2) The strategies of answering to multiple choice questions could not be used in vocabulary/grammar, writing, listening, and specially reading section. The first problem is occurred because writing and speaking have different cognitive process. The second one can be strongly related to the result in reading section. Above all, these disrupt accurate assessment of the examinee's writing and reading achievement. Therefore, this research insists the TOPIK needs to have the regulation and prescribe the management for the disabled. This research suggests 5 regulations for the blind examinee which covers the test time, supervisor, place and request of the examinee. These refer to the regulation for the disable in the other tests, such as the college scholarship ability test, TOEFL, TEPS, and a civil service exam.

• 영어어문교육
• /
• 제5호
• /
• pp.149-189
• /
• 1999

Assessment can be defined as any method used to understand the current knowledge that a student possesses. Assessment may influence decisions about grades, placement, instructional needs, and curriculum. Therefore, the purpose of assessment is to identify how the students think and know, to diagnose the difficulties they face, and to reflect the result of assessment on teaching. But the traditional multiple-choice test failed to evaluate and teach higher-level thinking and problem-solving skills. In this context, performance assessment is being required as an alternative assessment to get better understanding about what the students can do as well as what they know. This article points out some weaknesses of traditional assessments, and comments on the theoretical background and necessity of performance assessment. And it presents more specific information about performance assessment and some examples. It is certain that performance assessment is student-centered and future-oriented. But performance assessment can't be the surest and best way of evaluating the students' abilities. We are just on the way of another experimental stage for improving teaching methodology. More supplementary analyses and further improvements are needed.

• 한국임상약학회지
• /
• 제30권2호
• /
• pp.127-133
• /
• 2020

Competencies of entry-level pharmacists are evaluated by multiple-choice questions (MCQ) examination and objective structured clinical examination (OSCE). OSCE helps to evaluate student's communication skills and attitudes, which are difficult to evaluate by the MCQ exam. In Korea, pharmacy OSCE is not implemented; however, the needs of OSCE is growing. This study proposed OSCE exam contents and exam methods that can be implemented in colleges of pharmacy. Further study is needed to develop OSCE scenarios and questions, validate examination questions and evaluation methods by performing a pilot study, and provide feedback on the curriculum and study methods.

• 한국주거학회:학술대회논문집
• /
• 한국주거학회 2004년도 추계학술대회 논문집
• /
• pp.89-96
• /
• 2004

The purpose of the study was to identify the status of satisfaction level, moving motivation, the level of housing choosing behavior, and housing needs of potential purchasers in bukgu new housing area, Ulsan. The survey used questionnaire from 336 households living in bukgu area and analyzed using descriptive statistics, and one-way analysis of variance and Scheffe' multiple range test. The research results showed low degree of residents' satisfaction in storage space, neighborhood environment. The moving motivations were physical environment improvement, education environment, walking road, view and lighting.

• 영어어문교육
• /
• 제16권3호
• /
• pp.1-18
• /
• 2010

This study examined the effects of previewing and providing background knowledge on low level EFL readers' comprehension of expository texts and their responses to these treatments. 130 college freshmen were randomly placed into one of three treatment groups and read two expository texts reflecting unfamiliar cultural information. Prior to reading, one group was given previewing instruction, which included vocabulary preteaching and summaries, and a second group was provided with culture-specific background knowledge through watching videos and slides. The third group read each text without any prereading instruction. Immediately after reading a passage, subjects answered a 10-item multiple-choice test. Results showed significant positive effects of the previewing treatment and weak positive effects of the providing background knowledge treatment. Students' responses on the questionnaires revealed that the majority felt that the experimental treatments contributed to comprehension enhancement, made reading more enjoyable, and expedited their reading process. Students in the control group, however, indicated that they needed explicit prereading instruction in order to understand the texts. Pedagogical implications of the findings for EFL reading instruction are provided.

• 한방재활의학과학회지
• /
• 제20권4호
• /
• pp.105-130
• /
• 2010

Objectives : The purpose of this study was to assess the statistical methods errors used in the journal of Oriental Rehabilitation Medicine(JORM) and to identify the types of errors in statistical analysis. Methods : We reviewed quantitative articles that were published in the JORM from January 2005 through October 2009. Those were not used by statistical analysis such as literature studies, case study, review articles were not included in this analysis. A total of 296 articles was reviewed. We evaluated the adequacy and the validity of the statistical techniques with our checklist established be modified Lee's checklist, and three statistical evaluators assessed together to minimize bias. Results : Of the 222 articles, 213 were used in inferential and descriptive statistics. Of those 80% of articles adopting descriptive and inferential statistics were detected having statistical errors. One articles used 1.7 statistical method unit generally. Most frequently employed statistics were student t-test, one way ANOVA. pearson correlation analysis, Mann-whitney U test, paired t-test, and chi-square test in their order. However, most frequent statistics having errors were similar in order. The most common statistic errors were as follow: 1. absence of normality test, 2. misuse between paired test and unpaired test, 3. wrong choice of repeated measures analysis without consideration of time variables, 4, increase of Type I error by using inappropriate multiple test, 5. inappropriate application of discrete or categorical data instead of continuous data in correlation analysis, 6. poor consideration of basic consumption in chi-square test, 7. confusion between frequency comparison and average comparison, 8. mentioning the statistical technique without using it. Conclusions : We found various mistake or misuses in the applications of statistical methodologies in the articles published in the JORM. Careful consideration of statistical use and review from the specialist of statistics are warranted for improving the quality of JORM.

• 사상체질의학회지
• /
• 제35권1호
• /
• pp.35-45
• /
• 2023

Objectives We tried to examine the change in the test-retest response for the questionnaire itself regarding the QSCCII. Methods Tests were conducted twice times with an interval of 6 months between tests for test-retest reliability analysis. We examined the test-retest answer agreement rate (%) in all items of QSCCII . We conducted NcNemar analysis to examine test-retest reliability for 77 items selected from the QSCCII. Results The body shape-multiple-choice items showed a tendency of low test-retest agreement rate and most of the questions about when I was not well and when I felt my body condition improve showed an high test-retest agreement rate tendency in all items of QSCCII. As a result of the research on the selected 77 items, there was a significant change in the answer in item No.25, 58(in the item of Soeumin) item No.45, 103(in the item of Taeumin) and item No.87 (in the item of Soeumin) (Table.3, 4, 5, 6). Conclusion The QSCCII is shown as a questionnaire composed of mostly no significant response changes in test-retest in each item through this study. Some items were appropriately deleted in the process of developing the advanced model, but there are also items that should be considered further. It is thought that some items should be used after being refined in content and form.