• 한국해양공학회지
• /
• 제24권2호
• /
• pp.74-81
• /
• 2010

Ship STEP is the international standard for the exchange of ship modeling data between heterogeneous systems. It is expected that STEP AP218 can be used for seamless data exchange between various CAD/CAM/CAE systems used in the shipbuilding design process. Although the conformance assessment for standards would maximize the performance and confidence about data exchanges, most research has been directed toward interoperability testing. ISO SC4/TC184 only provides the method for conformance testing, and it can be used with test cases on application protocols. Even though standards have been defined for conformance assessment and testing, there is no organization or association. CAD vendors have focused on interoperability testing for evaluation of the performance of their systems. In this paper, the conformance testing criteria for AP218 have been developed with abstract test cases of ship structures. The requested STEP translator was also reviewed with a developed item pool of testing criteria. The criteria methodology would be a guideline for the development of translators and interfaces. The item pool method of testing criteria for conformance assessment would increase performance and efficiency of data translators for Ship STEP and other standards.

• 영어어문교육
• /
• 제16권4호
• /
• pp.153-184
• /
• 2010

On the bases of the 5 principles and the 4 criteria for designing and developing of the listening and the reading test of National English Ability Test (NEAT), this study presents Item-Types Decision-Making Model as a blueprint for designing and constructing the two tests. It sets up the criteria for validating item types, designs a modular type of test specifications, constructs an item-types bank, and specifies a complementary type of test specifications of the two tests. To gather all these threads up, it constructs Item-Types Decision-Making Model which consists of such components as the item-type pool, the validity criteria and the procedures of testing item types, the item-types bank, the modular and the complementary type test specification. Thus, it shows how the Model works in developing and constructing the two level-differentiated listening and reading tests (the 2nd and the 3rd rank) of NEAT. Finally, it discusses some implications and applications of the Model to the two level-differentiated tests (the A and the B type) of 2014 CSAT (College Scholastic Ability Test) systems, National Assessment of Educational Achievement (NAEA), and classroom testing. In conclusion, Item-Types Decision-Making Model functions as a testing template in an item development system and as a matrix in an item-types bank system.

• 디지털정책학회지
• /
• 제2권4호
• /
• pp.1-10
• /
• 2023

본 연구는 경찰교통에서의 효과적 ChatGPT 활용 방안 도출을 위한 사전 연구로서 운전면허 학과시험과 도로교통사고감정사 시험에 대한 ChatGPT의 응답을 분석하였다. ChatGPT가 뛰어난 성능과 접근성으로 여러 분야에서 기대를 받고 있으나 경찰 교통법규와 같이 고도의 정확성이 요구되는 분야에서는 사전에 그 성능과 한계를 탐색할 필요가 있다. 이에 본 연구에서는 운전면허 학과시험 문제은행과 도로교통사고감정사 1차 시험을 대상으로 파이썬 코드로 OpenAI API를 이용해 30회의 반복 실험으로 ChatGPT의 응답을 수집하고 응답 결과를 바탕으로 시험별·연도별·내용 영역별 정답률, 일관성 능력을 분석하였다. 분석 결과 첫째, 운전면허 학과시험 및 도로교통사고감정사 1차 시험의 평균 정답률은 각 44.60%, 35.45%로 합격기준보다 낮았다. 연도별로는 2022년 이후 정답률이 평균 정답률을 하회했다. 둘째, 영역별 정답률은 29.69%~56.80%로 나타나 큰 편차를 보였다. 셋째, 정답을 맞힌 경우 95% 이상 일관되게 같은 응답을 출력하였다. ChatGPT의 효과적 활용을 위해서는 사용자의 전문 지식, 평가 데이터 및 방법 마련, 양질의 교통법규 말뭉치 설계와 주기적 학습이 필요하다고 판단된다.