• Title/Summary/Keyword: 단답형

Search Result 40, Processing Time 0.02 seconds

Deep learning-based Answer Type Classifier Considering Topicality in Korean Question Answering (한국어 질의 응답에서의 화제성을 고려한 딥러닝 기반 정답 유형 분류기)

  • Cho, Seung Woo;Choi, DongHyun;Kim, EungGyun
    • Annual Conference on Human and Language Technology
    • /
    • 2019.10a
    • /
    • pp.103-108
    • /
    • 2019
  • 한국어 질의 응답의 입력 질문에 대한 예상 정답 유형을 단답형 또는 서술형으로 이진 분류하는 방법에 대해 서술한다. 일반적인 개체명 인식으로 확인할 수 없는 질의 주제어의 화제성을 반영하기 위하여, 검색 엔진 쿼리를 빈도수로 분석한다. 분석된 질의 주제어 정보와 함께, 정답의 범위를 제약할 수 있는 속성 표현과 육하원칙 정보를 입력 자질로 사용한다. 기존 신경망 분류 모델과 비교한 실험에서, 추가 자질을 적용한 모델이 4% 정도 향상된 분류 성능을 보이는 것을 확인할 수 있었다.

  • PDF

Evaluation of Generative AI's Understading of Hate Speech Using Appropriateness Conditions (적정성 조건을 활용한 생성 AI의 혐오 화행 이해 평가)

  • Kang Joeun;Kim Yujin;Kim Hansaem
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.95-100
    • /
    • 2023
  • 끊임없이 재생산되는 혐오 표현의 정확한 탐지를 위해서는 혐오란 무엇인가에 대한 본질적인 이해가 필요하다. 본 연구에서는 화용론에서 사용되는 적정성 조건이라는 분석 틀을 활용하여 모델이 '혐오하기' 화행을 어떻게 인식하고 있는지 평가하고자 했다. 혐오 화행의 적정성 조건을 명제 내용 조건, 예비 조건, 성실성 조건, 본질 조건으로 나누어 분석하였으며, 이를 진위형, 연결형, 단답형, 논술형 문항으로 구성했다. 그 결과 모든 문항 유형에서 50점이 넘는 점수를 받았으나 비교적 고차원인 사고 능력을 측정하는 단답형과 논술형 문항 유형의 점수가 가장 낮게 나타났다.

  • PDF

Evaluating Table QA with Generative Language Models (생성형 언어모델을 이용한 테이블 질의응답 평가)

  • Kyungkoo Min;Jooyoung Choi;Myoseop Sim;Haemin Jung;Minjun Park;Jungkyu Choi
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.75-79
    • /
    • 2023
  • 문서에서 테이블은 중요한 정보들을 축약하여 모아 놓은 정보 집합체라고 할 수 있다. 이러한 테이블을 대상으로 질의응답하는 테이블 질의응답 기술이 연구되고 있으며, 이 중 언어모델을 이용한 연구가 좋은 결과를 보이고 있다. 본 연구에서는 최근 주목받고 있는 생성형 언어모델 기술을 테이블 질의응답에 적용하여 언어모델과 프롬프트의 변경에 따른 결과를 살펴보고, 단답형 정답과 생성형 결과의 특성에 적합한 평가방법으로 측정해 보았다. 자체 개발한 EXAONE 1.7B 모델의 경우 KorWiki 데이터셋에 대해 적용하여 EM 92.49, F1 94.81의 결과를 얻었으며, 이를 통해 작은 크기의 모델을 파인튜닝하여 GPT-4와 같은 초거대 모델보다 좋은 성능을 보일 수 있음을 확인하였다.

  • PDF

Exploring Users' Desired Emotion in Product Light Focusing on the Refrigerator (제품 조명에 기대하는 소구 감성 탐색: 냉장고 사례를 중심으로)

  • Jeong, Kyeong Ah;Suk, Hyeon-Jeong
    • Science of Emotion and Sensibility
    • /
    • v.21 no.3
    • /
    • pp.3-16
    • /
    • 2018
  • Despite the substantial changes made in the product design field to adopt light as an essential design element, there has been little effort to define how customers respond emotionally to the light design of products. Therefore, it is necessary to analyze the emotional effect of light as a new design element. However, previous research focuses solely on deriving optimal lighting conditions to achieve particular emotional effects. Therefore, this paper investigates the customers' desired emotional effects of product's light design. We studied refrigerators that utilize light as the main design element of the product. We applied mixed methods by combining close-ended questions and open-ended question to efficiently derive the desired emotion. Participants were asked to choose the most favorable refrigerator image in each of the twelve image groups and indicate why they choose that image with the short-answer survey form. Approximately one thousand terms were collected, and those terms were classified into 29 groups using thesaurus relationships. The term groups were again classified into the four big emotion categories and labelled as "abstract quality," "light property," "space perception," and "visual comfort." Also, a model of the relationship between desired light style and light properties was proposed, since we observed the light properties related to three other categories. This study used mixed methods to identify the emotional value of a new design element. We suggest that the emotional categories derived and the proposed relationship model could be used to evaluate the product's light design.

Web-based online evaluation system for essay question (주관식 평가를 위한 웹기반 온라인 평가 시스템의 구현 및 적용)

  • Kim, Hong-Ki;Hong, Dong-Kweon
    • Journal of The Korean Association of Information Education
    • /
    • v.8 no.2
    • /
    • pp.251-259
    • /
    • 2004
  • Widespread internet service has brought many changes to modern life. Internet installed at school and intra-school computer network presented various education activities such as web-based instruction, immediate evaluation, and management of progress in studying. In this paper an essay question evaluation system for web service is studied for rapid measurement of accomplishment of student. This system provides evaluation of answers consisting a simple sentence and not demanding one word. If an essay question has exactly specified answer sheets and scoring criterion, this system give highly accurate scoring results, which shows nearly the same scoring of a teacher, needs very short time for evaluation, and represents real-time feed back result, so it is expected very high efficiency for the evaluation of an essay question.

  • PDF

A Decomposition of the Work of Leading Mathematical Discussions with Single Case Questions (단답형 문제를 이용한 수학 토론에 수반된 교수 업무 분석)

  • Kim, Yeon
    • Journal of Educational Research in Mathematics
    • /
    • v.23 no.4
    • /
    • pp.449-466
    • /
    • 2013
  • Mathematical discussion has been highlighted so that what students do actually guides their learning of mathematics and mathematical practice. However, the work of leading mathematical discussions has not yet been specified in such a way that it can be adequately studied and taught to teachers. This study analyzes a teacher's lessons that show full engagement in leading discussions, and examines the work of leading mathematical discussions in elementary classrooms. It identifies and illustrates the central tasks of leading mathematical discussions with single case questions with five steps. This article argues several key issues in leading mathematical discussions: helping students engage in struggling with important mathematical ideas, treating mathematical connections in an explicit and public way to have coherent and structured discussions, and parsing the work of teaching at a grain size that is usable in educating teachers.

  • PDF

Comparative Analysis of Informatics Education Assessment Tools in Overseas High School (해외 고등학교 정보 교육 검사도구의 비교 분석)

  • Choi, HeeJeong;Lee, WonGyu;Kim, JaMee
    • The Journal of Korean Association of Computer Education
    • /
    • v.21 no.1
    • /
    • pp.31-42
    • /
    • 2018
  • Countries around the world are strengthening informatics education to cope with the development of technology that leads to rapid social change. The last step in the capacity to foster through formal education is high school education. The purpose of this study is to examine the competence and level of informatics curriculum for high school students who aim to enter university in terms of testing tools. In order to carry out the research, we analyzed informatics education related test tools for high school students such as Japan, Germany, and USA. The results of the analysis are as follows: First, both the essay type and the short answer type question are included in the test tool as well as the multiple choice question type. Second, we use the real world model as an item and ask whether we can use computing power for practical problem solving ability. Third, the items directly related to the university education are reflected in the items. This study suggests that it has helped to elucidate the features and discussions of the test tool and establish the development direction of the test tool for informatics education.

An Analysis on the Information-seeking Behaviour of Users in the Internet Board of National Archives and Record Service (국가기록원 인터넷 게시판 이용자의 정보이용행태 분석)

  • Joung, Kyoung-Hee
    • Journal of Korean Library and Information Science Society
    • /
    • v.37 no.1
    • /
    • pp.283-303
    • /
    • 2006
  • An understanding the information seeking-behaviour of archival users is a basic for archival reference services. This study tries to understand who are users of internet board of archives, how and why they ask questions. And the study examines how archivists answer the users' questions. The data used in this study are 3,760 answers and questions in the internet board of National Archives and Record Service during $2000\sim2005$. According to this analysis. lots of users of the board make queries for archival management and asking various archives. And they are public officials, archivists, students, researches, and producers of media. The users mainly ask simple questions and it take average 5 days for users to get answers.

  • PDF

The Low Cost Implementation of Speech Recognition System for the Web (웹에서의 저가 음성인식 시스템의 구현)

  • Park, Yong-Beom;Park, Jong-Il
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.4
    • /
    • pp.1129-1135
    • /
    • 1999
  • isolated word recognition using the Dynamic Time warping algorithm has shown good recognition rate on speaker dependent environment. But, practically, since the searching time of the dynamic Time Warping algorithm is rapidly increased as searching data is increased. it is hard to implement. In the context-dependent-short-query system such as educational children's workbook on the Web, the number of responses to the specific questions is limited. Therefore, the searching space for the answers can be reduced depending on the questions. In this paper, low cost implementation method using DTW for the Web has been proposed. To cover the weakness of DTW, the searching space is reduced by the context. the searching space, depends on the specific questions, is chosen from interest searchable candidates. In the real implementation, the proposed method show better performance of both time and recognition rate.

  • PDF

Design and Implementation of Web Based Instruction System using Java Server Pages (JSP를 이용한 웹 기반 교수학습 시스템의 설계 및 구현)

  • Jung, Jong-Dae;Nam, Jae-Yeal;Choi, Jae-Gak
    • Journal of The Korean Association of Information Education
    • /
    • v.7 no.3
    • /
    • pp.263-274
    • /
    • 2003
  • Web based instruction (WBI) has been widely used thesedays because the web has various advantages for instruction. However, most of current WBI systems do not support various requirements from students. It is because of the lack of research for structural instruction method. This paper presents a new method of WBI and designs an instruction model to support various requirements from students by implementing dynamic WBI system using JSP to solve current WBI problems. The developed WBI system uses multimedia based instructions. The implemented system focused on the practical instruction by providing the functions of listening, homework, and test on web site. For the similar effects as in the classroom, it supports functions of electronic white board and multimedia data which is consisted of high-quality sound and video data with high degree of compression. Furthermore, the system supports that instructors can design a test using three kinds of basic forms, a multiple-choice test, brief-answer test, essay test, and evaluate the tests easily. It also supports easy management for homework, lecture registration, and many school affairs.

  • PDF