• Title/Summary/Keyword: short answer questions

Search Result 52, Processing Time 0.025 seconds

Semi-Automatic Scoring for Short Korean Free-Text Responses Using Semi-Supervised Learning (준지도학습 방법을 이용한 한국어 서답형 문항 반자동 채점)

  • Cheon, Min-Ah;Seo, Hyeong-Won;Kim, Jae-Hoon;Noh, Eun-Hee;Sung, Kyung-Hee;Lim, EunYoung
    • Korean Journal of Cognitive Science
    • /
    • v.26 no.2
    • /
    • pp.147-165
    • /
    • 2015
  • Through short-answer questions, we can reflect the depth of students' understanding and higher-order thinking skills. Scoring for short-answer questions may take long time and may be an issue on consistency of grading. To alleviate such the suffering, automated scoring systems are widely used in Europe and America, but are in the initial stage in research in Korea. In this paper, we propose a semi-automatic scoring system for short Korean free-text responses using semi-supervised learning. First of all, based on the similarity score between students' answers and model answers, the proposed system grades students' answers and the scored answers with high reliability have been included in the model answers through the thorough test. This process repeats until all answers are scored. The proposed system is used experimentally in Korean and social studies in Nationwide Scholastic Achievement Test. We have confirmed that the processing time and the consistency of grades are promisingly improved. Using the system, various assessment methods have got to be developed and comparative studies need to be performed before applying to school fields.

A Survey of Utilizing Status and Demand for Medical Devices in Traditional Korean Medicine (한방의료기기 사용 현황 및 개발 수요에 대한 조사 연구)

  • Nam, Dong-Hyun
    • The Journal of Korean Medicine
    • /
    • v.34 no.1
    • /
    • pp.69-79
    • /
    • 2013
  • Objectives: The aim of this survey was to investigate utilization, intended use, problems with and demand for medical devices by surveying members of the traditional Korean medical society. Methods: We distributed questionnaires to 13,957 traditional Korean medical doctors via e-mail, and received replies from 1,225. The questionnaire consisted of 4 multiple-choice questions for survey respondent information, 8 multiple-choice questions about the status of medical devices utilizing, and a short answer question about the demand for medical devices. Results: Use of medical devices in traditional Korean medical clinics is common. Diagnostic medical devices are mainly used to assess the patient's condition and to establish a close rapport with clients. In case of therapeutic medical devices, they are usually used for secondary treatment. Issues with traditional Korean medical devices currently in use were ineligibility for national health insurance, low reliability, uncertain validity, and high price. In development of traditional Korean medical equipment, the need for diagnostic medical devices was greater than for therapeutic, and the need for the recording and analysis of medical image data and visualization of medical information was great. Conclusions: There is growing demand for facilitating the development and commercialization of traditional Korean medical devices. To satisfy this demand, research on evaluation indicators that reflect functional and structural clinical information and how to clinically assess the indicators should proceed.

Korea's Logistics Education and Certification System to Support Globalization (글로벌 시대의 물류전문인력 육성 과제)

  • 안승범
    • Journal of Korea Port Economic Association
    • /
    • v.17 no.2
    • /
    • pp.89-110
    • /
    • 2001
  • Recent trends in globalization and informatization underscore the importance of logistics. As a result, there is a need for skilled and specialized logisticians. Third Party Logistics (TPL) and Supply Chain Management (SCM) require logisticians with a broad base of knowledge in areas such as multimodal transport, international trade, information technology computers, finance, operations management, etc. This study conducted a survey to find out the opinions of demanders and suppliers. The results of the surrey show that there are more skilled logisticians in the field of management, computer works in manager level and system management. The survey also found that the certificate exam, which the Ministry of Construction and Transportation started in 1997 as the "Certified Logistics Manager" exam, should have more questions in areas such as foreign languages, computers, logistics information, management skills, etc. To produce better logisticians in Korea, the government will have to invest more into their education, especially near the major ports and metropolitan areas. In addition, it is important that universities and companies work together to provide students with internship and other field-experience teaming opportunities. Logistics education centers should be built at the national level. In addition, the existing certification should be divided into two separate certifications: one for ordinary logistics, and one for international logistics. To further improve the certification system, short-answer or essay questions should be added to the second exam, and an additional certification for the highest level logisticians, a so-called "professional logisticians certificate," needs to be introduced.ntroduced.

  • PDF

Alternative Assessment in Mathematics Education (대안적인 평가를 통한 수학교육)

  • 최승현
    • Journal of Educational Research in Mathematics
    • /
    • v.8 no.1
    • /
    • pp.217-235
    • /
    • 1998
  • The purpose of this study is to define the altenative assessment and to suggest the method of scoring system. Alternative assessment includes any type of assessment in which student create reponses to a question rather than choosing a responses form given list( as for multiple choice, true/false, or matching). Alternative assessment can includes short answer questions, essay, performances, oral presentation, demonstrations, exhibitions, portfolios, and etc. To evaluate the each type of assessment, we can apply the method of holistic scoring and analytic scoring system. Also we have to concern the type of scoring mechanism directly relate to what we want to assess, our purpose for assessment fitting into the educational enterprise. Before applying the alternative assessment in our classroom, we need to step back and reconsider all our design features and teachers' responsibility.

  • PDF

The Development of the 7th National Curriculum-based Achievement and Assessment Standards for 1st and 2nd Grades in the Primary School Level (수학과 성취기준과 평가기준 개발 연구 - 초등학교 1, 2학년을 중심으로 -)

  • 황혜정
    • School Mathematics
    • /
    • v.2 no.1
    • /
    • pp.73-95
    • /
    • 2000
  • In this study, on the basis of the seventh national mathematics curriculum, the achievement standards were developed to specify the objectives and contents of teaching-learning at the first and second elementary school mathematics. The assessment standards were also developed to differentiate students’ levels of achievement with ‘high’, ‘mid’ and ‘low’ categories. Furthermore, this stuffy suggested the exemplary test items including short-answer and open-ended questions while putting emphasis on students' real performance to increase their ability in solving problems rather than in calculating. In addition to the test items, it introduced the grading system developed to grade the items with concrete guidelines and to report students' achievement on doing mathematics.

  • PDF

Chatbot Design Method Using Hybrid Word Vector Expression Model Based on Real Telemarketing Data

  • Zhang, Jie;Zhang, Jianing;Ma, Shuhao;Yang, Jie;Gui, Guan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.4
    • /
    • pp.1400-1418
    • /
    • 2020
  • In the development of commercial promotion, chatbot is known as one of significant skill by application of natural language processing (NLP). Conventional design methods are using bag-of-words model (BOW) alone based on Google database and other online corpus. For one thing, in the bag-of-words model, the vectors are Irrelevant to one another. Even though this method is friendly to discrete features, it is not conducive to the machine to understand continuous statements due to the loss of the connection between words in the encoded word vector. For other thing, existing methods are used to test in state-of-the-art online corpus but it is hard to apply in real applications such as telemarketing data. In this paper, we propose an improved chatbot design way using hybrid bag-of-words model and skip-gram model based on the real telemarketing data. Specifically, we first collect the real data in the telemarketing field and perform data cleaning and data classification on the constructed corpus. Second, the word representation is adopted hybrid bag-of-words model and skip-gram model. The skip-gram model maps synonyms in the vicinity of vector space. The correlation between words is expressed, so the amount of information contained in the word vector is increased, making up for the shortcomings caused by using bag-of-words model alone. Third, we use the term frequency-inverse document frequency (TF-IDF) weighting method to improve the weight of key words, then output the final word expression. At last, the answer is produced using hybrid retrieval model and generate model. The retrieval model can accurately answer questions in the field. The generate model can supplement the question of answering the open domain, in which the answer to the final reply is completed by long-short term memory (LSTM) training and prediction. Experimental results show which the hybrid word vector expression model can improve the accuracy of the response and the whole system can communicate with humans.

Question Analysis and Expansion based on Semantics (의미 기반의 질의 분석 및 확장)

  • Shin, Seung-Eun;Park, Hee-Guen;Seo, Young-Hoon
    • The Journal of the Korea Contents Association
    • /
    • v.7 no.7
    • /
    • pp.50-59
    • /
    • 2007
  • This paper describes a question analysis and expansion based on semantics for on efficient information retrieval. Results of all information retrieval systems include many non-relevant documents because the index cannot naturally reflect the contents of documents and because queries used in information retrieval systems cannot represent enough information in user's question. To solve this problem, we analyze user's question semantically, determine the answer type, and extract semantic features. And then we expand user's question using them and syntactic structures which are used to represent the answer. Our similarity is to rank documents which include expanded queries in high position. Especially, we found that an efficient document retrieval is possible by a question analysis and expansion based on semantics on natural language questions which are comparatively short but fully expressing the information demand of users.

Empirical Analysis on the Relationship between R&D Inputs and Performance Using Successive Binary Logistic Regression Models (연속적 이항 로지스틱 회귀모형을 이용한 R&D 투입 및 성과 관계에 대한 실증분석)

  • Park, Sungmin
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.40 no.3
    • /
    • pp.342-357
    • /
    • 2014
  • The present study analyzes the relationship between research and development (R&D) inputs and performance of a national technology innovation R&D program using successive binary Logistic regression models based on a typical R&D logic model. In particular, this study focuses on to answer the following three main questions; (1) "To what extent, do the R&D inputs have an effect on the performance creation?"; (2) "Is an obvious relationship verified between the immediate predecessor and its successor performance?"; and (3) "Is there a difference in the performance creation between R&D government subsidy recipient types and between R&D collaboration types?" Methodologically, binary Logistic regression models are established successively considering the "Success-Failure" binary data characteristic regarding the performance creation. An empirical analysis is presented analyzing the sample n = 2,178 R&D projects completed. This study's major findings are as follows. First, the R&D inputs have a statistically significant relationship only with the short-term, technical output, "Patent Registration." Second, strong dependencies are identified between the immediate predecessor and its successor performance. Third, the success probability of the performance creation is statistically significantly different between the R&D types aforementioned. Specifically, compared with "Large Company", "Small and Medium-Sized Enterprise (SMS)" shows a greater success probability of "Sales" and "New Employment." Meanwhile, "R&D Collaboration" achieves a larger success probability of "Patent Registration" and "Sales."

Neuro-cognitive Ramifications of Fasting and Feeding in Obese and Non-obese Cases

  • Mostafavi, Seyed-Ali;Khaleghi, Ali;Vand, Safa Rafiei;Alavi, Seyyed Salman;Mohammadi, Mohammad Reza
    • Clinical Psychopharmacology and Neuroscience
    • /
    • v.16 no.4
    • /
    • pp.481-488
    • /
    • 2018
  • Preliminary studies have claimed that short term fasting would negatively affect school performance and cognition. In contrast some other studies have reported not important decline in cognition and executive function as a result of fasting. Also limited attention was generally devoted to dietetic regimens, nutritional status and body weight. Yet neuroscience and neuro-cognitive aspects of acute hunger on the electroencephalogram and differences between obese and non-obese cases is not well understood. Hence, we decided to design and perform a case study in a more controlled situation similar to reality. Therefore, we performed several examinations including subjective tests (for eating status) and objective tests (cognitive tests such as Stroop effect and Sternberg search and electroencephalogram measures such as steady-state visual evoked potential and auditory steady-state responses) for an obese and a non-obese academic case before and after a simple breakfast. The results showed that the breakfast effects on the neuro-cognitive functions depend on either obesity status, nutritional status of the case or the type of cognitive task (visual or auditory). This paper would open a new insight to answer some important questions about the neuro-cognitive implications of fasting and feeding in obese and non-obese human cases.

Analysis of Summative Evaluation Objectives in Middle school Science Examination by Klopfer's Taxonomy of Educational Objectives (중학교 과학과 총괄 지필평가 문항의 목표 분석)

  • Park, HyunJu
    • Journal of Science Education
    • /
    • v.36 no.2
    • /
    • pp.293-302
    • /
    • 2012
  • The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.

  • PDF