• Title/Summary/Keyword: Automatic Assessment

Search Result 341, Processing Time 0.026 seconds

Automatic Scoring System for Korean Short Answers by Student Answer Analysis and Answer Template Construction (학생 답안 분석과 정답 템플릿 생성에 의한 한국어 서답형 문항의 자동채점 시스템)

  • Kang, SeungShik;Jang, EunSeo
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.5
    • /
    • pp.218-224
    • /
    • 2016
  • This paper proposes a computer-based practical automatic scoring system for Korean short answers through student answer analysis and natural language processing techniques. The proposed system reduces the overall scoring time and budget, while improving the ease-of-use to write answer templates from student answers as well as the accuracy and reliability of automatic scoring system. To evaluate the application of the automatic scoring system and compare to the human scoring process, we performed an experiment using the student answers of social science subject in 2014 National Assessment of Educational Achievement.

Speech Rhythm Metrics for Automatic Scoring of English Speech by Korean EFL Learners

  • Jang, Tae-Yeoub
    • MALSORI
    • /
    • no.66
    • /
    • pp.41-59
    • /
    • 2008
  • Knowledge in linguistic rhythm of the target language plays a major role in foreign language proficiency. This study attempts to discover valid rhythm features that can be utilized in automatic assessment of non-native English pronunciation. Eight previously proposed and two novel rhythm metrics are investigated with 360 English read speech tokens obtained from 27 Korean learners and 9 native speakers. It is found that some of the speech-rate normalized interval measures and above-word level metrics are effective enough to be further applied for automatic scoring as they are significantly correlated with speakers' proficiency levels. It is also shown that metrics need to be dynamically selected depending upon the structure of target sentences. Results from a preliminary auto-scoring experiment through a Multi Regression analysis suggest that appropriate control of unexpected input utterances is also desirable for better performance.

  • PDF

Development of a Semi-automatic Search Program for Crown Delineation Based on Watershed and Valley Following Algorithms

  • Sim, Woodam;Park, Jeongmook;Lee, Jungsoo
    • Journal of Forest and Environmental Science
    • /
    • v.34 no.2
    • /
    • pp.142-144
    • /
    • 2018
  • This paper discusses the development of semi-automatic search program for crown delineation in stand level. The crown of an individual tree was delineated by applying the Watershed (WS) and Valley Following (VF) algorithms. Unmanned Aerial Vehicle (UAV) images were used in the semi-automatic search program to delineate the crown area. The overall accuracy and Khat were used in accuracy assessment. WS algorithm's model showed the overall accuracy and Khat index of 0.80 and 0.59, respectively, in Plot 1. However, the overall accuracy and Khat of VF algorithm's model were 0.78 and 0.51, respectively, in Plot 2.

Machine Scoring Methods Highly-correlated with Human Ratings in Speech Recognizer Detecting Mispronunciation of Foreign Language (한국인의 외국어 발화오류검출 음성인식기에서 청취판단과 상관관계가 높은 기계 스코어링 기법)

  • Bae, Min-Young;Kwon, Chul-Hong
    • Speech Sciences
    • /
    • v.11 no.2
    • /
    • pp.217-226
    • /
    • 2004
  • An automatic pronunciation correction system provides users with correction guidelines for each pronunciation error. For this purpose, we develop a speech recognition system which automatically classifies pronunciation errors when Koreans speak a foreign language. In this paper, we propose a machine scoring method for automatic assessment of pronunciation quality by the speech recognizer. Scores obtained from an expert human listener are used as the reference to evaluate the different machine scores and to provide targets when training some of algorithms. We use a log-likelihood score and a normalized log-likelihood score as machine scoring methods. Experimental results show that the normalized log-likelihood score had higher correlation with human scores than that obtained using the log-likelihood score.

  • PDF

Development of the Assessment Model for Accessibility of a Frame Content (프레임 콘텐츠 접근성 평가 모형 개발)

  • Park, Seong-Je;Kim, Jong-Weon
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.17 no.7
    • /
    • pp.199-208
    • /
    • 2012
  • Due to increase of interest in web accessibility and recognition of its necessity, a variety of accessibility indicators and automatic assessment tools have been developed, but previous literature indicated various problems about these indicators and tools. Thus, this research proposes and verifies the assessment model for accessibility of a frame content by considering web standards which develop the same web page for every client environment.

Performance Assessment of a LIDAR Data Segmentation Method based on Simulation (시뮬레이션을 이용한 라이다 데이터 분할 기법의 성능 평가)

  • Kim, Seong-Joon;Lee, Im-Pyeong
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2010.04a
    • /
    • pp.231-233
    • /
    • 2010
  • Many algorithms for processing LIDAR data are being developed for diverse applications not limited to patch segmentation, bare-earth filtering and building extraction. However, since we cannot exactly know the true locations of LIDAR points, it is difficult to assess the performance of a LIDAR data processing algorithm. In this paper, we thus attempted the performance assessment of the segmentation algorithm developed by Lee (2006) using the LIDAR data generated through simulation based on sensor modelling. Consequently, based on simulation, we can perform the performance assessment of a LIDAR processing algorithm more objectively and quantitatively with an automatic procedure.

  • PDF

A Machine Learning Approach to Detect the Dog's Behavior using Wearable Sensors

  • Aich, Satyabrata;Chakraborty, Sabyasachi;Joo, Moon-il;Sim, Jong Seong;Kim, Hee-Cheol
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2019.05a
    • /
    • pp.281-282
    • /
    • 2019
  • In recent years welfare of animals is the biggest challenge because animals, especially dogs are widely recognized as pet as well as they are using as service animals. So, for the wellbeing of the dog it is necessary to perform objective assessment to track their behavior in everyday life. In this paper, we have proposed an automatic behavior assessment system for dogs based on a neck worn and tail worn accelerometer and gyroscope platform, and data analysis techniques that recognize typical dog activities. We evaluate the system based on the analysis of 8 behavior traits in 3 dogs, incorporating 2 breeds of various sizes. Our proposed framework able to reproduce the manual assessment that is based on the video recording which is treated as gold standard that exhibits the real-life use case of automated dog behavior analysis.

  • PDF

A Study on Development of Maritime Traffic Assessment Model (해상교통류 평가모델 개발에 관한 연구)

  • Kim, Kwang-Il;Jeong, Jung Sik;Park, Gyei-Kark
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.22 no.6
    • /
    • pp.761-767
    • /
    • 2012
  • Maritime traffic assessment is important to understand the characteristics of maritime traffic and to prevent maritime accidents. The maritime traffic assessment can be calculated from the ship trajectory data observed by using AIS(Automatic Identification System). This paper developes a maritime traffic assessment tool using ship's position and speed, course, time data from ships navigating waterways. The results are represented in terms of the number of traffic quantity and traffic distribution, speed distribution, geometric collision candidates. The developed tool will contributes to advance maritime traffic safety by VTS(Vessel Traffic Services).

Development and Field Assessment of DO Control System in an Aeration Tank for Automation of Sewage Treatment Plant

  • Jung, In-Chul;Kim, Dae-Yong;Junq, Byung-Gil
    • Journal of Environmental Science International
    • /
    • v.18 no.6
    • /
    • pp.603-608
    • /
    • 2009
  • Activated sludge sewage treatment processes are difficult to be controlled because of their complex and nonlinear behaviour, however, the control of the dissolved oxygen level in the reactors plays an important role in the operation of the facility. For this reason, this study is designed to present a system which accurately measures DO, MLSS, pH and ORP in the aeration tank to alleviate situations above and provide the automatization of a sewage treatment plant (STP) using new DO control system. The automatic control systems must be guaranteed the accuracy. Therefore, the proposed automatic DO control system in this study could be commercial applications in the aeration tanks by means of operating cost analysis and user-friendly for operation and maintenance. We could get accurate data from the lab tank which has water quality checker because there was no vortex and air bubble during the measurement process. Improvement of confidence in the lab tank enabled effective and automatic operation of sewage treatment plants so that operation costs and manpower could be saved. If this result is put in place in every sewage treatment plant nationwide for practical purposes, it is estimated to cost 18.5 million dollars in installing the lab tank and to save 9.8 million dollars in management cost a year, except for cost saved by automation.

Quality Assessment of Domestic Non-automatic Weighing Instruments for International Standards (국제표준에 대비한 국내 비자동저울의 품질평가에 관한 연구)

  • Namkoong Chai-Kwan;Kong Jae Hyang
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.13 no.6
    • /
    • pp.127-134
    • /
    • 2004
  • As the result of reduction of the barrier of national economy on matters of quality assurance of weighing instruments in recently, it is considering in domestic as well as international matters. Therefore, this study is to analysis and compare with international md national measuring standards on the electric self-indicating scale, to improve the quality of electronic machine by providing a reformation plan on currently problems of domestic manufactured, and to identify to introduce in domestic criteria from international standards. I had compared KSC 1313 to OIML R 76-1 as the performance assessment items, such as metrology Properties test, static temperature test, temperature effect testing under the un-load, electronic wave disturbance test, high-tempereature and high-humidity stability test and durability test. Therefore, only one company is passed all items of the test according to the international (reference) standards, but it is possible to improve the quality in general if it should be use the load cell and electric components which is stability of temperature change in order to supplementation to the static temperature test and temperature effect testing under the un-load. It is also possible to apply in the domestic with the OIML 76-1 after correcting the design.