• Title/Summary/Keyword: Automated assessment

Search Result 204, Processing Time 0.027 seconds

FlappyBird Competition System: A Competition-Based Assessment System for AI Course (FlappyBird Competition System: 인공지능 수업의 경쟁 기반 평가 시스템의 구현)

  • Sohn, Eisung;Kim, Jaekyung
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.4
    • /
    • pp.593-600
    • /
    • 2021
  • In this paper, we present the FlappyBird Competition System (FCS) implementation, a competition-based automated assessment system used in an entry-level artificial intelligence (AI) course at a university. The proposed system provides an evaluation method suitable for AI courses while taking advantage of automated assessment methods. Students are to design a neural network structure, train the weights, and tune hyperparameters using the given reinforcement learning code to improve the overall performance of game AI. Students participate using the resulting trained model during the competition, and the system automatically calculates the final score based on the ranking. The user evaluation conducted after the semester ends shows that our competition-based automated assessment system promotes active participation and inspires students to be interested and motivated to learn AI. Using FCS, the instructor significantly reduces the amount of time required for assessment.

A Study on Assessment Items and Considerations for Development of KNCAP of Automated Driving System (자율주행자동차 KNCAP(자동차안전도평가) 도입 시 평가항목과 고려사항에 관한 연구)

  • Woo, Hyungu;Lee, Gwang Goo
    • Journal of Auto-vehicle Safety Association
    • /
    • v.13 no.3
    • /
    • pp.102-110
    • /
    • 2021
  • As an alternative to solving safety, environments, and aging problems, ADS (Automated driving system) in the global automotive market is actively being developed as a new growth industry. In time for the appearance of ADS, relevant regulations and assessment programs must also be developed. For example, safety standards for the Level 3 automated driving system were promulgated in December 2019 by the Ministry of Land, Infrastructure and Transport of Korean government. However, assessment programs such as KNCAP for autonomous functions of ADS have not yet been introduced in Korea as well as globally. The autonomous driving functions of ADS at Level 3 or higher must be capable to recognize, judge and respond to objects and events in a wide variety of complex situations. In this paper, we examined and studied the complex situations, considerations and assessment items that ADS must respond to in the interest of safety for passengers, pedestrians and other road users. We hope this paper will be helpful to develop an execution program in the future.

Digital enhancement of pronunciation assessment: Automated speech recognition and human raters

  • Miran Kim
    • Phonetics and Speech Sciences
    • /
    • v.15 no.2
    • /
    • pp.13-20
    • /
    • 2023
  • This study explores the potential of automated speech recognition (ASR) in assessing English learners' pronunciation. We employed ASR technology, acknowledged for its impartiality and consistent results, to analyze speech audio files, including synthesized speech, both native-like English and Korean-accented English, and speech recordings from a native English speaker. Through this analysis, we establish baseline values for the word error rate (WER). These were then compared with those obtained for human raters in perception experiments that assessed the speech productions of 30 first-year college students before and after taking a pronunciation course. Our sub-group analyses revealed positive training effects for Whisper, an ASR tool, and human raters, and identified distinct human rater strategies in different assessment aspects, such as proficiency, intelligibility, accuracy, and comprehensibility, that were not observed in ASR. Despite such challenges as recognizing accented speech traits, our findings suggest that digital tools such as ASR can streamline the pronunciation assessment process. With ongoing advancements in ASR technology, its potential as not only an assessment aid but also a self-directed learning tool for pronunciation feedback merits further exploration.

Performance assessment model for robot-based automated construction systems

  • Lee, Ung-Kyun;Yoo, Wi Sung;An, Sung-Hoon;Doh, Nakju;Cho, Hunhee;Jun, Changhyun;Kim, Taehoon;Lee, Young Hoon
    • Journal of the Korea Institute of Building Construction
    • /
    • v.13 no.4
    • /
    • pp.416-423
    • /
    • 2013
  • An adjusted assessment model based on benefit-cost analysis (BCA) is proposed for evaluating the economic efficiency of automated construction technologies. In contrast to conventional BCA, the model does not compare monetary values, but the differences in benefits and costs between traditional and automated construction methods. To verify the usefulness of the model, it was applied to a real-scale building construction project that used a fully automated building construction system, and the face validity of the model was confirmed. The results indicate that the model can support decision makers in identifying valuable benefit factors and in assessing the cost effectiveness of the system.

Derivation of Assessment Scenario Elements for Automated Vehicles in the Expressway Mainline Section (자율주행차 평가 시나리오 구성요소 도출: 고속도로 본선구간을 중심으로)

  • Ko, Woori;Yun, Ilsoo;Park, Sangmin;Jeong, Harim;Park, Sungho
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.1
    • /
    • pp.221-239
    • /
    • 2022
  • Various elements such as geometry, traffic safety facilities, congestion level, weather, etc., need to be appropriately reflected in the assessment scenario evaluating the driving safety of automated vehicles. Therefore, this study first established a scenario structure and defined the layer of elements, to derive the elements to be reflected in the automated driving safety evaluation. After that, all elemental candidates that can be reflected in each layer were derived by reviewing the relevant literature. Finally, as a result of an expert survey, 77 items were selected to be reflected in the automated driving safety evaluation. The selected elements are expected to be actively utilized in developing scenarios for the driving safety evaluation of automated vehicles in simulation, proving ground, and real road assessments.

Automated Assessment Of The Air Situation During The Preparation And Conduct Of Combat Operations Using A Decision Support System Based On Fuzzy Networks Of Target Installations

  • Volkov, Andriy;Bazilo, Serhii;Tokar, Oleksandr;Horbachov, Kostiantyn;Lutsyshyn, Andrii;Zaitsev, Ihor;Iasechko, Maksym
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.11
    • /
    • pp.184-188
    • /
    • 2022
  • The article considers the improved method and model of automated air situation assessment using a decision support system based on fuzzy networks of target installations. The advanced method of automated assessment of the air situation using the decision support system is based on the methodology of reflexive control of the first rank. With this approach, the process of assessing the air situation in the framework of the formulated task can be reduced to determining the purpose, probabilistic nature of actions and capabilities of the air target. The use of a homogeneous functional network for the formal presentation of air situation assessment processes will formally describe the process of determining classes of events during air situation assessment and the process of determining quantitative and qualitative characteristics of recognized air situation situations. To formalize the patterns of manifestation of the values of quantitative and symbolic information, it is proposed to use the mathematical apparatus of fuzzy sets.

Efficient and automated method of collapse assessment

  • Qi, Yongsheng;Gu, Qiang;Li, Dong
    • Steel and Composite Structures
    • /
    • v.13 no.6
    • /
    • pp.561-570
    • /
    • 2012
  • Seismic collapse analysis requires efficient and automated method to perform thousands of time history analyses. The paper introduced the advantages of speed and convergence property of explicit method, provided a few techniques to accelerate speed of calculation and developed an automated procedure for collapse assessment, which combines the strong capacity of commercial explicit finite element software and the flexible, intelligent specialties of control program written in FORTRAN language aiming at collapse analysis, so that tedious and heavy work of collapse analysis based on FEMAP695 can be easily implemented and resource of calculation can be made the best use of. All the key commands of control program are provided to help analyzers and engineers to cope with collapse assessment conveniently.

A Study on the Risk Assessment for Urban Railway Systems Using an Adaptive Neuro-Fuzzy Inference System(ANFIS) (적응형 뉴로-퍼지(ANFIS)를 이용한 도시철도 시스템 위험도 평가 연구)

  • Tak, Kil Hun;Koo, Jeong Seo
    • Journal of the Korean Society of Safety
    • /
    • v.37 no.1
    • /
    • pp.78-87
    • /
    • 2022
  • In the risk assessment of urban railway systems, a hazard log is created by identifying hazards from accident and failure data. Then, based on a risk matrix, evaluators analyze the frequency and severity of the occurrence of the hazards, conduct the risk assessment, and then establish safety measures for the risk factors prior to risk control. However, because subjective judgments based on the evaluators' experiences affect the risk assessment results, a more objective and automated risk assessment system must be established. In this study, we propose a risk assessment model in which an adaptive neuro-fuzzy inference system (ANFIS), which is combined in artificial neural networks (ANN) and fuzzy inference system (FIS), is applied to the risk assessment of urban railway systems. The newly proposed model is more objective and automated, alleviating the limitations of risk assessments that use a risk matrix. In addition, the reliability of the model was verified by comparing the risk assessment results and risk control priorities between the newly proposed ANFIS-based risk assessment model and the risk assessment using a risk matrix. Results of the comparison indicate that a high level of accuracy was demonstrated in the risk assessment results of the proposed model, and uncertainty and subjectivity were mitigated in the risk control priority.

A Study for Secure the Reliability of Automated Warehouse System (자동화창고 시스템의 신뢰성 확보를 위한 연구)

  • Lee, Yang-Kyu;Yang, Hae-Sool
    • Journal of Digital Convergence
    • /
    • v.14 no.10
    • /
    • pp.253-259
    • /
    • 2016
  • Recently, not only domestic businesses but also overseas businesses are expanding development and investment in automated warehouses as domestic and foreign logistics environments undergo drastic change. In such an environment, automated warehouse systems are being rapidly changed, and automated warehouse systems equipped with diversified functions are being developed accordingly. But the assessment systems of developed automated warehouse system is at a standstill. In the present article, characteristics of the automated warehouse systems in diversified development and trends of technology were analyzed, based on which evaluation items of functional suitability and reliability were derived by referring to ISO/IEC 25000 as the international quality assessment standard to secure reliability of the automated warehouse system, and an evaluation model was developed through the derived evaluation items. Through the present article, evaluation standards of functional suitability and reliability to enhance quality levels of automated warehouse systems are considered to be secured.

A Methodology of Automated Analysis and Qualitative Assessment of Legislation and Court Decisions

  • Trofimov, Egor;Metsker, Oleg;Kopanitsa, Georgy
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.11
    • /
    • pp.229-235
    • /
    • 2022
  • This study aims to substantiate an interdisciplinary methodology for automated analysis and qualitative assessment of legislation and court decisions. The development of this kind of methodology will make it possible to fill a number of methodological gaps in various research areas, including law effectiveness assessment and legal monitoring. We have defined a methodology based on the interdisciplinary principles and tools. In general, it should be noted that even at the level of qualitative assessment made with the use of the methodology described above, the accumulation of knowledge about the relationship between legal objectives, indicators and computer methods of their identification can reduce the role of expert knowledge and subjective factor in the process of assessment, planning, forecasting and control over the state of legislation and law enforcement. Automation of intellectual processes becomes inevitable in a digital society, but, releasing experts from routine work, simultaneously reorients it to development of interdisciplinary methods and control over their application.