• Title/Summary/Keyword: automatic evaluation

Search Result 1,006, Processing Time 0.028 seconds

The Fault Tolerant Evaluation Model due to the Periodic Automatic Fault Detection Function of the Safety-critical I&C Systems in the Nuclear Power Plants (원전 안전필수 계측제어시스템의 주기적 자동고장검출기능에 따른 고장허용 평가모델)

  • Hur, Seop;Kim, Dong-Hoon;Choi, Jong-Gyun;Kim, Chang-Hwoi;Lee, Dong-Young
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.7
    • /
    • pp.994-1002
    • /
    • 2013
  • This study suggests a generalized availability and safety evaluation model to evaluate the influences to the system's fault tolerant capabilities depending on automatic fault detection function such as the automatic periodic testings. The conventional evaluation model of automatic fault detection function deals only with the self diagnostics, and supposes that the fault detection coverage of self diagnostics is always constant. But all of the fault detection methods could be degraded. For example, the periodic surveillance test has the potential human errors or test equipment errors, the self diagnostics has the potential degradation of built-in logics, and the automatic periodic testing has the potential degradation of automatic test facilities. The suggested evaluation models have incorporated the loss or erroneous behaviors of the automatic fault detection methods. The availability and the safety of each module of the safety grade platform have been evaluated as they were applied the automatic periodic test methodology and the fault tolerant evaluation models. The availability and safety of the safety grade platform were improved when applied the automatic periodic testing. Especially the fault tolerant capability of the processor module with a weak self-diagnostics and the process parameter input modules were dramatically improved compared to the conventional cases. In addition, as a result of the safety evaluation of the digital reactor protection system, the system safety of the digital parts was improved about 4 times compared to the conventional cases.

Summarization and Evaluation; Where are we today?!

  • Shamsfard, Mehrnoush;Saffarian, Amir;Ghodratnama, Samaneh
    • Proceedings of the Korean Society for Language and Information Conference
    • /
    • 2007.11a
    • /
    • pp.422-429
    • /
    • 2007
  • The rapid growth of the online information services causes the problem of information explosion. Automatic text summarization techniques are essential for dealing with this problem. There are different approaches to text summarization and different systems have used one or a combination of them. Considering the wide variety of summarization techniques there should be an evaluation mechanism to assess the process of summarization. The evaluation of automatic summarization is important and challenging, since in general it is difficult to agree on an ideal summary of a text. Currently evaluating summaries is a laborious task that could not be done simply by human so automatic evaluation techniques are appearing to help this matter. In this paper, we will take a look at summarization approaches and examine summarizers' general architecture. The importance of evaluation methods is discussed and the need to find better automatic systems to evaluate summaries is studied.

  • PDF

An automatic pronunciation evaluation system using non-native teacher's speech model (비원어민 교수자 음성모델을 이용한 자동발음평가 시스템)

  • Park, Hye-bin;Kim, Dong Heon;Joung, Jinoo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.16 no.2
    • /
    • pp.131-136
    • /
    • 2016
  • An appropriate evaluation on learner's pronunciation has been an important part of foreign language education. The learners should be evaluated and receive proper feedback for pronunciation improvement. Due to the cost and consistency problem of human evaluation, automatic pronunciation evaluation system has been studied. The most of the current automatic evaluation systems utilizes underlying Automatic Speech Recognition (ASR) technology. We suggest in this work to evaluate learner's pronunciation accuracy and fluency in word-level using the ASR and non-native teacher's speech model. Through the performance evaluation on our system, we confirm the overall evaluation result of pronunciation accuracy and fluency actually represents the learner's English skill level quite accurately.

Implementation and Evaluation of Automatic Assembly System from Manual Assembly Process of Small-sized Motor (소형 모터의 수 조립 공정의 자동 조립 시스템 구축 및 평가 체계)

  • Mok, Hak-Soo;Cho, Jong-Rae;Kim, Myoung-Lyoul
    • IE interfaces
    • /
    • v.12 no.1
    • /
    • pp.32-42
    • /
    • 1999
  • This paper proposes and implementation procedure for an automatic assembly system from a manual assembly and an evaluation method of implemented several automatic system alternatives using an AHP (Analytic Hierarchy Process) in a small-sized motor. First, the current product is redesigned for DFA (Design For Assembly) and assembly automation of motor, and then it is decided mechanisms of moving, magazining, feeding, composing of each part using main joining equipment and auxiliary equipment. Following the decided mechanism, the necessary assembly machines are selected or designed considering objectives and assembly conditions. Finally, the layout alternatives are completed for the automatic assembly system. According to the evaluation criteria which are established in advance, the automatic system alternatives are analyzed using AHP.

  • PDF

A study on design of assembly and evaluation system for optical micro film filter (필름형 마이크로 광필터 조립 평가 시스템 설계에 관한 연구)

  • 최두선;제태진;황경현;박한수
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2003.06a
    • /
    • pp.1191-1194
    • /
    • 2003
  • At present, the fabrication of optical filter for optical communication mostly depends on handwork, and only a few companies are propelling semi-automatic systems compounded with automatic and hand-operated methods. The measurement evaluation of optical filters is not commonly useful, so it causes difficulties in the producing field. And the packaging process becomes a very unstable process because the filters are judged from the results that they are not measured and immediately packaged during that process. In this situation, the automatic assembly system of optical filter for communication is extremely important and has begun to make its appearance as the most necessary technology for developing optical communication component with high-functionality. In this paper, we constructed systems of assembly and performance evaluation for micro optical collimator. And by using that, we designed a system capable of performance evaluation and assembly of film filter of about 30 $\mu\textrm{m}$ thickness as well as optical filter for common communication.

  • PDF

AI-based language tutoring systems with end-to-end automatic speech recognition and proficiency evaluation

  • Byung Ok Kang;Hyung-Bae Jeon;Yun Kyung Lee
    • ETRI Journal
    • /
    • v.46 no.1
    • /
    • pp.48-58
    • /
    • 2024
  • This paper presents the development of language tutoring systems for nonnative speakers by leveraging advanced end-to-end automatic speech recognition (ASR) and proficiency evaluation. Given the frequent errors in non-native speech, high-performance spontaneous speech recognition must be applied. Our systems accurately evaluate pronunciation and speaking fluency and provide feedback on errors by relying on precise transcriptions. End-to-end ASR is implemented and enhanced by using diverse non-native speaker speech data for model training. For performance enhancement, we combine semisupervised and transfer learning techniques using labeled and unlabeled speech data. Automatic proficiency evaluation is performed by a model trained to maximize the statistical correlation between the fluency score manually determined by a human expert and a calculated fluency score. We developed an English tutoring system for Korean elementary students called EBS AI Peng-Talk and a Korean tutoring system for foreigners called KSI Korean AI Tutor. Both systems were deployed by South Korean government agencies.

A Study on the Evaluation of Brinell Standard Hardness Tester and Automatic Indentation Measurement System (브리넬 경도 표준 시험기 및 압입 자국 자동 측정장치의 특성 평가에 대한 연구)

  • Bahng, G.W.;Tak, Nae-Hyung
    • Journal of the Korean Society for Heat Treatment
    • /
    • v.12 no.4
    • /
    • pp.294-302
    • /
    • 1999
  • Evaluation of Brinell standard hardness tester was carried out to secure its application as a national standard for Brinell hardness. Accuracies and reliabilities in load application, indenter diameter and indentation measurement were tested through evaluation of these components. The accuracies of load application for various loading conditions were within the limit of ISO and KS specifications. Errors in the indentation measurement due to the difference in personnel characters were successfully removed by utilising automatic indentation measurement system. In overall, the tester and the indentation measuring system were found to be eligible as a national standard of Brinell hardness.

  • PDF

Measurement technology of performance evaluation of optical collimator with high-functionality (고기능 광콜리메이터 성능평가 측정 기술)

  • Choi, D.S.;Je, T.J.;Hwang, K.H.;Kang, Y.H.
    • Proceedings of the KSME Conference
    • /
    • 2003.04a
    • /
    • pp.1355-1360
    • /
    • 2003
  • Currently, product of optical collimator for optical communication is depending on handiwork, and some companies are propelling semi-automatic system composite of manual and automatic operations. In this point of time, the importance of automatic system of optical collimator for optical communication is taking its place as a core technology in the development of parts with high-efficiency of optical communication. In order to develop such an optical collimator in this study, we designed an automatic assembly system, and developed a software for the system operation. At a result of that, we could carry out a single work process individually running processes of collimator fabrication, a constant work process constantly running all of the processes, and performance evaluation of the collimator.

  • PDF

Dialog-based multi-item recommendation using automatic evaluation

  • Euisok Chung;Hyun Woo Kim;Byunghyun Yoo;Ran Han;Jeongmin Yang;Hwa Jeon Song
    • ETRI Journal
    • /
    • v.46 no.2
    • /
    • pp.277-289
    • /
    • 2024
  • In this paper, we describe a neural network-based application that recommends multiple items using dialog context input and simultaneously outputs a response sentence. Further, we describe a multi-item recommendation by specifying it as a set of clothing recommendations. For this, a multimodal fusion approach that can process both cloth-related text and images is required. We also examine achieving the requirements of downstream models using a pretrained language model. Moreover, we propose a gate-based multimodal fusion and multiprompt learning based on a pretrained language model. Specifically, we propose an automatic evaluation technique to solve the one-to-many mapping problem of multi-item recommendations. A fashion-domain multimodal dataset based on Koreans is constructed and tested. Various experimental environment settings are verified using an automatic evaluation method. The results show that our proposed method can be used to obtain confidence scores for multi-item recommendation results, which is different from traditional accuracy evaluation.

Automatic Feeding Bottle Washing Machine Usability Evaluation : Infant Product (자동 젖병 세척기 사용성평가 : 영유아 제품)

  • Park, Hye Jin;Kim, Jong Geun;Lee, Seok Jae
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.3
    • /
    • pp.507-514
    • /
    • 2022
  • This study is to compare and analyze the evaluation of cleaning cleanliness and usability according to the muscle activity and cleaning method in the wrist rotation motion when using a bottle washer for women with childbirth experience. To this end, when using an automatic bottle washer and a manual bottle washer, the muscle activity and cleaning cleanliness of the forearm muscles were quantitatively evaluated using equipment, and the effects of variables were analyzed and the following conclusions were obtained. First, it was found that the muscle activity was lower than that of the automatic baby bottle cleaner when using a manual bottle cleaner. Second, the cleanliness was judged to be the best in automatic washing (forward + reverse direction), followed by automatic washing (forward direction) and manual washing. Third, the usability evaluation of the use of the baby bottle washing machine showed higher satisfaction than that of the automatic baby bottle washing machine. Through these conclusions, this study can be used as basic data for product advancement in the future by proving the effectiveness of using an automatic bottle washer.