• The KIPS Transactions:PartA
• /
• v.17A no.6
• /
• pp.289-296
• /
• 2010

So far, previous works with respect to evaluating program contents have concentrated on the implementation of general educational content evaluation. In terms of the efforts required to solve problems, however, there are a few evaluation methods on educational programming language contents. Therefore, we propose new evaluation criteria for educational programming language contents. The detailed research contents can be summarized as follows. First, we analyze existing works and propose naval evaluation criteria for educational programming language contents. Second, the new evaluation criteria is verified by teachers who use Visual Basic educational contents via questionaries. Also, a program content is experimented via the evaluation criteria. Finally, it is expected that our proposed evaluation criteria for educational programming language contents can be used to evaluate newly developed educational programming language contents and to design its evaluation plans.

• The Journal of the Korea Contents Association
• /
• v.16 no.12
• /
• pp.43-49
• /
• 2016

As user-centered design and content development emerge, the research and the establishment of items on usability evaluation are becoming more important. However, research on usability evaluation for digital systems in specific areas of mobile applications is still incomplete. Due to the recent development of wearable devices and smartphones, development and usage of quantified-self and life-logging applications has been rapidly increasing. This study aims to establish evaluation items and the main factors for the usability assessment of the applications that support life-logging services. In order to establish evaluation factors for life-logging application usability, we first gathered existing usability assessment items and selected the initial items through the Focus Group Interview(FGI). Second, we conducted user assessment surveys on the selected initial questionnaires and performed reliability and exploratory factor analyses based on the survey results. Third, through the statistical analyses results, we established 28 usability assessment items and four factors: recognition; functionality; aesthetics; and satisfaction. Finally, we discussed the expectations and limitations of the established usability assessment. The results from this paper could be used as a guideline for the usability assessment of life-logging applications and thus will contribute to effective content development.

• 대학교육
• /
• s.82
• /
• pp.66-74
• /
• 1996

연구.교육.사회활동이라는 삼분법적 교수업적 평가제는 특정 분야의 천재성이 인정되지 않는 평범한 대학상과 상식적인 교수상만 만들어낸다. -무의미한 논문, 저술의 양산에 질린 우리가 예.체능계 교수들의 업적평가를 일반계의 틀에 맞춘다는 것 자체가 뒤떨어진 발상이다. 예술가는 예술작품으로 평가받아야 한다. 그러기 위하여 창작평가위원회가 따로 설치되어야 한다.

• Proceedings of the KAIS Fall Conference
• /
• 2007.11a
• /
• pp.57-59
• /
• 2007

정보보호시스템 평가수요의 예측은 예측된 평가수요를 근거로 적극적인 평가서비스를 제공하기 위하여 필요하다. 평가수요예측을 하기위하여 일반적으로 설문조사를 이용하지만 무응답 및 불성실한 응답으로 인하여 설문응답 자료만으로 평가수요를 예측하기에는 부족하다. 따라서 설문조사의 평가수요를 보정할 수 있는 모형이 필요하다. 본 논문에서는 설문조사를 통하여 예측 할 수 있는 직접적인 평가수요와 통계적 모형을 이용한 간접적 평가수요를 비교하고 설문조사의 대체 방법을 제시하였다.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.2
• /
• pp.229-235
• /
• 2021

Blockchain, recognized as one of the core technologies of the 4th industrial revolution, is an Internet-based distributed data management system which does not require centralized control. Blockchain is characterized by the integrity and reliability of information, and blockchains can be used where such characteristics are required. Typical applications of blockchain include finance, transaction, and evaluation management. In this paper, we designed a blockchain-based evaluation management system that allows users to freely create and manage evaluation instances. Evaluation managers can create an evaluation instance according to their purpose and allocate evaluation items and evaluators. When the evaluators finish evaluating the evaluation items, the evaluation manager can aggregate the evaluation results for the instance. Someone, who want to perform evaluation for various purposes but do not have an evaluation system, can implement the evaluation system relatively simply by using this system. In addition, due to the characteristic of the blockchain, evaluators cannot modify the evaluation scores they have already recorded, and neither the system administrator nor the evaluation administrator can modify the evaluation scores. For this reason, the reliability of the evaluation increases.

• Annual Conference on Human and Language Technology
• /
• 2023.10a
• /
• pp.448-453
• /
• 2023

대규모 언어 모델 (Large Language Model, LLM)을 인간의 선호도 관점에서 평가하는 것은 기존의 벤치마크 평가와는 다른 도전적인 과제이다. 이를 위해, 기존 연구들은 강력한 LLM을 평가자로 사용하여 접근하였지만, 높은 비용 문제가 부각되었다. 또한, 평가자로서 LLM이 사용하는 주관적인 점수 기준은 모호하여 평가 결과의 신뢰성을 저해하며, 단일 모델에 의한 평가 결과는 편향될 가능성이 있다. 본 논문에서는 엄격한 기준을 활용하여 편향되지 않은 평가를 수행할 수 있는 평가 프레임워크 및 평가자 모델 'FubaoLM'을 제안한다. 우리의 평가 프레임워크는 심층적인 평가 기준을 통해 다수의 강력한 한국어 LLM을 활용하여 연쇄적 사고(Chain-of-Thought) 기반 평가를 수행한다. 이러한 평가 결과를 다수결로 통합하여 편향되지 않은 평가 결과를 도출하며, 지시 조정 (instruction tuning)을 통해 FubaoLM은 다수의 LLM으로 부터 평가 지식을 증류받는다. 더 나아가 본 논문에서는 전문가 기반 평가 데이터셋을 구축하여 FubaoLM 효과성을 입증한다. 우리의 실험에서 앙상블된 FubaoLM은 GPT-3.5 대비 16% 에서 23% 향상된 절대 평가 성능을 가지며, 이항 평가에서 인간과 유사한 선호도 평가 결과를 도출한다. 이를 통해 FubaoLM은 비교적 적은 비용으로도 높은 신뢰성을 유지하며, 편향되지 않은 평가를 수행할 수 있음을 보인다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.5
• /
• pp.700-705
• /
• 2008

In this paper, a model to evaluate the sustainability management for small and middle enterprises was suggested. Also, the if-then rules and its decision tree for pattern analysis which is obtained by fuzzy ID3 from the data of sustainability management were shown. The suggested model can be used for the evaluation tool of competition increasement of enterprises. If the enterprise can recognize that the evaluation rule can be taken advantage of the sustainability management pattern analysis using fuzzy ID3, it is expected that they can use the rule effectively for self evaluation.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.23 no.4
• /
• pp.92-100
• /
• 2009

This paper presents a voltage sag assessment program. The program provides various functions for stochastic assessment of voltage sags such as short-circuit analysis, the determination of the area of vulnerability and the calculation of expected sag frequency(ESF). Effective data visualization functions based on computer graphics and animation were also implemented in the developed program. In this paper, the concept of voltage sag assessment and the assessment method considering generator scheduling and time-varying fault rates are presented. The influence of generator scheduling and time-varying fault rates on voltage sag prediction is also described by performing case studies using the developed program.

• The Transactions of the Korea Information Processing Society
• /
• v.7 no.11
• /
• pp.3584-3591
• /
• 2000

In this paper we propose measure for performance evaluationof character recognition, We used three commercial character recognizers and one laboratory character recognizer for test. The characteristics of each recognizer is compared by proposed evaluation standrd, and analyzed characteristrics For the input test data, KT test collection are used. KT test collection is composed of 1000 document images about and complete source text. In this paper we propose method for measuring recognition rage in character unit for evaluation of character recogrition, The recogrition rates are compared and analyzed by single feature characteristic or mixed feature characteristic.

• Journal of The Korean Association of Information Education
• /
• v.5 no.2
• /
• pp.258-267
• /
• 2001

In this paper, We have developed the evaluation standards for web coursewares which can properly reflected each class-type teaching and learning theories, type of learning and characteristics of learners. We proved the proper of content, reliability and objectivity. Also, We have designed and developed the evaluation tool which runs on the web. The evaluation tools for the web coursewares developed in this paper presents the direction and standard to develop the web coursewares. Also, it will help learners to choose the web coursewares, because the evaluation results for web courseware notify on the web.