• Title/Summary/Keyword: evaluation measures

Search Result 2,034, Processing Time 0.033 seconds

A Study on the Measures for Managing the Quality of Curriculum of Early Childhood Education Department in College with the Application of CIPP Model Based on PDCA (PDCA기반 CIPP 모형을 적용한 전문대학 유아교육과 교육과정 질 관리 방안 연구)

  • Kim, Ok-Ju
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.1
    • /
    • pp.215-226
    • /
    • 2019
  • The objective of this study is to draw implications and also to design an evaluation model suitable for vocational education in college based on the literary consideration of the quality management of curriculum and the case analysis on the quality management of curriculum of early childhood education department in college, and then to seek for the measures for the systematic quality management of curriculum of early childhood education department applying the evaluation model. To the core of this study, as the evaluation measures for systematically approaching the quality management of curriculum in the aspect of department, this study presented a curriculum quality management model for early childhood education department of college which was mixed with CIPP model as a program evaluation model that has been a lot used for the evaluation of domestic/foreign curriculums in the evaluation(C) stage of PDCA with the use of PDCA procedure as a school administrative process, and then suggested the roles and quality culture of members. The results of this study could be used as the basic data for the quality management of curriculum of early childhood education department in college, desired by diverse institutions and projects for the institutional support in the future.

A Survey of Repetitiveness Assessment Methodologies for Hand-Intensive Tasks (수작업의 반복성 평가 방법 조사)

  • Gwon, O-Chae;Yu, Hui-Cheon
    • Journal of the Ergonomics Society of Korea
    • /
    • v.22 no.3
    • /
    • pp.75-91
    • /
    • 2003
  • Evaluation of repetitiveness for hand-intensive tasks is essential to determine the level of risk for upper-extremity musculoskeletal disorders at the workplace. Many measures and methods have been introduced for repetitiveness assessment: however, our understanding of the differences among these measures and methods is lacking. The present study compared the repetitiveness measures and measurement/analysis methods to help practitioners apply the proper repetitiveness assessment methodology in the workplace. By reviewing 51 studies of repetitiveness assessment, measures and corresponding measurement/analysis methods were surveyed. Of the repetitiveness measures, two types of dimensions (frequency and time) and corresponding types of analysis scopes were identified. According to the dimensional and analysis-scope types. the repetitiveness measures were categorized and then the surveyed studies were counted for each measure. It is identified that frequency measures have used 2.7 times higher than time measures and the frequency of wrist motions has been most frequently used in repetitiveness assessment. Furthermore, the measurement methods were categorized into objective and subjective methods, and the analysis methods into statistical and spectral methods. Lastly, eight factors (accuracy, reliability. sensitivity. efficiency. ease of use. applicability. interference. and robustness) were listed to be considered in selecting the appropriate assessment methodology.

Empirical Comparison of Word Similarity Measures Based on Co-Occurrence, Context, and a Vector Space Model

  • Kadowaki, Natsuki;Kishida, Kazuaki
    • Journal of Information Science Theory and Practice
    • /
    • v.8 no.2
    • /
    • pp.6-17
    • /
    • 2020
  • Word similarity is often measured to enhance system performance in the information retrieval field and other related areas. This paper reports on an experimental comparison of values for word similarity measures that were computed based on 50 intentionally selected words from a Reuters corpus. There were three targets, including (1) co-occurrence-based similarity measures (for which a co-occurrence frequency is counted as the number of documents or sentences), (2) context-based distributional similarity measures obtained from a latent Dirichlet allocation (LDA), nonnegative matrix factorization (NMF), and Word2Vec algorithm, and (3) similarity measures computed from the tf-idf weights of each word according to a vector space model (VSM). Here, a Pearson correlation coefficient for a pair of VSM-based similarity measures and co-occurrence-based similarity measures according to the number of documents was highest. Group-average agglomerative hierarchical clustering was also applied to similarity matrices computed by individual measures. An evaluation of the cluster sets according to an answer set revealed that VSM- and LDA-based similarity measures performed best.

Evaluation of Information Presentation Methods for a Wearable Braille Display

  • Jung, Ki-Hyo;Lee, Min-Jeong;Chang, Joon-Ho;You, Hee-Cheon
    • Journal of the Ergonomics Society of Korea
    • /
    • v.30 no.6
    • /
    • pp.739-747
    • /
    • 2011
  • Objective: The present study evaluated information presentation methods applicable to a wearable Braille display in terms of performance and satisfaction measures. Background: A Braille display wearable at a finger can improve accessibility of information for the blind by presenting information in real time. Method: A Braille display with six pins operated by DC servomotors was developed to simulate four information presentation methods(active, stationary, simultaneous, and sequential methods). An evaluation experiment was conducted with 16 participants(8 normal and 8 blind participants) by using three objective measures(reaction time, RT, unit: sec; recognition time, CT, unit: sec; correct response percentage, CP) and two subjective measures(overall satisfaction, OS; perception easiness, PE) with a 7-point scale. Results: The average RTs and CTs of the active and stationary methods were significantly shorter than those of the simultaneous and sequential methods for the blind participants. Also, the average CPs, OSs, and PEs of the active and sequential methods were significantly higher than those of the stationary and simultaneous methods. Conclusion: The active and sequential methods were preferred to the other methods for the blind. Application: The performance characteristics identified in the present study for the four braille display methods can be utilized to develop an effective wearable Braille display system.

A Case Study of the Discrepancy between Ex Ante and Ex Post Evaluation of IS Performance (정보화 성과의 사전-사후평가 차이에 관한 사례연구)

  • Lee, Kuk-Hie;Park, So-Hyun;Gu, Bon-Jae;Lee, Mi-Young
    • Journal of Information Technology Applications and Management
    • /
    • v.19 no.2
    • /
    • pp.59-78
    • /
    • 2012
  • The purpose of this longitudinal case study is to shed light on the reliability problems of IS performance evaluation by analyzing the discrepancy between ex ante evaluation in 2011 and ex post evaluation in 2012. Through an information system development project of a public enterprise, the gap between ex ante and ex post evaluation was ascertained and the causes as to why such gap occurs and the success factors that can solve the problems were derived. The ex ante evaluation of IS performance was performed based on both IS success model and BSC model and the ex post evaluation was carried out at the time after the target system has been built up by applying the evaluation measures and process that are similar to the ex ante evaluation. In the ex ante evaluation the business performance improved by the target system was estimated to 18.2%. On the other hand, it was seen as being low at 15.2% in the ex post evaluation and the differences were found to be statistically significant in 6 out of 10 measures. The reasons as to why such gap occurs were diagnosed as being of 2 types : (1) changes in the evaluation psychology according to the differences in the evaluation objectives; and (2) excessive expectation levels of the target system that is formed at the time of the ex ante evaluation. In other words, the users who have excessive expectations tend to overestimate in the ex ante evaluation and, in the ex post evaluation, tend to underestimate lower than the actual performance mainly due to disappointment on the results that do not meet the early expectations. As solutions to overcome the reliability problem of ex ante evaluation, 3 factors were derived : (1) the temperance of excessive expectation levels of the users; (2) a clear definition of the scope and functionality of the target system; and (3) actual commitments for the evaluations of IT performance.

Development of Evaluation Technique of Mobility and Navigation Performance for Personal Robots (퍼스널 로봇을 위한 운동과 이동 성능평가 기술의 개발)

  • Ahn Chang-hyun;Kim Jin-Oh;Yi Keon Young;Lee Ho Gil;Kim Kyu-ro
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.2
    • /
    • pp.85-92
    • /
    • 2003
  • In this paper, we propose a method to evaluate performances of mobile personal robots. A set of performance measures is proposed and the corresponding evaluation methods are developed. Different from industrial manipulators, personal robots need to be evaluated with its mobility, navigation, task and intelligent performance in environments where human beings exist. The proposed performance measures are composed of measures for mobility including vibration, repeatability, path accuracy and so on, as well as measures for navigation performance including wall following, overcoming doorsill, obstacle avoidance and localization. But task and intelligent behavior performances such as cleaning capability and high-level decision-making are not considered in this paper. To measure the proposed performances through a series of tests, we designed a test environment and developed measurement systems including a 3D Laser tracking system, a vision monitoring system and a vibration measurement system. We measured the proposed performances with a mobile robot to show the result as an example. The developed systems, which are installed at Korea Agency for Technology and Standards, are going to be used for many robot companies in Korea.

Evaluation Standard for Performance of Artificial Intelligence Systems: ISO/IEC TR 24029-1 (인공지능 시스템의 성능 평가 표준: ISO/IEC TR 24029-1)

  • Seongsoo Lee
    • Journal of IKEEE
    • /
    • v.27 no.3
    • /
    • pp.350-354
    • /
    • 2023
  • This paper describes ISO/IEC TR 24029-1, an international standard to evaluate the performance of artificial intelligence systems. ISO/IEC TR 24029-1 defines the performance measures of artificial intelligence systems in two categories, i.e. interpolation and classificiation. Performance measures in the interpolation categories mean how much the predicted values of the artificial intelligence system is close to the real values. Performance measures in the classification categories mean how much the predicted classes of the artificial intelligence system is equal to the real classes. Based on these performance measures, performance of artificial intelligence systems can be evaluated and performance of different artificial intelligence systems can be compared.

Analysis of Ship Handlers' Maneuvers with respect to Ship's Speed under Strong Cross Current in the Breakwater Channel of Busan Port (부산항 방파제 진입항로의 강한 횡조류 환경에서 선속에 따른 조종자의 선박조종의 결과 검토)

  • Lee, Dong-Sup;Jeong, Tae-Gweon
    • Journal of Navigation and Port Research
    • /
    • v.32 no.8
    • /
    • pp.577-582
    • /
    • 2008
  • In order to ascertain the effect of ship's speeds, in maneuver under the condition of strong cross current in the breakwater channel of Busan port, this paper is to deal with the analyses of vessel proximity measures, vessel controllability measures, and ship handlers' subjective evaluation measures of simulated maneuvers, which were carried out by 76 ship handlers who conned Panamax bulk carrier of 60,000 DWT, The set and drift of current are southwesterly and 2 knots. The speeds of the model ship are 5 knots & 10 knots respectively. The followings are concluded. ${(1)}$ In the approaches of the breakwater of Busan port, ship handlers psychologically tend not to give the drift angle of more than $10^{\circ}$ bemuse ship's head points out of the entrance. ${(2)}$ Ship handlers' subjective evaluation, vessel proximity and controllability measures are relatively larger under the speed of 5 knots than under that of 10 knots. due to direct pressure of strong current. ${(3)}$ A single index of controllability measures was suggested, by removing their units.

A Study on the Priority and Evaluation Criteria of Domestic Support Measures according to FTA (FTA 체결에 따른 국내지원대책의 평가기준 및 우선순위 선정)

  • Son, Yong-Jung
    • International Commerce and Information Review
    • /
    • v.14 no.1
    • /
    • pp.301-314
    • /
    • 2012
  • To improve support for damages due to FTA and competitive power to overcome it, direct damages to farming and fisheries are compensated through Direct Payment Policy and Business Cessation Support System. Support plans will be developed to enhance competitive power in industries and income base in rural areas. This study carried an AHP to decide Priority and Evaluation Criteria in respect to domestic support measures according to FTA. For the AHP, the classes were categorized into direct damage conservation, higher competitive power and expansion of income. For the direct damage preservation measures, the classes were categorized into farmers, fishermen, manufactures, service business managers, and workers. In respect to reinforcement of competitive power of each industry, the classes were categorized into farming, fisheries, manufacturing, the drug industry, and service business. In respect to expansion of income, the classes were categorized into farming and fishing. Then 27 national support measures were presented for sub-classes. As a result of the analysis, it was discovered that more weight was given to measures to reinforce competitive power of each industry and expand income than those on direct damage conservation. In respect to higher competitive power in industries, more weight was given to support for farming and manufacturing. In respect to expansion of income, more weight was given on measures on farming than fisheries. For the direct damage preservation measures, more weight was given on support measures on farmers and workers.

  • PDF

Balanced Scorecard Perspective Analysis of Institutional Performance Evaluation for Government S&T Research Institutes (과학기술계 출연연구기관 기관평가지표의 BSC 관점 분석)

  • Nam Yeong-Ho;Kim Byeong-Tae
    • Journal of Technology Innovation
    • /
    • v.13 no.1
    • /
    • pp.265-293
    • /
    • 2005
  • This research examines the relationship between the characteristics of Government S&T Research Institutes (GRI) and their institutional performance evaluation system. First, based on Kaplan & Norton (1992) Balanced Scorecard Model, six perspectives suitable to Korean GRI are derived. Second, personnel who works on evaluation job classified current performance measures into the six perspectives. Analyzing comparative weights of individual perspectives, the characteristics of performance evaluation systems among institutes are derived and compared with their missions. The results are as follows: First, GRI evaluation systems put most weight on the customer perspective and least weight on the financial perspective. This result complies with Korean GRI's missions and strategies as well as findings of foreign cases. Second, Basic-technology GRI group relatively more priotizes long-term customer perspective, while Applied-technology GRI Group relatively more priotizes short-term customer perspective. Public-technology GRI Group is located in the middle in terms of priority of customer perspectives. Third, for three yews (2000-2002), performance measure weights of Basic-technology Group are changed much less than those of the other two groups. Further research are needed for reasons of drastic changes for Applied-technology and Public-technology groups and some abnormally high and low measure weights.

  • PDF