• Title/Summary/Keyword: scoring system of assessment

Search Result 137, Processing Time 0.023 seconds

A Study on the Management Assessment Index of Remote Island Route Passenger Company (낙도보조항로 운영 사업체 경영평가 지표 개발에 관한 연구)

  • Noh Chang-Kyun
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2006.06b
    • /
    • pp.131-136
    • /
    • 2006
  • This study proposes the introduction of management assessment system an the remote island route passenger companies in a way of stimulating the companies to make sustained efforts on management improvement, and come up with the ways of management assessment index and management assessment methods by using the AHP scheme. These indices are organizes in three categories. The main category is consisted of responsible management part, management an control part, business operation part and customer satisfaction part, and the intermediary category has the 15 items including the efforts for responsible management, and the sub category is consisted of 44 items including the management vision of executive and participation of enterprise in responsible management, and others. The scoring of these indices is the result of scoring by calculating the added weight for each category by using the AHP scheme tint it is considered as needed for the scoring adjustment for each standard of assessment index by the adjustment of added weight for categories with the consideration of shipping company operation and shipping characteristics while undertaking the actual affairs.

  • PDF

A Study on the Management Assessment Index of Remote Island Route Passenger Company (낙도보조항로 운영 사업체 경영평가 지표 개발에 관한 연구)

  • Noh, Chang-Kyun
    • Journal of Navigation and Port Research
    • /
    • v.30 no.8 s.114
    • /
    • pp.657-662
    • /
    • 2006
  • This study proposes the introduction of management assessment system on the remote island route passenger companies in a way of stimulating the companies to make sustained efforts on management improvement, and come up with the ways of management assessment index and management assessment methods by using the AHP scheme. These indices are organizes in three categories. The main category is consisted of responsible management part, management an control part, business operation part and customer satisfaction part, and the intermediary category has the 15 items including the efforts for responsible management, and the sub category is consisted of 44 items including the management vision of executive and participation of enterprise in responsible management, and others. The scoring of these indices is the result of scoring by calculating the added weight for each category by using the AHP scheme that it is considered as needed for the scoring adjustment for each standard of assessment index by the adjustment of added weight for categories with the consideration of shipping company operation and shipping characteristics while undertaking the actual affairs.

Automated Scoring System for Korean Short-Answer Questions Using Predictability and Unanimity (기계학습 분류기의 예측확률과 만장일치를 이용한 한국어 서답형 문항 자동채점 시스템)

  • Cheon, Min-Ah;Kim, Chang-Hyun;Kim, Jae-Hoon;Noh, Eun-Hee;Sung, Kyung-Hee;Song, Mi-Young
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.5 no.11
    • /
    • pp.527-534
    • /
    • 2016
  • The emergent information society requires the talent for creative thinking based on problem-solving skills and comprehensive thinking rather than simple memorization. Therefore, the Korean curriculum has also changed into the direction of the creative thinking through increasing short-answer questions that can determine the overall thinking of the students. However, their scoring results are a little bit inconsistency because scoring short-answer questions depends on the subjective scoring of human raters. In order to alleviate this point, an automated scoring system using a machine learning has been used as a scoring tool in overseas. Linguistically, Korean and English is totally different in the structure of the sentences. Thus, the automated scoring system used in English cannot be applied to Korean. In this paper, we introduce an automated scoring system for Korean short-answer questions using predictability and unanimity. We also verify the practicality of the automatic scoring system through the correlation coefficient between the results of the automated scoring system and those of human raters. In the experiment of this paper, the proposed system is evaluated for constructed-response items of Korean language, social studies, and science in the National Assessment of Educational Achievement. The analysis was used Pearson correlation coefficients and Kappa coefficient. Results of the experiment had showed a strong positive correlation with all the correlation coefficients at 0.7 or higher. Thus, the scoring results of the proposed scoring system are similar to those of human raters. Therefore, the automated scoring system should be found to be useful as a scoring tool.

Development of Biosphere Assessment Modeling Strategy for Deep Geological Disposal in Generic Site of the Korean Peninsula

  • Do Hyun Kim;Wontak Lee;Dongki Kim;Jonghyun Kim;Joowan Park
    • Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
    • /
    • v.21 no.1
    • /
    • pp.149-164
    • /
    • 2023
  • As part of the safety case development for generic disposal sites in Korea, it is necessary to develop generic assessment models using various geosphere-biosphere interfaces (GBIs) and potentially exposed groups (PEGs) that reflect the natural environmental characteristics and the lifestyles of people in Korea. In this study, a unique modeling strategy was developed to systematically construct and select Korean generic biosphere assessment models. The strategy includes three process steps (combination, screening, and experts' scoring) for the biosphere system conditions. First, various conditions, such as climate, topography, GBIs, and PEGs, were combined in the biosphere system. Second, the combined calculation cases were configured into interrelation matrices to screen out some calculation cases that were highly unlikely or less significant in terms of the exposure dose. Finally, the selected calculation cases were prioritized based on expert judgment by scoring the knowledge, probability, and importance. The results of this study can be implemented in the development of biosphere assessment models for Korean generic sites. It is believed that this systematic methodology for selecting the candidate calculation cases can contribute to increasing the confidence of future site-specific biosphere assessment models.

Comparison between Subjective Scoring and Computer-Based Asymmetry Assessment in Facial Nerve Palsy

  • Lee, Doh Young;Kim, Hyun Seok;Kim, So Young;Park, Kwang Suk;Kim, Young Ho
    • Journal of Audiology & Otology
    • /
    • v.23 no.1
    • /
    • pp.53-58
    • /
    • 2019
  • Background and Objectives: The aim of the present study was to assess the feasibility of a PC-based facial asymmetry assessment program (PC-FAAP) and to compare the results of PC-FAAP with subjective regional scoring by raters in acute unilateral peripheral facial nerve paralysis (FNP). Subjects and Methods: Participants were divided into 3 groups with 8 participants per group: group I, normal; group II, mild to moderate FNP; and group III, severe FNP. Using the PC-FAAP, the mouth asymmetry ratio (MAR), eyebrow asymmetry ratio (EAR), and complete eye closure asymmetry ratio (CAR) were calculated by comparing the movement of tracking points on both sides. The FNP grading scale (FGS) integrated each score, and the scores were weighted with a ratio of 5:3:2 (MAR:CAR:EAR). Subjective regional scoring was measured on a 0-100 scale score by three otologists. PC-FAAP and subjective scoring were compared in each group regarding the consistency of the results. Results: The mean scores of the MAR, EAR, CAR, and FGS of each group were significantly different. PC-FAAP showed significant differences between the three groups in terms of MAR, EAC, CAR, and FGS. PC-FAAP showed more consistent results than subjective assessment (p<0.001). The PC-FAAP was significantly more consistent in group I and group III (p<0.001 and p=0.002, respectively). FGS in group III was the only parameter that showed a more consistent result in PC-FAAP than the subjective scoring (p=0.008). Conclusions: An FNP grading system using a PC-based program may provide more consistent results, especially for severe forms.

Comparison between Subjective Scoring and Computer-Based Asymmetry Assessment in Facial Nerve Palsy

  • Lee, Doh Young;Kim, Hyun Seok;Kim, So Young;Park, Kwang Suk;Kim, Young Ho
    • Korean Journal of Audiology
    • /
    • v.23 no.1
    • /
    • pp.53-58
    • /
    • 2019
  • Background and Objectives: The aim of the present study was to assess the feasibility of a PC-based facial asymmetry assessment program (PC-FAAP) and to compare the results of PC-FAAP with subjective regional scoring by raters in acute unilateral peripheral facial nerve paralysis (FNP). Subjects and Methods: Participants were divided into 3 groups with 8 participants per group: group I, normal; group II, mild to moderate FNP; and group III, severe FNP. Using the PC-FAAP, the mouth asymmetry ratio (MAR), eyebrow asymmetry ratio (EAR), and complete eye closure asymmetry ratio (CAR) were calculated by comparing the movement of tracking points on both sides. The FNP grading scale (FGS) integrated each score, and the scores were weighted with a ratio of 5:3:2 (MAR:CAR:EAR). Subjective regional scoring was measured on a 0-100 scale score by three otologists. PC-FAAP and subjective scoring were compared in each group regarding the consistency of the results. Results: The mean scores of the MAR, EAR, CAR, and FGS of each group were significantly different. PC-FAAP showed significant differences between the three groups in terms of MAR, EAC, CAR, and FGS. PC-FAAP showed more consistent results than subjective assessment (p<0.001). The PC-FAAP was significantly more consistent in group I and group III (p<0.001 and p=0.002, respectively). FGS in group III was the only parameter that showed a more consistent result in PC-FAAP than the subjective scoring (p=0.008). Conclusions: An FNP grading system using a PC-based program may provide more consistent results, especially for severe forms.

Assessment factors for the Selection of Priority Soil Contaminants based on the Comparative Analysis of Chemical Ranking and Scoring Systems (국내.외 Chemical Ranking and Scoring 체계 비교분석을 통한 우선순위 토양오염물질 선정을 위한 평가인자 도출)

  • An, Youn-Joo;Jeong, Seung-Woo;Kim, Tae-Seung;Lee, Woo-Mi;Nam, Sun-Hwa;Baek, Yong-Wook
    • Journal of Soil and Groundwater Environment
    • /
    • v.13 no.6
    • /
    • pp.62-71
    • /
    • 2008
  • Soil quality standards (SQS) are necessary to protect the human health and soil biota from the exposure to soil pollutants. The current SQS in Korea contain only sixteen substances, and it is scheduled to expand the number of substances. Chemical ranking and scoring (CRS) system is very effective to screen the priority chemicals for the future SQS in terms of their toxicity and exposure potential. In this study, several CRS systems were extensively compared to propose the assessment factors that required for the screening of soil pollutants The CRS systems considered in this study include the CHEMS-1 (Chemical Hazard Evaluation for Management Strategies), SCRAM (Scoring and Ranking Assessment Model), EURAM (European Union Risk Ranking Method), ARET (Accelerated Reduction/Elimination of Toxics), CRSKorea, and other systems. The additional assessment factors of CRS suitable for soil pollutants were suggested. We suggest soil adsorption factor as an appropriate factor of CRS system to consider chemical transport from soil to groundwater. Other factors such as soil emission rate and cases of accident of soil pollutants were included. These results were reflected to screen the priority chemicals in Korea, as a part of the project entitled ‘Setting the Priority of Soil Contaminants'.

Machine Scoring Methods Highly-correlated with Human Ratings in Speech Recognizer Detecting Mispronunciation of Foreign Language (한국인의 외국어 발화오류검출 음성인식기에서 청취판단과 상관관계가 높은 기계 스코어링 기법)

  • Bae, Min-Young;Kwon, Chul-Hong
    • Speech Sciences
    • /
    • v.11 no.2
    • /
    • pp.217-226
    • /
    • 2004
  • An automatic pronunciation correction system provides users with correction guidelines for each pronunciation error. For this purpose, we develop a speech recognition system which automatically classifies pronunciation errors when Koreans speak a foreign language. In this paper, we propose a machine scoring method for automatic assessment of pronunciation quality by the speech recognizer. Scores obtained from an expert human listener are used as the reference to evaluate the different machine scores and to provide targets when training some of algorithms. We use a log-likelihood score and a normalized log-likelihood score as machine scoring methods. Experimental results show that the normalized log-likelihood score had higher correlation with human scores than that obtained using the log-likelihood score.

  • PDF

Development of Preliminary Assessment Methodology for Priority Listing of Soil and Groundwater Contamination Sources (토양.지하수오염원 관리우선순위 개략평가기법 개발)

  • Jeong, Seung-Woo;Kim, Young-Ju;Kim, Jae-Hoon;Hwang, Sang-Il
    • Journal of Soil and Groundwater Environment
    • /
    • v.16 no.6
    • /
    • pp.106-112
    • /
    • 2011
  • This study developed preliminary assessment methodology for priority listing of soil and groundwater contamination sources, considering source characteristics, local environments and risk receptors. Source characteristics were evaluated by scoring relative risk of contamination sources. Local environments were evaluated by scoring annual rainfall, hydraulic conductivity of aquifer, and annual groundwater use. Risk receptors were evaluated by scoring local population, direct distance to surface water, direct distance to drinking-water wells. Scores of each parameter were allocated by analysing distribution of parameter values obtained from government databases. Distributed scores of source characteristics local environments: risk receptors were 12 : 12 : 12. The preliminary assessment scored 0 to 36 for each soil and groundwater sources. Inventory of soil and groundwater sources consisted of 7 categories. This study applied the preliminary assessment methodology to Manan-Gu, Anyang City, Korea. The number of car repair and washing facility was the largest in the contamination source inventory. Petroleum storage facilities showed the highest assessment score. The preliminary assessment methodology also indicated that Anyang-Dong was the priority section among Anyang-Dong, Suksu-Dong, Bakdal-Dong. This study is the first trial for relative ranking soil and groundwater contamination sources by considering source and local characteristics. Therefore, further researches and revision of the preliminary assessment methodology need to be pursued for various applications.

A Study on the Development of New Mathematical Evaluation System for Improving Students' Creativity (창의성 신장을 위한 새로운 수학교육 평가 방안에 관한 연구)

  • 박배훈;류희찬;이기석;김인수
    • School Mathematics
    • /
    • v.5 no.1
    • /
    • pp.1-25
    • /
    • 2003
  • This study develops a performance assessment system to improve grade 4-9 students' creativity. First, this study discusses its educational meaning, its task types, scoring methods and practical application methods. Then, this study provides the typical examples of performance assessment task classified by each of the types and its scoring rubrics. Finally, this study analyzes students' achievement levels for each task. Each task includes item informations such as content area, evaluation goal, evaluation procedure, preparatory material, characteristics, considering points, scoring rubric etc. for grade 4-9 teachers to use them in their evaluation processes directly without difficulties.

  • PDF