• Title/Summary/Keyword: scoring system of assessment

Search Result 137, Processing Time 0.038 seconds

Scoring Methods for Improvement of Speech Recognizer Detecting Mispronunciation of Foreign Language (외국어 발화오류 검출 음성인식기의 성능 개선을 위한 스코어링 기법)

  • Kang Hyo-Won;Kwon Chul-Hong
    • MALSORI
    • /
    • no.49
    • /
    • pp.95-105
    • /
    • 2004
  • An automatic pronunciation correction system provides learners with correction guidelines for each mispronunciation. For this purpose we develope a speech recognizer which automatically classifies pronunciation errors when Koreans speak a foreign language. In order to develope the methods for automatic assessment of pronunciation quality, we propose a language model based score as a machine score in the speech recognizer. Experimental results show that the language model based score had higher correlation with human scores than that obtained using the conventional log-likelihood based score.

  • PDF

The Accuracy of Barr, Blethyn and Leech Scoring Systems on Plain Abdominal Radiographs in Childhood Constipation (소아에서 단순 복부 X-선 사진으로 변비를 진단하는데 있어 Barr, Blethyn과 Leech 점수체계의 정확도)

  • Moon, Ji-Young;Moon, Kyung-Rye
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • v.10 no.1
    • /
    • pp.44-50
    • /
    • 2007
  • Purpose: The role of plain, abdominal radiography in childhood constipation has not been fully evaluated. The aim of this study was to determine the accuracy and reliability of scoring systems assessing a fecal load on plain, abdominal radiographs in children with functional constipation. Methods: Plain, abdominal radiographs from 38 constipated children and 39 control children were examined by four independent inspectors, pediatric residents. Four inspectors independently scored the radiographs according to three different scoring systems Barr, Blethyn, and Leech. No clinical information about the patients was available to the inspectors. Each abdominal radiograph was evaluated on two separate occasions, one week apart. Kappa coefficients were calculated as indicators of inter-and intra-inspector variability, coefficients <0.20, 0.21~0.40, 0.40~0.60, 0.61~0.80 and 0.81~1.00 were considered to indicate poor, fair, moderate, good, and very good agreement, respectively. Results: The Leech score showed the highest reproducibility: the inter-inspector agreement was uniformly very good on two separate occasions (${\kappa}$ values of 0.88, 0.91, 0.92, 0.86 in the first time and 0.81, 0.88, 0.89, 0.84 in the second time). Agreement using the Barr score was good (${\kappa}$ values of 0.66, 0.67, 0.69, 0.66 in the first time and 0.68, 0.65, 0.71, 0.68 in the second time). However, agreement for the Blethyn score was the lowest of the three scoring systems. The Leech scoring system had the highest sensitivity and specificity compared to the Barr scoring system for the diagnosis of functional constipation by plain, abdominal radiographs. Conclusion: The Leech score appeared to be a more accurate and reliable method because of its high sensitivity and specificity for evaluating the fecal load on plain, abdominal radiographs in children with functional constipation. Therefore, the Leech scoring system was found to be the most useful for assessment for the degree of constipation on plain, abdominal radiographs in children.

  • PDF

Prognostic Accuracy of the Quick Sequential Organ Failure Assessment for Outcomes Among Patients with Trauma in the Emergency Department: A Comparison with the Modified Early Warning Score, Revised Trauma Score, and Injury Severity Score

  • Kang, Min Woo;Ko, Seo Young;Song, Sung Wook;Kim, Woo Jeong;Kang, Young Joon;Kang, Kyeong Won;Park, Hyun Soo;Park, Chang Bae;Kang, Jeong Ho;Bu, Ji Hwan;Lee, Sung Kgun
    • Journal of Trauma and Injury
    • /
    • v.34 no.1
    • /
    • pp.3-12
    • /
    • 2021
  • Purpose: To evaluate the severity of trauma, many scoring systems and predictive models have been presented. The quick Sequential Organ Failure Assessment (qSOFA) is a simple scoring system based on vital signs, and we expect it to be easier to apply to trauma patients than other trauma assessment tools. Methods: This study was a cross-sectional study of trauma patients who visited the emergency department of Jeju National University Hospital. We excluded patients under the age of 18 years and unknown outcomes. We calculated the qSOFA, the Modified Early Warning Score (mEWS), Revised Trauma Score (RTS), and Injury Severity Score (ISS) based on patients' initial vital signs and assessments performed in the emergency department (ED). The primary outcome was mortality within 14 days of trauma. We analyzed qSOFA scores using multivariate logistic regression analysis and compared the predictive accuracy of these scoring systems using the area under the receiver operating characteristic curve (AUROC). Results: In total, 27,764 patients were analyzed. In the multivariate logistic regression analysis of the qSOFA, the adjusted odds ratios with 95% confidence interval (CI) for mortality relative to a qSOFA score of 0 were 27.82 (13.63-56.79) for a qSOFA score of 1, 373.31 (183.47-759.57) for a qSOFA score of 2, and 494.07 (143.75-1698.15) for a qSOFA score of 3. In the receiver operating characteristic (ROC) curve analysis for the qSOFA, mEWS, ISS, and RTS in predicting the outcomes, for mortality, the AUROC for the qSOFA (AUROC [95% CI]; 0.912 [0.871-0.952]) was significantly greater than those for the ISS (0.700 [0.608-0.793]) and RTS (0.160 [0.108-0.211]). Conclusions: The qSOFA was useful for predicting the prognosis of trauma patients evaluated in the ED.

A study on the risk scoring and risk index for the ecosystem-based fisheries assessment (생태계 기반 어업평가의 위험도 추정에 관한 개선연구)

  • Park, Hee Won;Zhang, Chang Ik;Kwon, You Jung;Seo, Young Il;Oh, Taeg-Yun
    • Journal of the Korean Society of Fisheries and Ocean Technology
    • /
    • v.49 no.4
    • /
    • pp.469-482
    • /
    • 2013
  • This study identified problems of the existing ecosystem-based fisheries assessment approach, and suggested new methods for scoring risk and for the estimation of fishery risk index. First, risk scores of zero to two for target and limit reference points for each indicator were replaced by those of zero to three, and the risk scores were calculated from new formulae which were developed in this study. Second, a new method for estimating fishery risk index (FRI) was developed in this study, considering the level of indicators. New method was applied to the Korean large purse seine fishery, large pair trawl fishery and drag net fishery. More precise and detailed risk scores were obtained from the new method, which can explain the risks by the wider range of both risk levels for 'better than target' and 'beyond limit'. The new method for estimating FRI could avoid the basic problem related with duplicated computations of fishery-level indicators, which improved the estimated FRI to be more accurate. Also, a method for estimating variance of FRI using the bootstrap was proposed in this study.

Validation of a simple binary scoring system for assessment of welfare measures of 10-day-old commercial broilers and their correlation with environmental parameters

  • Kumari, Priyanka;Choi, Hong-Lim;Metali, Shamira Hazi;Yussof, Siti Anisah Hazi;Han, Jiwoon
    • Journal of Animal Science and Technology
    • /
    • v.57 no.3
    • /
    • pp.9.1-9.5
    • /
    • 2015
  • Background: A simple binary scoring system (SBSS) was developed and used to assess the welfare measures of commercial broiler chickens in South Korea. We also correlated welfare measures with environmental parameters of broiler house. Our measures of welfare included lameness, hock burn (HB) and foot pad dermatitis (FPD), whilst environmental parameters included air temperature, relative humidity, air speed, light intensity, air quality (in particular carbon dioxide ($CO_2$) and ammonia ($NH_3$) concentrations) and airborne microbes. Results: The effect of environmental parameters on welfare measures was apparent even on 10-day-old broilers. A non-parametric correlation analysis revealed significant correlations between environmental parameters and welfare measures. The key environmental parameters were relative humidity and light intensity. The results indicate that there is a need for proper control of environmental conditions on poultry farms, which could reduce health problems and subsequently reduce disease and mortality. Conclusions: In conclusion, the simplicity of SBSS makes it preferable over more complex scoring systems and allows a farmer to more easily assess the welfare measures on their own farm.

A Study about Discharge Criteria to Determine Patients' Readiness for Safe Return to Home after Ambulatory Surgery (통원 수술환자의 안전한 귀가 결정을 위한 퇴실기준에 관한 연구)

  • Yoon, Ke Sook;Kim, Eun Gyeong;Jung, So Hyun;Lee, Seung Ju;Jung, Mi Kyoung;Lee, Young Mee
    • Journal of Korean Clinical Nursing Research
    • /
    • v.18 no.3
    • /
    • pp.435-446
    • /
    • 2012
  • Purpose: This study was conducted to compare three discharge criteria; 1) discharge criteria of S Hospital determined by nurses, 2) discharge readiness determined by patients, and 3) the Modified Post-Anesthetic Discharge Scoring System (MPADSS). The usefulness of MPADSS as a discharge criteria for the patients'safe return to home after ambulatory surgery was also evaluated. Methods: A total of 370 day surgery cases were investigated. The MPADSS was employed in every 30 min. in parallel with discharge readiness assessment by nurses and patients. The percentage of the patients who were categorized as being ready to discharge were compared according to three discharge criteria. Results: The percentage of patients scored to be as MPADSS > 9 in 30 min, 60 min, 90 min were 96.5%, 99.5%, 100%respectively. Whereas 11.1%, 44.3%, 71.1%of patients rated themselves as being ready to discharge and 2.7%, 23.5%, 54.3% of patients actually discharged by nurses according to discharge criteria of S Hospital. Conclusion: Nurses tend to keep patients longer in the hospital when compared to the patient's own assessment about their readiness to home and to that of MPADSS. Faster discharge in the evening than day time suggests patient discharge can be influenced by nursing factors. This brings out the importance of scoring system to determine the safe discharge. The MPADSS could be a useful tool in evaluating patients for safe discharge.

Effect of Application of Ensemble Method on Machine Learning with Insufficient Training Set in Developing Automated English Essay Scoring System (영작문 자동채점 시스템 개발에서 학습데이터 부족 문제 해결을 위한 앙상블 기법 적용의 효과)

  • Lee, Gyoung Ho;Lee, Kong Joo
    • Journal of KIISE
    • /
    • v.42 no.9
    • /
    • pp.1124-1132
    • /
    • 2015
  • In order to train a supervised machine learning algorithm, it is necessary to have non-biased labels and a sufficient amount of training data. However, it is difficult to collect the required non-biased labels and a sufficient amount of training data to develop an automatic English Composition scoring system. In addition, an English writing assessment is carried out using a multi-faceted evaluation of the overall level of the answer. Therefore, it is difficult to choose an appropriate machine learning algorithm for such work. In this paper, we show that it is possible to alleviate these problems through ensemble learning. The results of the experiment indicate that the ensemble technique exhibited an overall performance that was better than that of other algorithms.

The application of simplified risk assessment for tunnel (터널 리스크 평가 기법의 적용성에 대한 연구)

  • Kim, Sang-Hwan;Lee, Chung-Hwan
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.9 no.1
    • /
    • pp.63-74
    • /
    • 2007
  • Unexpected ground conditions have always been a major problem for the construction of tunnel. Therefore, it is necessary to evaluate the risk capacity before and/or during construction of new tunnel. This paper presents the simplified risk assessment system using modified stability number (N), namely Underground Risk Index (URI) system, to evaluate the tunnel risk possibility in the design stage. URI is a scoring system for risk possibility by rating the each appraisal elements. The modified stability number (N) which is one of risk factor in the Interaction Matrix parameters such as RQD, UCS, weathering, overburden, stability number, ground water-table, RMR, permeability and so on, is used in the system. In addition, the case study is performed in order to verify the applicability of URI-system in practice.

  • PDF

Assessment of DNA Ploidy Patterns in Connection with Prognostic Factors in Patients with Papillary Thyroid Carcinoma (유두상 갑상선암에서 예후인자와 DNA배수성의 상관관계)

  • Chung Woung-Youn;Lee Jong-Hoon;Park Cheong-Soo
    • Korean Journal of Head & Neck Oncology
    • /
    • v.12 no.2
    • /
    • pp.153-160
    • /
    • 1996
  • Regardless of the prognostic factors in papillary thyroid cancer, such as sex, age, size of tumor, extent of disease, and distant metastasis, the prognosis of papillary thyroid cancer is sometimes difficult to predict from clinical and microscopic analysis alone and additional prognostic indicators are needed. Recent studies of thyroid cancer have indicated that DNA aneuploidy may be correlated to the biological behavior of malignancy and inversely correlated to the prognosis, but it still remains contraversal. We performed this study to assess DNA ploidy patterns in relation with the previously known prognostic factors in AMES scoring system and lateral neck node metastasis in papillary thyroid cancer. A series of 132 patients with papillary thyroid cancer and 80 patients with benign thyroid tumor(27 follicular adenomas and 53 adenomatous goiters) as a control group from October 1993 to Feburary 1995 were analyzed and their nuclear DNA content was measured with flow cytometry using fresh tissue specimens. DNA aneuploidy was found in 8(6.1%) in papillary cancer and 8(10%) in benign tumor. S-phase traction(SFP) and proliferative index(PI) were higher in thyroid cancers, being 2.18$\pm$4.24%, 6.34$\pm$4.94% in the papillary thyroid cancers and 1.97$\pm$2.93%, 4.44$\pm$3.80% in the benign tumors, respectively. However there was no significant difference of values between two groups(p>0.05). Among variable prognostic factors studied(age, sex, size of tun or, extent of disease, distant metastasis in AMES scoring system and lateral neck node metastasis), DNA aneuploidy was found to be common in distant metastasis(p<0.001) and in lateral neck node metastasis(p>0.035), but there was no significant difference between the high risk and low risk group according to the AMES scoring system(p<0.08). In our study, DNA aneuploidy was not valuable in determining the presence of malignancy and did not correlate to the AMES scoring system. However, follow-up study of more cases will be needed for accurate information about the DNA ploidy as a independent prognostic factor.

  • PDF

Equitable Peer Assessment Method in Collaboration Project Using Statistical Technique (통계적 기법을 이용한 집단 협업 프로젝트에서의 공정한 동료 평가 방법론에 대한 연구)

  • Cho, Miyeon;Ko, Sung-Seok
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.36 no.1
    • /
    • pp.44-52
    • /
    • 2013
  • For evaluating participation in collaboration project, the peer assement method is mostly used and various scoring methods have been proposed. But, the reliability and validity of the peer assessment method are still doubted for all most method. In order to overcome these weaknesss, some guidelines and training methods have been recommended. In this article, however, statistical technique is proposed for measuring individual contributions to collaboration projects considering each assessor's reliability. The gist of our proposed algorithm is that an assessor's reliability depends on the evaluation policy, and this reliability is evaluated by an analysis of variance of the scores assigned by the assessor. We also show that the proposed method is very efficient by case study in university class.