• Phonetics and Speech Sciences
• /
• v.6 no.2
• /
• pp.9-20
• /
• 2014

In this paper, we propose an automatic fluency evaluation algorithm for English speaking tests. In the proposed algorithm, acoustic features are extracted from an input spoken utterance and then fluency score is computed by using support vector regression (SVR). We estimate the parameters of feature modeling and SVR using the speech signals and the corresponding scores by human raters. From the correlation analysis results, it is shown that speech rate, articulation rate, and mean length of runs are best for fluency evaluation. Experimental results show that the correlation between the human score and the SVR score is 0.87 for 3 speaking tests, which suggests the possibility of the proposed algorithm as a secondary fluency evaluation tool.

• Korean Journal of Child Studies
• /
• v.21 no.2
• /
• pp.83-97
• /
• 2000

Ninety 6th graders were randomly assigned to an experimental or a control group in this 5 week study of the effects of constructivist instruction on writing performance. After the writing pre-test, the experimental group was treated with constructivist instruction while the control group was treated with a tradition procedure based on Joyce and Weil's(1992) basic exercise model Instruction consisted of ten 40-minute sessions. The effectiveness of the constructivist instruction was tested by post-and retention-tests. Two raters scored the children's writing by the analytical scale of Jin-Suk Won(1994). Results were analyzed by t-test. The writing performance and the retention scores of the experimental group were higher than that of the control group. The results of the sub-criteria scores showed significant effects on children's understanding of contents and constructive performance.

• Phonetics and Speech Sciences
• /
• v.9 no.2
• /
• pp.1-7
• /
• 2017

The purpose of this study is to investigate the relations between phonetic differences among Korean learners' production of English front vowels, pronunciation intelligibility and speaking proficiency test score. To do so, thirty Korean university students were asked (1) to read English text book paragraphs and (2) describe a picture. Two English native raters and one Korean rater evaluated Korean subjects' English pronunciation intelligibility and speaking. In addition, subjects' English vowel productions were acoustically analyzed(F0, F1, F2, vowel duration, intensity). The results of the study show that the vowel quality and pitch of the unstressed vowels and lax vowel are related to the pronunciation intelligibility. In addition, the scores of pronunciation intelligibility and speaking are highly related.

• Physical Therapy Korea
• /
• v.4 no.3
• /
• pp.45-60
• /
• 1997

This study was performed to determine the inter-rater reliability of the Chedoke-McMaster Stroke Assessment translated in Korean. This measures the physical impairments and disabilities that impact on the lives of individuals with stroke. The purposes of this measure were 1) to stage motor recovery to classify individuals in terms of clinical characteristics, 2) to predict rehabilitation outcomes, and 3) to measure clinically important change in physical function. Twenty-two subjects from physical therapy unit were assessed by two physical therapists. The ratings were compared by Spearman's rank correlation The correlation between two raters ranged from 0.85 to 0.98. Inter-rater reliability coefficient for total scores ranged from 0.95 to 0.97. This study confirms that the Chedoke-McMaster Stroke Assessment yields reliable results.

• KIEAE Journal
• /
• v.12 no.3
• /
• pp.69-75
• /
• 2012

Developing reliable measures of the environment is important to increase our understanding of the environmental effects on walking among seniors. As a preliminary study for developing an instrument for measuring walkability of seniors' environment, the purpose of this study are to identify important assessment indicators associated with seniors' walking and to test their reliability using inter-rater and intra-rater reliability methods. A set of assessment indicators was identified through literature review, and field studies by trained raters were conducted in three senior centers located in Seongnam area in order to test reliability of the audit tool. The results indicated high percent agreement for most indicators and overall 91.6% and 86.1% of items assessed had good or medium inter-rater and intra-rater reliability, respectively. The reliable assessment indicators would provide reliable data for use in community-based audits of built environment in relation to walking among older adults. The findings showed that the indicators of aesthetics had lower reliability compare to safety, convenience, and access. Rater training with various images would improve rater agreement while reduce rater bias.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.10
• /
• pp.3498-3512
• /
• 2021

This article describes how events that make up text stories can be represented and extracted. We also address the results from our simple experiment on extracting and clustering events in terms of emotions, under the assumption that different emotional events can be associated with the classified clusters. Each emotion cluster is based on Plutchik's eight basic emotion model, and the attributes of the NLTK-VADER are used for the classification criterion. While comparisons of the results with human raters show less accuracy for certain emotion types, emotion types such as joy and sadness show relatively high accuracy. The evaluation results with NRC Word Emotion Association Lexicon (aka EmoLex) show high accuracy values (more than 90% accuracy in anger, disgust, fear, and surprise), though precision and recall values are relatively low.

• International conference on construction engineering and project management
• /
• 2013.01a
• /
• pp.507-508
• /
• 2013

International Roughness Index (IRI) has been widely used by state DOTs to quantify pavement smoothness. When pavement condition falls below certain IRI thresholds, corresponding pavement maintenance treatments should be considered for application. Selection of appropriate IRI thresholds is essential to tactical allocation of limited resources to improve the conditions of states' roadway systems. This selection process is often challenging, however, because IRI thresholds are largely determined by Perceived Ride Quality (PRQ), and PRQ differs in each state. In this paper, a framework is proposed to address this problem. Passenger raters will be randomly selected from predetermined geographic locations, and their PRQ ratings collected. Taking this perceived ride data, along with other data collected, a statistical analysis will be conducted to establish the relationship between measured IRI values and PRQ. Appropriate IRI thresholds will then be determined. Once this framework is implemented, state DOTs could make informative maintenance decisions, which are expected to greatly enhance the public perception of pavement conditions in today's challenging economy.

• Journal of Korean Academy of Nursing Administration
• /
• v.10 no.1
• /
• pp.25-36
• /
• 2004

Purpose: Nursing puts much weight en the organization of hospital. Therefore it is necessity to improve nursing care. One of the most important things is to secure confident nurses and to develop nurse' potentiality. It directs nurse evaluation system. The concept of "performance appraisal tools" is extremely important in evaluation system. Therefore, the purpose of this study aims to define performance appraisal process. Method: In order to do this, two main study has been observed interviewing appraisers and employees in-depth and analyzing performance appraisal tools of seven hospitals and analysed validity, reliability, acceptability and practicability. Result: The result of this study can be summarized as follows; Firstly, the result of analysis of performance appraisal tools. Regard to validity, Hospitals had a typical goal, but had not put to practice use. Regard to reliability, 1) Appraisal rule had been focused on appraiser's error, how to avoid. 2) 5 hospitals accessed nurses with relative rating and 2 hospitals with absolute rating both in practice. 3) 3 hospitals informed nurses the result of performance appraisal but 4 hospitals did not. 4) All hospitals in this study had conducted superiors rating. Regard to acceptability, 1)Rating scale method had been implemented by 6 hospitals and among those conducted beth ranking method and descriptive method. 2) Most hospitals had focused on personal traits in performance appraisal factors. Regard to practicality, The term of appraisal took $10{\sim}14$ days; performance appraisal happened 1 or 2 times per year; appraisal factors were based on 10 different items. Secondly, the result of in-depth interview with head nurses and staff nurses Regard to validity, head nurses and nurses wared that the goal of performance appraisal is to develop nurse's ability. Regard to reliability, head nurses pointed out that they were doubt of the justice of performance appraisal and they should have got training. Nurses insisted that raters should have been trained due to lack of qualification of appraiser; Head nurses and nurse proposed to convert form relative rating to absolute rating; to inform the result of appraisal; to implement peers rating. Regard to acceptability, One of the critical problems of performance appraisal tools was abstract of appraisal factors ; Lack of job analysis. Regard to practicality, Head nurses used to take overtime for appraisal. There was only a little respond despite of their efforts. Nurses questioned that appraisal tools exist for only appraisal; there was less cost-effectiveness. Conclusion: Based en these findings, it could be suggested to improve the performance appraisal tools for nurses evaluation. Firstly, it is necessary to describe goal of performance appraisal clearly set up, so that nurses could improve their positive word performance and develop their potentiality. Secondly, it is necessary to obtain various training on raters, implement absolute rating and inform the result of appraisal to nurses and use peers rating. Thirdly, it is necessary to convert from rating scale method to management by objectives or behaviorally anchored rating scale and take measurable appraisal factors based en job analysis. Finally, it is necessary to reduce the appraisal cost but increase effectiveness of performance appraisal.

• The Journal of Internal Korean Medicine
• /
• v.34 no.3
• /
• pp.231-239
• /
• 2013

Objectives : This study was performed to evaluate inter-rater and intra-rater reliability of interpretation and reproducibility of a pulse analyser (MAXMAC27-Plus). Methods : 38 of 40 volunteers completed the pulse analysis consecutively. Three Korean medical doctors who had at least 2 years of clinical experience interpreted the pulse waves for 3 aspects of size, depth and shape, then inter-rater reliability and crude agreement was obtained. Reinterpretation was done 2 weeks later and intra-rater reliability and crude agreement was obtained. Intra-rater reliability and crude agreement between 1st and 2nd measurement was calculated. Cohen's weighted kappa for size, Cohen's kappa for depth and shape were used as statistical analysis. Results : Inter-rater reliability of size, depth and shape among 3 raters was 0.598, 0.604, and 0.312, respectively, showing moderate to substantial agreement. Average intra-rater reliability between 1st and 2nd interpretation of size, depth and shape was 0.806, 0.705, and 0.638, respectively, showing substantial to almost perfect agreement. However, intra-rater reliability between consecutive measurements of size, depth and shape was 0.221, 0.121, and 0.194, respectively, which showed only poor to fair agreement. Conclusions : Intra-rater and inter-rater reliability of one pulse wave showed relatively high concordance. Training by a clinical expert may effect better concordance among raters. Test-retest reliability showed poor agreement. Improvement of measurement technique and device performance will be needed.

• Journal of Korean Academy of Nursing Administration
• /
• v.13 no.1
• /
• pp.5-16
• /
• 2007

Purpose: This study is to verify the validity and reliability of classified items and criteria of the patient classification system(PCS) based on Park's definition of nursing intensity. Methods: An expert group of 8 persons verified the content validity of the tools. The 1817 inpatients at a tertiary hospital in Seoul, Korea were classified into 4 groups according to two tools for verifying concurrent validity and interraters' reliability. These verifications were performed from September to October, 2004. Results: Nursing domains of the tools have been divided into 12 items: hygiene, nutrition, elimination, exercise & activity, education & counseling, emotional support, communication & consciousness, treatment & examination, medication, measurement & observation, coordination of multidisciplinary team, admission & discharge & transfer management. Content validity was verified by the content validity index(above 0.75 in all 12 areas). Interraters' reliability was no significant difference in the results of the patient classification between the two raters(A group 93.75%. B group 88.24%). Concurrent validity was also verified by the agreement of two tools(73.7%). Conclusion: These results showed that the reliability and validity of the PCS based on the nursing intensity were verified. These will use an data for nursing productivity in the future.