• Title/Summary/Keyword: speaking score

Search Result 39, Processing Time 0.028 seconds

Computer-Based Fluency Evaluation of English Speaking Tests for Koreans (한국인을 위한 영어 말하기 시험의 컴퓨터 기반 유창성 평가)

  • Jang, Byeong-Yong;Kwon, Oh-Wook
    • Phonetics and Speech Sciences
    • /
    • v.6 no.2
    • /
    • pp.9-20
    • /
    • 2014
  • In this paper, we propose an automatic fluency evaluation algorithm for English speaking tests. In the proposed algorithm, acoustic features are extracted from an input spoken utterance and then fluency score is computed by using support vector regression (SVR). We estimate the parameters of feature modeling and SVR using the speech signals and the corresponding scores by human raters. From the correlation analysis results, it is shown that speech rate, articulation rate, and mean length of runs are best for fluency evaluation. Experimental results show that the correlation between the human score and the SVR score is 0.87 for 3 speaking tests, which suggests the possibility of the proposed algorithm as a secondary fluency evaluation tool.

The relation between phonetic differences of Korean learners' production of English vowels, pronunciation intelligibility and speaking proficiency test scores (한국인 학습자 영어 모음 발화의 음성학적 차이와 발음 이해도, 말하기 점수와의 관계)

  • Kim, Ji-Eun
    • Phonetics and Speech Sciences
    • /
    • v.9 no.2
    • /
    • pp.1-7
    • /
    • 2017
  • The purpose of this study is to investigate the relations between phonetic differences among Korean learners' production of English front vowels, pronunciation intelligibility and speaking proficiency test score. To do so, thirty Korean university students were asked (1) to read English text book paragraphs and (2) describe a picture. Two English native raters and one Korean rater evaluated Korean subjects' English pronunciation intelligibility and speaking. In addition, subjects' English vowel productions were acoustically analyzed(F0, F1, F2, vowel duration, intensity). The results of the study show that the vowel quality and pitch of the unstressed vowels and lax vowel are related to the pronunciation intelligibility. In addition, the scores of pronunciation intelligibility and speaking are highly related.

Fluency Scoring of English Speaking Tests for Nonnative Speakers Using a Native English Phone Recognizer

  • Jang, Byeong-Yong;Kwon, Oh-Wook
    • Phonetics and Speech Sciences
    • /
    • v.7 no.2
    • /
    • pp.149-156
    • /
    • 2015
  • We propose a new method for automatic fluency scoring of English speaking tests spoken by nonnative speakers in a free-talking style. The proposed method is different from the previous methods in that it does not require the transcribed texts for spoken utterances. At first, an input utterance is segmented into a phone sequence by using a phone recognizer trained by using native speech databases. For each utterance, a feature vector with 6 features is extracted by processing the segmentation results of the phone recognizer. Then, fluency score is computed by applying support vector regression (SVR) to the feature vector. The parameters of SVR are learned by using the rater scores for the utterances. In computer experiments with 3 tests taken by 48 Korean adults, we show that speech rate, phonation time ratio, and smoothed unfilled pause rate are best for fluency scoring. The correlation of between the rater score and the SVR score is shown to be 0.84, which is higher than the correlation of 0.78 among raters. Although the correlation is slightly lower than the correlation of 0.90 when the transcribed texts are given, it implies that the proposed method can be used as a preprocessing tool for fluency evaluation of speaking tests.

A Study of Normal Nasalance and Velopharyngeal Port Activity in the Speech of Korean Adults (정상 성인의 비음도와 비인강 활성도에 관한 연구)

  • Leem Dae-Ho;Shin Hyo-Keun;Baek Jin-A.;Kim Hyun-Gi;Kwon Min-Su
    • Korean Journal of Cleft Lip And Palate
    • /
    • v.7 no.2
    • /
    • pp.123-132
    • /
    • 2004
  • The purpose of this study was to obtain normative nasalance scores for adult subjects speaking the Korean language. Additional objectives of the study were to determine if speaker sex played a role in differences in nasalance score and there was significantly correlation of nasalance score with nasalance slope score. The subjects include 75 healthy young Korean adults with normal oral and velopharyngeal resource and function. They had no history of speech problem, were judged as having normal speech and resonance at the time of testing, and had no upper respiratory tract infections or allergies at the time of testing. The Nasometer II 6400 was used to obtain nasalance scores and nasalance slope scores for /a/, /i/, /e/, /o/, /u/, /ja/, /je/, /wi/, /p'ap'i/ and /sasi/. The data of nasalance and nasalance slope were analyzed statistically. The mean nasalance score of the female was significantly higher than that of male at /a/, /i/, /wi/, /p'ap'i/ and /sasi/(p <0.10). The mean nasalance score of /i/ was highest and that of /o/ was the lowest. In this study, we could not and the relationship of the nasalance score and the closing slope score. However, there was negative correlation between the mean nasalance score and the opening slope score at ie/ and /;ai, positive to /sasi/. These normative nasalance scores for normal young adults speaking the Korean language provide important reference information for Korean cleft palate teams. In the future study of velopharygneal activity with the Nasometer, the opening slope score will be able to be the important parameter.

  • PDF

Evaluation of English speaking proficiency under fixed speech rate: Focusing on utterances produced by Korean child learners of English

  • Narah Choi;Tae-Yeoub Jang
    • Phonetics and Speech Sciences
    • /
    • v.15 no.1
    • /
    • pp.47-54
    • /
    • 2023
  • This study attempted to test the hypothesis that Korean evaluators can score L2 speech appropriately, even when speech rate features are unavailable. Two perception experiments-preliminary and main-were conducted sequentially. The purpose of the preliminary experiment was to categorize English-as-a-foreign-language (EFL) speakers into two groups-advanced learners and lower-level learners-based on the proficiency scores given by five human raters. In the main experiment, a set of stimuli was prepared such that the speech rate of all data tokens was modified to have a uniform speech rate. Ten human evaluators were asked to score the stimulus tokens on a 5-point scale. These scores were statistically analyzed to determine whether there was a significant difference in utterance production between the two groups. The results of the preliminary experiment confirm that higher-proficiency learners speak faster than lower-proficiency learners. The results of the main experiment indicate that under controlled speech-rate conditions, human raters can appropriately assess learner proficiency, probably thanks to the linguistic features that the raters considered during the evaluation process.

Improvement of Inspection Methods using Lighting Signals and Guidebook for Non-English speaking Foreign Visitors (For chest X-ray Screening Examinees) (비영어권 외국인 내원객의 조명 신호와 안내서를 이용한 검사방법 개선 효과(흉부 방사선 검사자를 대상으로))

  • Kwak, Jong Hyeok;Choi, Min Gyeong;Kim, Neung Kyun;Kim, A Yeon;Kim, Gyeong Rip
    • Journal of the Korean Society of Radiology
    • /
    • v.14 no.5
    • /
    • pp.577-584
    • /
    • 2020
  • In this study, the number of non-English speaking visitors is increasing day by day, and accordingly, there was a limitation in language communication and communication during radiographic examination. To this end, after distributing the handbook produced for inspection, the improvement effect of before and after explanation was examined. The score scale was not statistically significant as to whether it was the test site or not, and the degree of discomfort of the test, the degree of understanding of the breathing guidelines, and the satisfaction of the test description were improved and the score scale was improved before and after the description of the guide. Non-English-speaking foreign visitors were more satisfied with explanations in their own text than in English or Korean, and the method was also able to conduct effective inspections by informing the foreign guests when to control their breathing by using the lighting signals in the laboratory. In the future, the quality of medical services and imaging medical examinations can be improved only when communication methods are implemented from various perspectives, such as developing various language interpretation programs, developing guides for various test sites, and developing tools and improving foreign language skills of radiologists and medical staff. There will be. In the future, it may be used as a basic resource to prepare a manual that can be used to examine non-English speaking foreigners who do not understand English or Korean in other radiology labs.

Speech Enhancement Using Lip Information and SFM (입술정보 및 SFM을 이용한 음성의 음질향상알고리듬)

  • Baek, Seong-Joon;Kim, Jin-Young
    • Speech Sciences
    • /
    • v.10 no.2
    • /
    • pp.77-84
    • /
    • 2003
  • In this research, we seek the beginning of the speech and detect the stationary speech region using lip information. Performing running average of the estimated speech signal in the stationary region, we reduce the effect of musical noise which is inherent to the conventional MlMSE (Minimum Mean Square Error) speech enhancement algorithm. In addition to it, SFM (Spectral Flatness Measure) is incorporated to reduce the speech signal estimation error due to speaking habit and some lacking lip information. The proposed algorithm with Wiener filtering shows the superior performance to the conventional methods according to MOS (Mean Opinion Score) test.

  • PDF

AI-based language tutoring systems with end-to-end automatic speech recognition and proficiency evaluation

  • Byung Ok Kang;Hyung-Bae Jeon;Yun Kyung Lee
    • ETRI Journal
    • /
    • v.46 no.1
    • /
    • pp.48-58
    • /
    • 2024
  • This paper presents the development of language tutoring systems for nonnative speakers by leveraging advanced end-to-end automatic speech recognition (ASR) and proficiency evaluation. Given the frequent errors in non-native speech, high-performance spontaneous speech recognition must be applied. Our systems accurately evaluate pronunciation and speaking fluency and provide feedback on errors by relying on precise transcriptions. End-to-end ASR is implemented and enhanced by using diverse non-native speaker speech data for model training. For performance enhancement, we combine semisupervised and transfer learning techniques using labeled and unlabeled speech data. Automatic proficiency evaluation is performed by a model trained to maximize the statistical correlation between the fluency score manually determined by a human expert and a calculated fluency score. We developed an English tutoring system for Korean elementary students called EBS AI Peng-Talk and a Korean tutoring system for foreigners called KSI Korean AI Tutor. Both systems were deployed by South Korean government agencies.

A Study on Analyzing Actual Condition for Developing A Married Immigrant Families Support Program from the Consumer' Viewpoint: Focused on Seoul Residing Married Immigrant Women (수요자 관점의 결혼이민자가족지원 프로그램 개발을 위한 기초 실태 분석: 서울시 거주 결혼이민여성을 중심으로)

  • Kim, Yang-Hee;Anh, Jin-Kyung
    • Journal of Families and Better Life
    • /
    • v.28 no.4
    • /
    • pp.1-13
    • /
    • 2010
  • The purpose of this study is to conduct base line research, which is based on requestion of international married immigrant women, for developing social adaptation and family enrichment program for those population who reside in Korea. The survey questionnaire was distributed to 142 international married immigrant women who reside in Seoul to research program participate satisfaction and requestion. Analyze the study results, frequency, percentage, t-test, ANOVA and Duncan-post test were utilized. As a result, overall satisfaction toward program that offered by organization was highly ranked. Visiting service showed high score of satisfaction but mentor service that strongly possess sacrifice showed lower score of satisfaction. Vocational and job-related skill improvement education presented less satisfied degree of satisfaction but cooking class, computer class, training education for native-speaking instructor present high level of satisfaction. Second, the requisition of target population, who did not participate program, presented lower than the satisfaction, still present high demand of variety area of program. Among them, assist child nurturing and vocational and job- related skill improvement education showed high demand. It enable to predict that they are eager to get support toward parent role and self-realization. Third, when the difference were analyzed to compare the subjective judgement toward life adaptation in Korea and the satisfaction for program user and the requisition of non-user, the meaningful differences were founded; especially, individuals who possess confident degree of computer skills and Korean(reading, speaking, and listening) showed higher degree of satisfaction to vocation and job-skill related improvement education. This study has a practical implication, which is based on the study results, on developing a program to support international married immigrant women and multicultural families to satisfactory settlement in Korea life and to maintain healthy families.

A Study on the Teaching Method for a Efficient EMI Education of Engineering major Subjects (공학 전공과목 영어강의에서 효율적인 교수법 연구)

  • Lee, Boo-Hyung
    • Journal of Engineering Education Research
    • /
    • v.13 no.6
    • /
    • pp.188-194
    • /
    • 2010
  • This paper deals with a teaching method in EMI(English Medium Instructor) Education for engineering major subjects which is accomplished between non-native english speaking professors and students. Goals of EMI in non-english speaking countries will be both a improvement of communication ability and understanding of the major subjects. However, when students who have a low level-english ability participate in english class, it is necessary to analyze whether they can obtain above goals or not and to study on a teaching method for them. The english classes were aimed at students at the college of engineering who have 200-420 TOEIC average score. The research was proceeded by course evaluations to three direct EMI and surveys that were performed targeting all students participated in english class. The proposed research results may lead to development of EMI for students who have a low level- english ability and give them a better understanding and interest of major subjects.

  • PDF