• Title/Summary/Keyword: linguistic evaluation

Search Result 127, Processing Time 0.021 seconds

A Quantative Evaluation Method of the Quality of Natural Language Sentences based on Genetic Algorithm (유전자 알고리즘에 기반한 자연언어 문장의 정량적 질 평가 방법)

  • Yang, Seung-Hyeon;Kim, Yeong-Seom
    • Journal of KIISE:Software and Applications
    • /
    • v.26 no.11
    • /
    • pp.1372-1380
    • /
    • 1999
  • 본 논문에서는 자연언어 문장의 객관적 정량적인 질 측정 방법의 구축에 대해 설명하고, 이를 문장 퇴고 시스템의 사례에 적용해 본다. 문장의 질을 평가한다는 것은 본질적으로 주관적이고 정량화가 어려운 작업이기 때문에, 이 과정에서 질의 객관적 계량화가 가능한지 여부가 가장 중요한 문제가 된다. 이 논문에서는 이러한 문제를 해결하기 위해 유전자 알고리즘을 이용한 진화적 접근 방법을 통해 객관적이고 정량적인 질의 측정 공식을 유도하는 방법론을 제시하였다. 이 논문에서 제시한 방법론의 핵심은 간단히 말해서 사람이 행하는 정성적인 판단을, 이에 가장 근접하는 정량적 측정 체계로 전환시키는 것이라고 보면 된다. 이것을 위해 정량화 문제를 문장의 단순 언어 특징들의 변화값을 이용한 최적화 문제로 환원시키고, 다시 이 최적화 문제를 유전자 알고리즘을 이용해 해결함으로써 문제를 효과적으로 해결할 수 있었다. 실험 결과를 보면, 본 논문에서 제시한 최적화 방법은 주어진 훈련용 예제와 검증용 예제 중 각각 99.84%, 99.88%를 만족시키는 해를 찾아내었으므로 정량적 질 평가 공식의 유도에 매우 효과적임을 알 수 있었다. 또한 도출된 측정 공식을 이용해서 실제 퇴고 시스템 평가에 적용한 결과 문장 질의 측정에 매우 유용하게 이용될 수 있음을 알 수 있었다. 이와 같이 질의 정량적 평가가 가능하다는 사실이 갖는 또 한가지 중요한 의미는 최종 사용자의 구매 의사나 개발자의 공학적 의사 결정을 위한 객관적 성능 평가 자료의 제공에 이 방법이 유용하게 사용될 수 있다는 점이다.Abstract This paper describes a method of building a quantitative measure of the quality of natural language sentences, particularly produced by document revision systems. Evaluating the quality of natural language sentences is intrinsically subjective, so what is most important as to the evaluation is whether the quality can be measured objectively. To solve such problem of objective measurability, genetic algorithm, an evolutionary learning method, is employed in this paper. The underlying standpoint of this approach is that building the quality measures is a task of constructing a formulae that produces as close results as can to the qualitative decisions made by humans. For doing this, the problem of measurability has been simply reduced to an optimization problem using the change of the values of simple linguistic parameters found in sentences, and the reduced problem has been solved effectively by the genetic algorithm. Experimental result shows that the optimization task satisfied 99.84% and 99.88% of the given objectives for training and validation samples, respectively, which means the method is quite effective in constructing the quantitative measure of the quality of natural language sentences. The actual evaluation result of a revision system shows that the measure is useful to quantize the quality of sentences. Another important contribution of this measure would be to provide an objective performance evaluation data of natural language systems on a basis of which end-users and developers can make their decision to fit their own needs.

Analysis of Semantic Attributes of Korean Words for Sound Quality Evaluation in Music Listening (음악감상에서의 음질 평가를 위한 한국어 어휘의 의미론적 속성 분석)

  • Lee, Eun Young;Yoo, Ga Eul;Lee, Youngmee
    • Journal of Music and Human Behavior
    • /
    • v.21 no.2
    • /
    • pp.107-134
    • /
    • 2024
  • This study aims to classify the semantic words commonly used to evaluate sound quality and to analyze their differences in reflecting the level of musical stimuli. Participants were thirty-one music majors in their 20s and 30s, with an average of 9.4 years of professional training. Each participant listened to nine pieces of music with variations in texture and instrument type and evaluated them using 18 pairs of semantic words describing sound quality. A factor analysis was conducted to group words influenced by the same latent factor, and a multivariate ANOVA determined the differences in ratings based on texture and instrument type. Radar charts were also drawn based on the identified sets of semantic words. The results showed that four factors were identified, and the word pairs 'soft-hard,' 'dull-sharp,' 'muddy-clean' and 'low-high' showed significant differences based on the level of musical stimuli. The radar charts effectively distinguished the sound quality evaluations for each music. These results indicate that developing Korean semantic words for sound quality evaluation requires a structure different from the previous categories used in Western countries and that linguistic and cultural factors are crucial. This study will provide foundational data for developing a verbal sound quality evaluation framework suited to the Korean context, while reflecting acoustic attributes in music listening.

Applying Polite level Estimation and Case-Based Reasoning to Context-Aware Mobile Interface System (존대등분 계산법과 사례기반추론을 활용한 상황 인식형 모바일 인터페이스 시스템)

  • Kwon, Oh-Byung;Choi, Suk-Jae;Park, Tae-Hwan
    • Journal of Intelligence and Information Systems
    • /
    • v.13 no.3
    • /
    • pp.141-160
    • /
    • 2007
  • User interface has been regarded as a crucial issue to increase the acceptance of mobile services. In special, even though to what extent the machine as speaker communicates with human as listener in a timely and polite manner is important, fundamental studies to come up with these issues have been very rare. Hence, the purpose of this paper is to propose a methodology of estimating politeness level in a certain context-aware setting and then to design a context-aware system for polite mobile interface. We will focus on Korean language for the polite level estimation simply because the polite interface would highly depend on cultural and linguistic characteristics. Nested Minkowski aggregation model, which amends Minkowski aggregation model, is adopted as a privacy-preserving similarity evaluation for case retrieval under distributed computing environment such as ubiquitous computing environment. To show the feasibility of the methodology proposed in this paper, simulation-based experiment with drama cases has performed to show the performance of the methodology proposed in this paper.

  • PDF

Construction of English-Korean Automatic Translation System for Patent Documents Based on Domain Customizing Method (도메인 특화 방법에 의한 영한 특허 자동 번역 시스템의 구축)

  • Choi, Sung-Kwon;Kwon, Oh-Woog;Lee, Ki-Young;Roh, Yoon-Hyung;Park, Sang-Kyu
    • Journal of KIISE:Software and Applications
    • /
    • v.34 no.2
    • /
    • pp.95-103
    • /
    • 2007
  • This paper describes an English-to-Korean automatic translation system for patent documents which is constructed by a method customizing from a general domain to a specific domain. The customizing method consists of following steps: 1) linguistically studying about characteristics of patent documents, 2) extracting unknown words from large patent documents and terminologically constructing, 3) customizing the target language words of existing terms, 4) extracting and constructing patent translation patterns peculiar to patent documents, 5) customizing existing translation engine modules according to linguistic study about characteristics of patent documents, 6) evaluation of automatic translation results. The English-to-Korean patent machine translation system implemented by these customization steps shows a translation accuracy of 81.03% and is improving.

Compilation of the Yonsei English Learner Corpus (YELC) 2011 and Its Use for Understanding Current Usage of English by Korean Pre-university Students (한국 예비 대학생의 영어 사용 특성 파악을 위한 대규모 공개 영어 학습자 코퍼스 구축 및 분석)

  • Rhee, Seok-Chae;Jung, Chae Kwan
    • The Journal of the Korea Contents Association
    • /
    • v.14 no.11
    • /
    • pp.1019-1029
    • /
    • 2014
  • In recent years, researchers have become increasingly interested in the creation and pedagogical use of English learner corpora. Many studies have shown that learner corpora can not only make a significant contribution to second language acquisition research but also contribute to the construction and evaluation of language tests by advancing our understanding of English learners. So far, however, little attention has been paid to the Korean EFL (English as a foreign language) learners' corpus. The Yonsei English Learner Corpus (YELC 2011) is a specialized, monolingual, and synchronic Korean EFL learner corpus that was developed by Yonsei University from 2011 to 2012. Over 3,000 Korean high school graduates (or equivalents) who were accepted by Yonsei University for their further studies participated in this project. It consists of 6,572 written texts (1,085,828 words) at nine different English proficiency levels. In this paper, we describe its compilation, and more specifically, how we have corpusized from a text archive to a corpus. After introducing the process of corpusization, we report arresting insights into the specific linguistic features that different proficiency levels of Korean learners of English have. This study also discusses the potential use of the YELC 2011 which is now freely available for research purposes.

An Adaptive Tutoring System based on Fuzzy sets for Learning by Level (수준별 학습을 위한 퍼지 집합 기반 적응형 교수 시스템)

  • Choi, Sook-Young;So, Ji-Sook;Lee, Sun-Jung
    • The Journal of Korean Association of Computer Education
    • /
    • v.6 no.2
    • /
    • pp.121-135
    • /
    • 2003
  • This paper proposes a web-based adaptive tutoring system based on fuzzy set that provides learning materials and questions dynamically according to students' knowledge state, and gives advices for the learning after an evaluation. For this, we design a courseware knowledge structure systematically and then construct a fuzzy level set on the basis of it considering importance of learning targets, difficulty of learning materials and relation degree between learning targets and learning materials. Using the fuzzy level set, our system offers learning materials and questions to adapt to individual students. Moreover, a result of the test is evaluated with fuzzy linguistic variable. Appling the fuzzy concept to the tutoring system could naturally consider and deal with various and uncertain items of learning environment thus could offer more flexible and effective instruction-learning methods.

  • PDF

Evaluation of the Korean Version of Physical Activity Scale for the Elderly (K-PASE) (한국판 노인 신체활동 측정도구(Korean version of Physical Activity Scale for the Elderly: K-PASE)의 평가)

  • Choe, Myoung-Ae;Kim, Jeung-Im;Jeon, Mi-Yang;Chae, Young-Ran
    • Women's Health Nursing
    • /
    • v.16 no.1
    • /
    • pp.47-59
    • /
    • 2010
  • Purpose: The purpose of this study was to develop a Korean version of Physical Activity Scale for the Elderly (K-PASE) from PASE and to evaluate the validity and reliability of the K-PASE. This scale was originally developed by Washburn et al. (1993). A valid and reliable physical activity scale for the elderly is needed to assess accurately physical activity of the elderly, because there has been no valid and reliable physical activity scale for the elderly in Korea. Methods: The K-PASE was developed from PASE through linguistic validation and cultural adaptation for use with this population. Convenient sampling was used to recruit participants. Reliability was evaluated by conducting the test-retest and convergent validity was evaluated by Pearson correlation. Results: Test-retest reliability, assessed over a 2 week interval, was r=.94. Convergent validity was established by correlating the KPASE scores between related variables which were the Tokyo Metropolitan Institute of Gerontology Index of Competence (TMIG-IC) and hand-grip strength. Scores of the K-PASE had a low significant correlation with TMIG-IC (r=.246, p<.001), and hand-grip strength (r=.251, p<.001). The mean score of physical activity of Korean elderly assessed by the K-PASE was 96.5. Conclusion: We conclude that the K-PASE is a reliable and valid instrument to assess physical activity for Korean elderly.

Using Fuzzy Numbers in Quality Function Deployment Optimization (QFD 최적화에서 퍼지 넘버의 이용)

  • Yoo, Jaewook
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.39 no.2
    • /
    • pp.138-149
    • /
    • 2016
  • Quality function deployment (QFD) is a widely adopted customer-oriented product development methodology by translating customer requirements (CRs) into technical attributes (TAs), and subsequently into parts characteristics, process plans, and manufacturing operations. A main activity in QFD planning process is the determination of the target levels of TAs of a product so as to achieve a high level of customer satisfaction using the data or information included in the houses of quality (HoQ). Gathering the information or data for a HoQ may involve various inputs in the form of linguistic data which are inherently vague, or human perception, judgement and evaluation for the information and data. This research focuses on how to deal with this kind of impreciseness in QFD optimization. In this paper, it is assumed as more realistic situation that the values of TAs are taken as discrete, which means each TA has a few alternatives, as well as the customer satisfaction level acquired by each alternative of TAs and related cost are determined based on subjective or imprecise information and/or data. To handle these imprecise information and/or data, an approach using some basic definitions of fuzzy sets and the signed distance method for ranking fuzzy numbers is proposed. An example of a washing machine under two-segment market is provided for illustrating the proposed approach, and in this example, the difference between the optimal solution from the fuzzy model and that from the crisp model is compared as well as the advantage of using the fuzzy model is drawn.

Linguistic Analysis of Human Sensibility in Various Pictorial Images (사진 이미지의 감성에 대한 언어적 분석)

  • Noh, Yeon-Sook;Har, Dong-Hwan
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.2
    • /
    • pp.182-195
    • /
    • 2012
  • Pictorial Images are often used when persuading someone, since people believe that photographs tell us what happened in reality. This paper aims to strengthen the role of pictorial images as a powerful method of persuasion through interpolating sensibility, which is a key factor in decision making, into the pictorial images. This paper analyses the structure of sensibility in pictorial images, in order to draw out specific factors that arouse positive impression. Furthermore, intensional meanings were given to various factors that compose the sensibility of pictorial images, and the factors are prioritized to enhance applicability. Recognitions of the sensibility in pictorial images differ due to diverse variables, but the photographed subjects themselves and the specific attributes of picture quality are the primary factors that influence the recognition. In order to achieve general and detailed results, broadly selected shooting subjects and images that have various picture quality attributes.

Reliability of the Neck Pain and Disability Scale in Neck Pain Patients (경통 환자들을 위한 Neck Pain and Disability Scale의 신뢰도 연구)

  • Shin, Won-Seob;Lee, Eun-Woo;Jung, Kyoung-Sim;Lee, Suk-Min;Chung, Yi-Jung
    • Physical Therapy Korea
    • /
    • v.15 no.1
    • /
    • pp.77-85
    • /
    • 2008
  • The self-report measure is a useful tool for evaluating self-recognized disability and difficulty in daily living activities. Although many studies and clinics used the Neck Pain and Disability Scale (NPDS) for measuring neck pain and functional impairment, there has not been much adaptation of this for use with Korean patients. The purpose of this study was to establish the reliability and validity of NPDS among Korean neck pain patients. Fifty-five subjects (32 males, 23 females) with neck pain enrolled in this study. They completed standardized self-administered questionnaires. The NPDS measures pain intensity; its interference with vocational, emotional, recreational, social, and functional aspects of living; and the presence and extent of associated factors. Reliability was determined by the intraclass correlation coefficient (ICC) and Cronbach's alpha for internal consistency. Validity was examined by correlating the NPDS scores to the Visual Analog Scale (VAS) score. The test-retest reliability of the translated versions of the NPDS was good ICC (2,1)=.86 (95%CI .76~.92). Cronbach's alpha value for NPDS was found to be .93, and this was statistically significant (p<.05). The criterion-related validity coefficient was .79 (p<.Oll. We conclude that the Korean version of NPDS has been shown to be a reliable and valid instrument for the assessment of neck pain. Successful linguistic and cultural translation will admit appropriate cross-cultural comparison for clinical analysis. Therefore, this study can be expected to be used as an adequate evaluation scale for neck pain related studies and treatments.

  • PDF