• Title/Summary/Keyword: relevance evaluation

Search Result 291, Processing Time 0.03 seconds

A Text Similarity Measurement Method Based on Singular Value Decomposition and Semantic Relevance

  • Li, Xu;Yao, Chunlong;Fan, Fenglong;Yu, Xiaoqiang
    • Journal of Information Processing Systems
    • /
    • v.13 no.4
    • /
    • pp.863-875
    • /
    • 2017
  • The traditional text similarity measurement methods based on word frequency vector ignore the semantic relationships between words, which has become the obstacle to text similarity calculation, together with the high-dimensionality and sparsity of document vector. To address the problems, the improved singular value decomposition is used to reduce dimensionality and remove noises of the text representation model. The optimal number of singular values is analyzed and the semantic relevance between words can be calculated in constructed semantic space. An inverted index construction algorithm and the similarity definitions between vectors are proposed to calculate the similarity between two documents on the semantic level. The experimental results on benchmark corpus demonstrate that the proposed method promotes the evaluation metrics of F-measure.

Analysis and Evaluation of the Content Relevance in the 7th National Primary Science Curriculum (제7차 초등학교 과학과 교육과정 내용의 적정성 분석 및 평가)

  • Lee Yang-Rak;Part Jae-Keun;Lee Bong-Woo;Han In-Ok
    • Journal of Korean Elementary Science Education
    • /
    • v.24 no.3
    • /
    • pp.214-225
    • /
    • 2005
  • The purpose of this study was to examine the content relevance of the 7th national primary science curriculum and textbooks. To fulfill the purpose of the study, we 1) analyzed the 7th national science curriculum of Korea, Californian science standards, the national science curriculum of England and Japan, and current Korean and Japanese science textbooks, 2) conducted a nationwide survey to gather opinions from students, teachers, and professors of teachers colleges about the relevance of the science curriculum and textbooks. Main findings of this study are as follows: First, the science contents at each grade level should be determined by the students' characteristics, not by an equal portion rule among physics, chemistry, biology and earth science. Second, the excessive overlapping and repetition of contents due to the spiral curriculum should be avoid. Third, the number of topics at each grade level should be reduced, and the similar topics and themes should be integrated for students' deeper understanding. Fourth, the number of science concepts and activities should be reduced to an appropriate level considering the time allotment for science classes, teachers workload, laboratory conditions, etc. Fifth, differentiated curriculum, such as in-depth and supplementary course, should be described not in science contents, but in teaching and learning strategy.

  • PDF

A Study on the Effectiveness of Information Retrieval (정보검색효율에 관한 연구)

  • Yoon Koo-ho
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.8
    • /
    • pp.73-101
    • /
    • 1981
  • Retrieval effectiveness is the principal criterion for measuring the performance of an information retrieval system. The effectiveness of a retrieval system depends primarily on the extent to which it can retrieve wanted documents without retrieving unwanted ones. So, ultimately, effectiveness is a function of the relevant and nonrelevant documents retrieved. Consequently, 'relevance' of information to the user's request has become one of the most fundamental concept encountered in the theory of information retrieval. Although there is at present no consensus as to how this notion should be defined, relevance has been widely used as a meaningful quantity and an adequate criterion for measures of the evaluation of retrieval effectiveness. The recall and precision among various parameters based on the 'two-by-two' table (or, contingency table) were major considerations in this paper, because it is assumed that recall and precision are sufficient for the measurement of effectiveness. Accordingly, different concepts of 'relevance' and 'pertinence' of documents to user requests and their proper usages were investigated even though the two terms have unfortunately been used rather loosely in the literature. In addition, a number of variables affecting the recall and precision values were discussed. Some conclusions derived from this study are as follows: Any notion of retrieval effectiveness is based on 'relevance' which itself is extremely difficult to define. Recall and precision are valuable concepts in the study of any information retrieval system. They are, however, not the only criteria by which a system may be judged. The recall-precision curve represents the average performance of any given system, and this may vary quite considerably in particular situations. Therefore, it is possible to some extent to vary the indexing policy, the indexing policy, the indexing language, or the search methodology to improve the performance of the system in terms of recall and precision. The 'inverse relationship' between average recall and precision could be accepted as the 'fundamental law of retrieval', and it should certainly be used as an aid to evaluation. Finally, there is a limit to the performance(in terms of effectiveness) achievable by an information retrieval system. That is : "Perfect retrieval is impossible."

  • PDF

Document ranking methods using term dependencies from a thesaurus (시소러스의 연관성 정보를 이용한 문서의 순위 결정 방법)

  • 이준호
    • Journal of the Korean Society for information Management
    • /
    • v.10 no.2
    • /
    • pp.3-22
    • /
    • 1993
  • In recent years various document ranking methods such as Relevance. R-Distance and K-Distance have been developed wh~ch can be used in thesaurus-based boolean retrieval systems. They give high quality document rankings in many cases by using term dependence lnformatlon from a thesaurus. However, they suffer from several problems resulting from inefficient and Ineffective evaluation of boolean operators AND. OR and NOT. In this paper we propose new thesaurus-based document ranking methods called KB-FSM and KB-EBM by exploitmg the enhanced fuzzy set model and the extended boolean model. The proposed methods overcome the problems of the previous methods and use term dependencies from a thesaurs effectively. We also show through performance comparison that KB-FSM and KBEBM provide higher retrieval effectiveness than Relevance. R-D~stance and K-Distance.

  • PDF

Exploring the Factors Influencing Major Satisfaction of Engineering College Students : Focusing on T University (공학계열 대학생의 전공만족도 영향 요인 탐색 : T 대학교를 중심으로)

  • You, Hyunjoo
    • Journal of Engineering Education Research
    • /
    • v.27 no.1
    • /
    • pp.41-49
    • /
    • 2024
  • The purpose of this study is to explore ways to improve major satisfaction that can be applied by universities through the analysis of factors influencing major satisfaction of engineering college students. To this end, Korea-National Survey of Student Engagement(K-NSSE) data involving 814 students from T University were used, and logistic regression analysis and t-test were applied. The main results obtained through this are as follows. First, engineering college students' major satisfaction factors include major-career relevance, college immersion, and positive academic sentiment. Second, depending on the grade, it was confirmed that the factor of major-career relevance in the lower grades, and the factors of meaningful learning experience and college immersion in addition to major-career relevance in the upper grades had a significant influence. Third, the higher the meaningful learning experience, positive academic sentiment, and college immersion, including the major-career relevance, the higher the major satisfaction was found in the middle-class group with a score of BO or higher. This study is meaningful in that it revealed differences in influence by individual characteristics as well as major satisfaction influencing factors that can be practiced in universities such as learning experiences.

An Experimental Study on the Spatial Effects of Colours - with relevance to colours of ceilings , walls and floors in living rooms - (실내색채의 공간효과에 관한 실험연구 - 거실의 천장 , 벽 , 바닥 색채를 중심으로 -)

  • 조원덕
    • Journal of the Korean housing association
    • /
    • v.3 no.2
    • /
    • pp.13-19
    • /
    • 1992
  • The purpose of this study is to grasp spatial effects of colours in interior design. The visual feeling in the 1/10 living room scale models that are different in the colour combination of ceilings, walls and floors is judged using a semantic scale of the fifteen adjectives. The major findings are as follows; 1) As a result of factor analysis, three dimensions, "evaluation", "activity" and "warmness" are extracted. Dimension 1, "evaluation", is most greatly affected by the chroma and hue of the room colour, dimension 2, "activity", by the hue and value, by the difference in hue and value of ceilings, walls and floors, dimensions 3, "warmness", by mainly the hue of the rooms. 2) Concerning the spatial effects of colour, the subjects felt higher vlaue with relevance to the hue of GY, Y, low chroma and high value. The room colours other than walls is felt more comfortable in similar colour, especially hue and value.re comfortable in similar colour, especially hue and value.

  • PDF

User Perceptions of Uncertainty in the Evaluation of Search Results

  • Kim, Yang-Woo
    • International Journal of Contents
    • /
    • v.8 no.1
    • /
    • pp.100-107
    • /
    • 2012
  • While considerable research suggests that users' uncertainty gradually decreases, as they proceed through the information seeking process, others argue that it can arise at any stage of their information seeking process. Reflecting the latter view, this study examined user perceptions of uncertainty in the final stage of users' information seeking process, the stage of search results evaluation. Considering the significance of Web search engines for academic study, this study investigated the relevance decision stage of scholarly researchers in the field of science, who use Web search engines for their academic study. Based on the analysis of the users' uncertainty, this study provided implications to improve information systems and Web contents design.

A Study on measuring techniques of retrieval effectiveness (검색효율 측정척도에 관한 연구)

  • Yoon Koo Ho
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.16
    • /
    • pp.177-205
    • /
    • 1989
  • Retrieval effectiveness is the principal criteria for measuring the performance of an information retrieval system. This paper deals with the characteristics of 'relevance' of information and various measuring techniques of retrieval effectivess. The outlines of this study are as follows: 1) Relevance decision for evaluation should be devided into the user-oriented and the system-oriented decisions. 2) The recall-precision measure seems to be user-oriented, and the recall-fallout measure to be system-oriented. 3) Many of composite measures can not be justified III any rational manner unfortunately. 4) The Swets model has demonstrated that it yields, in general, a straight line instead of a curve of varying curvature and emphasized the fundamentally probabilistic nature of information retrieval. 5) The Cooper model seems to be a good substitute for precision and a useful measure for systems which ranked documents. 6) The Rocchio model were proposed for the evaluation of retreval systems which ranked documents, and were designed to be independent of cut-off. 7) The Cawkell model suggested that the Shannon's equation for entropy can be applied to measuring of retrieval effectiveness.

  • PDF

A Rational Development Way of Performance Evaluation Measures for the Informatization Program by means of the Coincidence Analysis (부합성 분석을 이용한 정보화지원사업 성과평가지표의 합리적 도출 방안)

  • Choi Jeom-Ki;Park Il-Kyu;Kim Sang-Hoon
    • Journal of Information Technology Applications and Management
    • /
    • v.13 no.3
    • /
    • pp.145-179
    • /
    • 2006
  • The measurement of informatization program effectiveness continues to be a central concern of both academics and practitioners. However, most studies of it have been inclined too heavily toward testing validity and reliability of evaluation measure to strengthen the theoretical rigor. Drawbacks of this approach have been pointed out as being unsuitable for evaluating the effectiveness of informatization program due to lack of practical relevance. The paper comprises four sections to solve the problem. 1) Through literature review of theoretical conceptual models in IS effectiveness and the domestic and foreign cases on informatization program, we establish the evaluation framework which consists of evaluation phases, 6 evaluation areas, and 22 evaluation items, and developed evaluation measures of each items. 2) Different researchers have addressed different aspects of attribute of measure. With comparing them to each other, 3 mutually exclusive criteria on coincidence analysis(usability of measurement. reliability of measurement. and validity of content) are identified. 3) Data are gathered from respondents in informatizaiton program-related organizations such as policy agency, management agency, support agency, and recipient agency. 4) The degree of coincidence of each evaluation measure are analyzed by course of an coincidence analysis procedure, which includes the reliability test, arithmetical test, and criteria validity test. The academic implication of this study is that researchers can gain an insight into the coincidence analysis to approach the problem of deciding on an indicator of performance for informatization program. There is also practical implication for applying the potential means of improving the practical relevance of conducting evaluating the informatization program.

  • PDF

Analysis and Evaluation of the Earth Science Content Relevance in the 7th National Science Curriculum (제7차 과학과 교육과정 지구과학 내용의 적정성 분석 및 평가)

  • Lee, Yang-Rak;Kwak, Young-Sun;Kim, Dong-Young
    • Journal of the Korean earth science society
    • /
    • v.26 no.8
    • /
    • pp.759-770
    • /
    • 2005
  • The purpose of this study is to examine the Earth science content relevance of the 7th national science curriculum. For this purpose, we (1) analyzed science curriculum or content standards of Korea, California, England and Japan, (2) compared science textbooks of Korea and Japan, (3) conducted a nationwide survey to gather opinions from students, teachers, professors and textbook authors about the relevance of the science curriculum and textbooks. According to the results, the Earth science contents of the 7th national science curriculum were not appropriate in terms of the objectives of science curriculum and the needs of students and society. The main reasons include the equal division among physics, chemistry, biology and earth science, iack of connection due to fractionation of units, overly strict application of spiral curriculum, and redundant amount of activities and concepts to cover in the textbook. Major suggestions fir securing the relevance of Earth science contents are as follows: First, the science contents and the size of units at each grade level should be determined according to the students' characteristics, not by equal portion rule. Second, the excessive overlapping and repetition of contents due to the spiral curriculum should be avoided. In addition, the number of activities should be reduced and the quality of required science activities should be improved. Third, to raise students' interest in Earth science, real-life applications and real-world Earth science contents should be emphasized including natural disasters, safety, universe and space exploration, and natural resources. Lastly, considering one of the relevance criteria is feasibility, supports for schools and science teachers are needed to realize the goal of the intended science curriculum.