• 제목/요약/키워드: relevance evaluation

검색결과 291건 처리시간 0.027초

A Text Similarity Measurement Method Based on Singular Value Decomposition and Semantic Relevance

  • Li, Xu;Yao, Chunlong;Fan, Fenglong;Yu, Xiaoqiang
    • Journal of Information Processing Systems
    • /
    • 제13권4호
    • /
    • pp.863-875
    • /
    • 2017
  • The traditional text similarity measurement methods based on word frequency vector ignore the semantic relationships between words, which has become the obstacle to text similarity calculation, together with the high-dimensionality and sparsity of document vector. To address the problems, the improved singular value decomposition is used to reduce dimensionality and remove noises of the text representation model. The optimal number of singular values is analyzed and the semantic relevance between words can be calculated in constructed semantic space. An inverted index construction algorithm and the similarity definitions between vectors are proposed to calculate the similarity between two documents on the semantic level. The experimental results on benchmark corpus demonstrate that the proposed method promotes the evaluation metrics of F-measure.

제7차 초등학교 과학과 교육과정 내용의 적정성 분석 및 평가 (Analysis and Evaluation of the Content Relevance in the 7th National Primary Science Curriculum)

  • 이양락;박재근;이봉우;한인옥
    • 한국초등과학교육학회지:초등과학교육
    • /
    • 제24권3호
    • /
    • pp.214-225
    • /
    • 2005
  • The purpose of this study was to examine the content relevance of the 7th national primary science curriculum and textbooks. To fulfill the purpose of the study, we 1) analyzed the 7th national science curriculum of Korea, Californian science standards, the national science curriculum of England and Japan, and current Korean and Japanese science textbooks, 2) conducted a nationwide survey to gather opinions from students, teachers, and professors of teachers colleges about the relevance of the science curriculum and textbooks. Main findings of this study are as follows: First, the science contents at each grade level should be determined by the students' characteristics, not by an equal portion rule among physics, chemistry, biology and earth science. Second, the excessive overlapping and repetition of contents due to the spiral curriculum should be avoid. Third, the number of topics at each grade level should be reduced, and the similar topics and themes should be integrated for students' deeper understanding. Fourth, the number of science concepts and activities should be reduced to an appropriate level considering the time allotment for science classes, teachers workload, laboratory conditions, etc. Fifth, differentiated curriculum, such as in-depth and supplementary course, should be described not in science contents, but in teaching and learning strategy.

  • PDF

정보검색효율에 관한 연구 (A Study on the Effectiveness of Information Retrieval)

  • 윤구호
    • 한국문헌정보학회지
    • /
    • 제8권
    • /
    • pp.73-101
    • /
    • 1981
  • Retrieval effectiveness is the principal criterion for measuring the performance of an information retrieval system. The effectiveness of a retrieval system depends primarily on the extent to which it can retrieve wanted documents without retrieving unwanted ones. So, ultimately, effectiveness is a function of the relevant and nonrelevant documents retrieved. Consequently, 'relevance' of information to the user's request has become one of the most fundamental concept encountered in the theory of information retrieval. Although there is at present no consensus as to how this notion should be defined, relevance has been widely used as a meaningful quantity and an adequate criterion for measures of the evaluation of retrieval effectiveness. The recall and precision among various parameters based on the 'two-by-two' table (or, contingency table) were major considerations in this paper, because it is assumed that recall and precision are sufficient for the measurement of effectiveness. Accordingly, different concepts of 'relevance' and 'pertinence' of documents to user requests and their proper usages were investigated even though the two terms have unfortunately been used rather loosely in the literature. In addition, a number of variables affecting the recall and precision values were discussed. Some conclusions derived from this study are as follows: Any notion of retrieval effectiveness is based on 'relevance' which itself is extremely difficult to define. Recall and precision are valuable concepts in the study of any information retrieval system. They are, however, not the only criteria by which a system may be judged. The recall-precision curve represents the average performance of any given system, and this may vary quite considerably in particular situations. Therefore, it is possible to some extent to vary the indexing policy, the indexing policy, the indexing language, or the search methodology to improve the performance of the system in terms of recall and precision. The 'inverse relationship' between average recall and precision could be accepted as the 'fundamental law of retrieval', and it should certainly be used as an aid to evaluation. Finally, there is a limit to the performance(in terms of effectiveness) achievable by an information retrieval system. That is : "Perfect retrieval is impossible."

  • PDF

시소러스의 연관성 정보를 이용한 문서의 순위 결정 방법 (Document ranking methods using term dependencies from a thesaurus)

  • 이준호
    • 정보관리학회지
    • /
    • 제10권2호
    • /
    • pp.3-22
    • /
    • 1993
  • 최근 시소러스를 기반으로 하는 불리안 검색 시스템에서 문서의 순위 결정에 사용 될 수 있는 Relevance, R-distance, K-distance와 같은 방법들이 개발되었다. 이러한 방법들은 색인어들 사이의 연관성 정보를 이용하여 문서들의 순위를 결정함으로써 많은 경우에 높은 검색 효율을 제공할 지라도, 불리안 연산자 AND, OR, NOT에 대한 연산 방법이 문제점으로 지적되어왔다. 본 논문에서는 개선된 퍼지 집합 모델과 확장된 불리안 모델을 시소러스가 제공하는 색인어들 사이의 연관성 정보를 효율적으로 이용할 수 있도록 확장함으로써, 기존 방법들의 문제점을 극복하는 새로운 순위 결정 방법 KB-FSM과 KB-EBM을 제안한다. 또한 KB-FSM과 KB-EBM이 Relevance, R-distance, K-distance보다 문서들의 순위를 보다 정확하게 결정함을 성능 비교를 통하여 입증한다.

  • PDF

공학계열 대학생의 전공만족도 영향 요인 탐색 : T 대학교를 중심으로 (Exploring the Factors Influencing Major Satisfaction of Engineering College Students : Focusing on T University)

  • 유현주
    • 공학교육연구
    • /
    • 제27권1호
    • /
    • pp.41-49
    • /
    • 2024
  • The purpose of this study is to explore ways to improve major satisfaction that can be applied by universities through the analysis of factors influencing major satisfaction of engineering college students. To this end, Korea-National Survey of Student Engagement(K-NSSE) data involving 814 students from T University were used, and logistic regression analysis and t-test were applied. The main results obtained through this are as follows. First, engineering college students' major satisfaction factors include major-career relevance, college immersion, and positive academic sentiment. Second, depending on the grade, it was confirmed that the factor of major-career relevance in the lower grades, and the factors of meaningful learning experience and college immersion in addition to major-career relevance in the upper grades had a significant influence. Third, the higher the meaningful learning experience, positive academic sentiment, and college immersion, including the major-career relevance, the higher the major satisfaction was found in the middle-class group with a score of BO or higher. This study is meaningful in that it revealed differences in influence by individual characteristics as well as major satisfaction influencing factors that can be practiced in universities such as learning experiences.

실내색채의 공간효과에 관한 실험연구 - 거실의 천장 , 벽 , 바닥 색채를 중심으로 - (An Experimental Study on the Spatial Effects of Colours - with relevance to colours of ceilings , walls and floors in living rooms -)

  • 조원덕
    • 한국주거학회논문집
    • /
    • 제3권2호
    • /
    • pp.13-19
    • /
    • 1992
  • The purpose of this study is to grasp spatial effects of colours in interior design. The visual feeling in the 1/10 living room scale models that are different in the colour combination of ceilings, walls and floors is judged using a semantic scale of the fifteen adjectives. The major findings are as follows; 1) As a result of factor analysis, three dimensions, "evaluation", "activity" and "warmness" are extracted. Dimension 1, "evaluation", is most greatly affected by the chroma and hue of the room colour, dimension 2, "activity", by the hue and value, by the difference in hue and value of ceilings, walls and floors, dimensions 3, "warmness", by mainly the hue of the rooms. 2) Concerning the spatial effects of colour, the subjects felt higher vlaue with relevance to the hue of GY, Y, low chroma and high value. The room colours other than walls is felt more comfortable in similar colour, especially hue and value.re comfortable in similar colour, especially hue and value.

  • PDF

User Perceptions of Uncertainty in the Evaluation of Search Results

  • Kim, Yang-Woo
    • International Journal of Contents
    • /
    • 제8권1호
    • /
    • pp.100-107
    • /
    • 2012
  • While considerable research suggests that users' uncertainty gradually decreases, as they proceed through the information seeking process, others argue that it can arise at any stage of their information seeking process. Reflecting the latter view, this study examined user perceptions of uncertainty in the final stage of users' information seeking process, the stage of search results evaluation. Considering the significance of Web search engines for academic study, this study investigated the relevance decision stage of scholarly researchers in the field of science, who use Web search engines for their academic study. Based on the analysis of the users' uncertainty, this study provided implications to improve information systems and Web contents design.

검색효율 측정척도에 관한 연구 (A Study on measuring techniques of retrieval effectiveness)

  • 윤구호
    • 한국문헌정보학회지
    • /
    • 제16권
    • /
    • pp.177-205
    • /
    • 1989
  • Retrieval effectiveness is the principal criteria for measuring the performance of an information retrieval system. This paper deals with the characteristics of 'relevance' of information and various measuring techniques of retrieval effectivess. The outlines of this study are as follows: 1) Relevance decision for evaluation should be devided into the user-oriented and the system-oriented decisions. 2) The recall-precision measure seems to be user-oriented, and the recall-fallout measure to be system-oriented. 3) Many of composite measures can not be justified III any rational manner unfortunately. 4) The Swets model has demonstrated that it yields, in general, a straight line instead of a curve of varying curvature and emphasized the fundamentally probabilistic nature of information retrieval. 5) The Cooper model seems to be a good substitute for precision and a useful measure for systems which ranked documents. 6) The Rocchio model were proposed for the evaluation of retreval systems which ranked documents, and were designed to be independent of cut-off. 7) The Cawkell model suggested that the Shannon's equation for entropy can be applied to measuring of retrieval effectiveness.

  • PDF

부합성 분석을 이용한 정보화지원사업 성과평가지표의 합리적 도출 방안 (A Rational Development Way of Performance Evaluation Measures for the Informatization Program by means of the Coincidence Analysis)

  • 최점기;박일규;김상훈
    • Journal of Information Technology Applications and Management
    • /
    • 제13권3호
    • /
    • pp.145-179
    • /
    • 2006
  • The measurement of informatization program effectiveness continues to be a central concern of both academics and practitioners. However, most studies of it have been inclined too heavily toward testing validity and reliability of evaluation measure to strengthen the theoretical rigor. Drawbacks of this approach have been pointed out as being unsuitable for evaluating the effectiveness of informatization program due to lack of practical relevance. The paper comprises four sections to solve the problem. 1) Through literature review of theoretical conceptual models in IS effectiveness and the domestic and foreign cases on informatization program, we establish the evaluation framework which consists of evaluation phases, 6 evaluation areas, and 22 evaluation items, and developed evaluation measures of each items. 2) Different researchers have addressed different aspects of attribute of measure. With comparing them to each other, 3 mutually exclusive criteria on coincidence analysis(usability of measurement. reliability of measurement. and validity of content) are identified. 3) Data are gathered from respondents in informatizaiton program-related organizations such as policy agency, management agency, support agency, and recipient agency. 4) The degree of coincidence of each evaluation measure are analyzed by course of an coincidence analysis procedure, which includes the reliability test, arithmetical test, and criteria validity test. The academic implication of this study is that researchers can gain an insight into the coincidence analysis to approach the problem of deciding on an indicator of performance for informatization program. There is also practical implication for applying the potential means of improving the practical relevance of conducting evaluating the informatization program.

  • PDF

제7차 과학과 교육과정 지구과학 내용의 적정성 분석 및 평가 (Analysis and Evaluation of the Earth Science Content Relevance in the 7th National Science Curriculum)

  • 이양락;곽영순;김동영
    • 한국지구과학회지
    • /
    • 제26권8호
    • /
    • pp.759-770
    • /
    • 2005
  • 본 연구의 목적은 제7차 교육과정 지구과학 내용의 적정성을 평가하는 것이다. 이를 위해 교육과정 분석(우리나라, 미국 캘리포리아주, 영국, 일본), 우리나라와 일본 교과서의 지구과학 내용 분석과 초 중등학생, 교사, 교수, 교과서 저자에 대한 광범위한 설문조사를 실시하였다 제7차 교육과정의 지구과학 내용은 과학과 4개 영역의 균등 분배, 단원의 세분화로 인한 내용구성과 연계성 부족, 그리고 나선형 교육과정의 과도한 적용, 지나친 탐구활동 중심의 교과서 내용구성으로 인한 학습량 증가와 체계적 개념 지도의 어려움 등으로 인해 적정하게 구성되어 있지 않다고 평가할 수 있다. 이를 해결하고 지구과학 영역 내용 적정성을 확보하기 위한 방안으로는 첫째, 내용 구성 및 연계 측면에서 볼 때, 각 학년에서 다루게 되는 내용을 과학 4개 영역으로 균등하게 분배하지 말고, 단원의 크기를 다양화해야 한다. 둘째, 학습량 측면에서는 나선형 교육과정의 구성 방식을 탈피하여 학년 수준에 맞는 내용은 해당 학년에서 종료되도록 하여 학년간에 중복이 되지 않도록 해야 하고, 필수 탐구활동의 수를 줄이고 질을 높여야 한다. 셋째, 내용의 수준과 흥미 측면에서, 학생들의 지구과학에 대한 흥미를 제고할 수 있도록 자연재해, 안전, 우주 관련 분야, 자원 등을 강조해야 한다. 아울러 교육 내용 적정성의 평가 준거 중의 하나가 실현 가능성임을 고려할 때, 교육과정이 추구하는 목표가 학교 현장에서 실현될 수 있도록 주변 여건에 대한 지원이 선행되어야 할 것이다.