• Title/Summary/Keyword: relevance consistency

Search Result 33, Processing Time 0.014 seconds

An Experimental Study on the Effect of Domain Expertise on the Consistency of Relevance Judgements (주제전문지식이 적합성판정의 일관성에 미치는 영향에 관한 실험적 연구)

  • Scholten, Stacey;Moon, Sung-Been
    • Journal of the Korean Society for information Management
    • /
    • v.38 no.3
    • /
    • pp.1-22
    • /
    • 2021
  • An online experiment was conducted to test the subject-knowledge view of relevance theory in order to find evidence of a conceptual basis for relevance. Six experts in Library and Information Science (LIS), nine Master's students of LIS, and twelve non-experts judged the relevance of 14 abstracts within and outside of the LIS domain. Consistency among the judges was calculated by joint-probability agreement (PA) and interclass correlation coefficients (ICC). When using PA to analyze the judgements, non-experts had a higher consensus regardless of the task or division of groups. However, ICC calculations found Master's candidates had a higher level of consensus than non-experts within LIS, although the experts did not; and the agreement rates on the non-LIS task for all groups were only poor to moderate. It was only when the groups were analyzed as two groups (experts including Master's candidates and non-experts) that the expected trend of higher consistency among experts in the LIS task was seen.

Emotion-Based Music Retrieval Using Consistency Principle and Multi-Query Feedback (검색의 일관성원리와 피드백을 이용한 감성기반 음악 검색 시스템)

  • Shin, Song-Yi;Park, En-Jong;Eum, Kyoung-Bae;Lee, Joon-Whoan
    • The KIPS Transactions:PartB
    • /
    • v.17B no.2
    • /
    • pp.99-106
    • /
    • 2010
  • In this paper, we propose the construction of multi-queries and consistency principle for the user's emotion-based music retrieval system. The features used in the system are MPEG-7 audio descriptors, which are international standards recommended for content-based audio retrievals. In addition we propose the method to determine the weight that represent the importance of each descriptor for each emotion in order to reduce the computation. Also, the proposed retrieval algorithm that uses the relevance feedback based on consistency principal and multi-queries improves the success ratio of musics corresponding to user's emotion.

An Automated Topic Specific Web Crawler Calculating Degree of Relevance (연관도를 계산하는 자동화된 주제 기반 웹 수집기)

  • Seo Hae-Sung;Choi Young-Soo;Choi Kyung-Hee;Jung Gi-Hyun;Noh Sang-Uk
    • Journal of Internet Computing and Services
    • /
    • v.7 no.3
    • /
    • pp.155-167
    • /
    • 2006
  • It is desirable if users surfing on the Internet could find Web pages related to their interests as closely as possible. Toward this ends, this paper presents a topic specific Web crawler computing the degree of relevance. collecting a cluster of pages given a specific topic, and refining the preliminary set of related web pages using term frequency/document frequency, entropy, and compiled rules. In the experiments, we tested our topic specific crawler in terms of the accuracy of its classification, crawling efficiency, and crawling consistency. First, the classification accuracy using the set of rules compiled by CN2 was the best, among those of C4.5 and back propagation learning algorithms. Second, we measured the classification efficiency to determine the best threshold value affecting the degree of relevance. In the third experiment, the consistency of our topic specific crawler was measured in terms of the number of the resulting URLs overlapped with different starting URLs. The experimental results imply that our topic specific crawler was fairly consistent, regardless of the starting URLs randomly chosen.

  • PDF

Methodological Problems in Information Retrieval Research (정보검색 연구의 방법론에 관한 고찰)

  • 이명희
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.7 no.1
    • /
    • pp.231-246
    • /
    • 1994
  • A major problem for information retrieval research in the past three decades has been methodology, even though some progress has been made in obtaining useful results from methodologically sound experiments. Within a methodology, potential problems include artificial data generated by the researcher, small sample size interpretation of findings. Critics have pointed out that some room exists for improving methodology of information retrieval research; using existing data, having big enough sample size, including large numbers of search queries, introducing more control in relation to variables, utilizing more appropriate performance measures, conducting rests carefully and evaluating findings properly. Relevance judgments depend entirely on the perception of the user and on the situation of the moment. In an experiment, the best judge of relevance is a user with a well defined information need. Normally more than two categories for relevance judgments are desirable becase there are degrees of relevance. In experimental design, careful control of variables is meeded for internal validity. When no single database exists for comparison, existing operational databases should be used cautiously, Careful control for the variations of search queries, inter-searcher sonsistency, intra-searcher consistency and search strategies is necessary. Parametric statistics requiring rigid assumptions are not appropriate in information retrieval research and non-parametric statistics requiring few assumptions are necessary. Particularly, the sign test and the Wilcoxon test are good alternatives.

  • PDF

An Evaluative study on information quality of ASKERIC databases (ASKERIC 데이터베이스의 품질에 관한 연구)

  • 이명희
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.9 no.1
    • /
    • pp.221-240
    • /
    • 1998
  • This study concerns information quality of the database which has been produced in the ASKERIC database. The measures used in this study were accuracy of the records. consistency, completeness and currency. Accuracy was measurred in terms of the keywords used in different ways in the US and Britain and the spelling errors in the records. Consistency was measured in terms of 'see also' and 'see reference' mechanism and character capitalization. Completeness was measured as follows: completeness of the search fields in the record and relevance of search fields. Currency was measured using the publication date. The experimental result showed that ERIC databases had some errors in terms of accuracy. consistency. completeness and currency. However, continuous striving for the automatic error checking functions and the policy of feedback from users have contributed to the improvement of the quality in ERIC databases.

  • PDF

A Study on Continuity of User Experience in Multi-device Environment (멀티 디바이스 환경에서 사용자 경험의 연속성에 관한 고찰)

  • Lee, Young-Ju
    • Journal of Digital Convergence
    • /
    • v.16 no.11
    • /
    • pp.495-500
    • /
    • 2018
  • This study examined the factors that can enhance the continuity of user experience in multi - device environment. First of all, regarding the structural difference and continuity of tasks, functional differences such as OS difference according to the characteristics of cross media, use of mouse and touch gesture were found to interfere with continuity. To increase continuity, metaphor and ambience To increase relevance and visibility. In the continuity part of visual memory and cognition, familiarity was given by the identity and similarity of visual perception elements, and it was found that familiarity factors are closely related to continuity. Finally, for the continuity of the user experience, we can see that the visibility factors as well as the meaning and layout consistency of the information are factors for the continuity of the user experience. Based on this, it was found that familiarity, consistency, and correlation were significant influences on continuity dimension of user experience, but visibility did not have a significant effect on continuity when regression analysis was conducted as factors of familiarity, consistency, correlation and visibility.

Statistics Quality Assessment and Improvement of Small & Medium Enterprises Survey (중소기업실태조사의 품질진단과 개선에 관한 연구)

  • Kim, Moon Sun;Chun, Sae Rom;Nam, Kyung H.
    • Journal of Korean Society for Quality Management
    • /
    • v.40 no.4
    • /
    • pp.577-588
    • /
    • 2012
  • Purpose: This paper aims to evaluate the quality of Small & Medium Enterprises(SMEs) Survey and to provide some desirable directions and improvements for the future SMEs Survey, conducted by the Government. Methods: The diagnosis were performed by employing the quantitative and qualitative approaches with the official guideline provided by the Ministry of Statistics. Results: Results show that follow-up management are evaluated relatively low in specific processes, and timeliness are evaluated relatively lower than accuracy, accessibility, relevance, comparability and consistency in statistical qualities. Conclusion: we propose the alternatives which enhance the quality level of SMEs by using the 6 tools of Quality Management for Statistics.

A Study of the Innovation of Local Government Accounting System for Value Creation (가치창조를 위한 지방정부회계제도의 개혁)

  • Park Lee-Bong
    • Management & Information Systems Review
    • /
    • v.13
    • /
    • pp.99-125
    • /
    • 2003
  • The purpose of this study is to improve local government accounting system for value creation. In order to achieve this object: First, improvement of public finance policy can be obtained through connection of policy and estimate, and evaluation of soundness and rationality of tax system. Second, innovation of appropriation is achieved through effective division of cost, efficient division of budgetary resources and perfect accrual accounting. Third, a performance report must include accurate performance measures and performance indicators, for its effect is linked to public finance policy. Fourth, general principles of local government accounting must include significance, reliability, consistency with user concepts, relevance, understandability and comparability for financial reports.

  • PDF

Consistency Between Elementary Teachers' Teaching Practice in Mathematics and Classroom Learning Environment (초등학교 교사들의 수업 관행과 학생들의 학습 환경 인식과의 관계)

  • 오영열
    • School Mathematics
    • /
    • v.4 no.2
    • /
    • pp.237-246
    • /
    • 2002
  • The purpose of this paper is to investigatethe relationship between Korean elementary teachers' teaching practice and students' perceptions of classroom learning environment. It is important to examine whether teachers conceive of mathematics and their teaching practice are consistent with their actual teaching mathematics in classroom. To do so, two reform-oriented and two traditionally-oriented elementary teachers in Seoul and a total of 130 students from these four selected teachers' classes participated in the present study Using classroom environment survey scale [CES] the differences in students' perceptions on classroom learning environment were examined. The results show that students taught by reform-oriented teachers have significantly higher score in the area of participation, relevance, and commitment to learning than traditionally-oriented group of students. Thus, we may conclude that the reform-oriented group of students have more benefits in learning mathematics than do the traditionally-oriented group of students.

  • PDF

Quality Diagnosis and Improvement of Fisheries Census Statistic (어업조사통계의 품질진단과 개선에 관한 연구)

  • Pyo, Hee-Dong;Kim, Jong-Chun
    • Journal of Fisheries and Marine Sciences Education
    • /
    • v.22 no.4
    • /
    • pp.553-565
    • /
    • 2010
  • The paper aims to evaluate the quality of fisheries census statistic and to provide some desirable directions and improvements for the future fisheries census, conducted by the Government. For the quality diagnosis of fisheries census statistic, specific processes of fisheries census and statistical qualities of each dimension are surveyed and evaluated by a Government's practician, two external examiners and a research group. Results show that census design, data analysis and quality control are evaluated relatively low in specific processes, and accessibility and comparability are evaluated relatively lower than relevance, accuracy, timeliness and consistency in statistical qualities. For minimizing the sampling errors, the probability proportion method should be employed in sampling methods from currently simple sampling method. In addition, fisheries census statistic is desirable to include and compare with those of different countries for consumer oriented data system.