• Title/Summary/Keyword: metadata quality

Search Result 114, Processing Time 0.03 seconds

Korean Web Content Extraction using Tag Rank Position and Gradient Boosting (태그 서열 위치와 경사 부스팅을 활용한 한국어 웹 본문 추출)

  • Mo, Jonghoon;Yu, Jae-Myung
    • Journal of KIISE
    • /
    • v.44 no.6
    • /
    • pp.581-586
    • /
    • 2017
  • For automatic web scraping, unnecessary components such as menus and advertisements need to be removed from web pages and main contents should be extracted automatically. A content block tends to be located in the middle of a web page. In particular, Korean web documents rarely include metadata and have a complex design; a suitable method of content extraction is therefore needed. Existing content extraction algorithms use the textual and structural features of content blocks because processing visual features requires heavy computation for rendering and image processing. In this paper, we propose a new content extraction method using the tag positions in HTML as a quasi-visual feature. In addition, we develop a tag rank position, a type of tag position not affected by text length, and show that gradient boosting with the tag rank position is a very accurate content extraction method. The result of this paper shows that the content extraction method can be used to collect high-quality text data automatically from various web pages.

Design and Implementation of the Query Processor and Browser for Content-based Retrieval in Video Database (내용기반 검색을 위한 비디오 데이터베이스 질의처리기 및 브라우저의 설계 및 구현)

  • Lee, Hun-Sun;Kim, Yong-Geol;Bae, Yeong-Rae;Jin, Seong-Il
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.8
    • /
    • pp.2008-2019
    • /
    • 1999
  • As computing technologies are rapidly progressed and widely used, the needs of high quality information have been increased. To satisfy these needs, it is essential to develop a system which can provide an efficient storing, managing and retrieving mechanism of complex multimedia data, esp. video data. In this paper, we propose a metadata model which can support content-based retrieval of video data. And we design and implement an integrated user interface for querying and browser for content-based retrieval in video database which can efficiently access and browse the video clip that user want to see. Proposed query processor and browser can support various user queries by integrating image feature, spatial temporal feature and annotation. Our system supports structure browsing of retrieved result, so users can more exactly and efficiently access relevant video clip. Without browsing the whole video clip, users can know the contents of video by seeing the storyboard. This storyboard facility makes users know more quickly the content of video clip.

  • PDF

Collecting Method and Implementation of Search Management System for R&D Projects in Korean Medicine Field (한의학 연구개발과제 수집 방법 및 검색 관리 시스템 구축)

  • Kim, Sang-Kyun;Jang, Hyun-Chul;Yea, Sang-Jun;Kim, Chul;Eom, Dong-Myung;Song, Mi-Young
    • The Journal of Korean Medicine
    • /
    • v.30 no.4
    • /
    • pp.47-58
    • /
    • 2009
  • Objectives: Several domestic search systems for research projects providing capabilities of searching and managing the research information based on metadata have been completed, although they cannot search projects for specific domains such as the Oriental Medicine field. Therefore, in this paper we propose an effective method for collecting and refining information of research projects in the oriental medicine field. We also design and implement a search management system based on the collected information. Methods: We chose three search elements and defined the collecting process for research projects. The collected information was refined to enhance the quality of results. Then, the search management system was implemented by Adobe Flex. Results: We were able to collect 1,688 research projects in the oriental medicine field. We also implemented the search management system, which provides the functionalities of search and management such as input, update, delete, spreadsheet import/export of R&D projects, user management and access control. Conclusions: The collected information and the search management system will be used in a project analysis system which will be constructed in the future. The project analysis system could help to analyze trends in oriental medicine research as well as construct a technical roadmap.

  • PDF

TV Program Recommender System Using Viewing Time Patterns (시청시간패턴을 활용한 TV 프로그램 추천 시스템)

  • Bang, Hanbyul;Lee, HyeWoo;Lee, Jee-Hyong
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.25 no.5
    • /
    • pp.431-436
    • /
    • 2015
  • As a number of TV programs broadcast today, researches about TV program recommender system have been studied and many researchers have been studying recommender system to produce recommendation with high accuracy. Recommender system recommends TV program to user by using metadata like genre, plot or calculating users' preferences about TV programs. In this paper, we propose a new TV program Collaborative Filtering Recommender System that exploits viewing time pattern like viewing ratio, relation with finish time and recently viewing history to calculate preference for high-quality of recommendation. To verify usefulness of our research, we also compare our method which utilizes viewing time patterns and baseline which simply recommends TV program of user's most frequently watched channel. Through this experiments, we show that our method very effectively works and recommendation performance increases.

A Case Study of the Audio-Visual Archives System Development and Management (시청각(사진/동영상) 기록물 관리를 위한 시스템 구축과 운영 사례 연구)

  • Shin, Dong-Hyeon;Jung, Se-Young;Kim, Seon-Heon
    • Journal of Korean Society of Archives and Records Management
    • /
    • v.9 no.1
    • /
    • pp.33-50
    • /
    • 2009
  • ADD(Agency for Defense Development) has developed digital audio-visual archives management system to ensure easy access and long-term preservation for digital audio-visual archives. This paper covers total process of the system development and database management in the aspect of preservation and utilization by users' easy search through digitization of audio-visual archives. In detail, it contains system design for images and video data handling, standard workflow establishment, data quality, and metadata settings for database by converting an analog data into digital format. Also, this study emphasizes the importance of audio-visual archives management system through cost-effectiveness analysis.

XOB: An XMDR-based Ontology Builder (XOB: XMDR 기반의 온톨로지 생성 시스템)

  • Lee, Suk-Hoon;Jeong, Dong-Won;Kim, Jang-Won;Baik, Doo-Kwon
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.16 no.9
    • /
    • pp.904-917
    • /
    • 2010
  • Much research on ontology has been done during the last decade in order to represent knowledge and connect data semantically in AI and Semantic Web areas. However, ontologies might be represented and defined in different ways depending on knowledge and intention of users. It causes heterogeneity problem that the same concept can be differently expressed. This paper introduces a XOB (XMDR-based Ontology Builder) system based on XMDR to resolve the problem. XOB creates ontologies by reusing classes and relations defined in XMDR. XOB therefore is able to either solve or minimize the heterogeneity problem among ontologies. This paper introduces the conceptual model and overall architecture of the proposed system XOB. This paper defines the process, algorithm, ontology generation rule that is required to create ontologies by using concepts registered in XMDR. Our proposal supports higher standardization than the previous approaches, and it provides many advantages such as consistent concept usage, easy semantic exchange, and so on. Therefore, XOB enables high-quality ontology creation and reduces cost for ontology integration and system development.

The European Library, a New Model for Collaborations in Digital Libraries (유럽의 국가 도서관 통합 서비스에 대한 연구)

  • Pyo, Soon-Hee;Lee, Jae-Yun
    • Journal of Information Management
    • /
    • v.36 no.3
    • /
    • pp.71-95
    • /
    • 2005
  • Interoperability and collaborations have become essential factors for developing a digital library. TEL, the European Library, is a new Pan-European service which gives access to the combined resources of the national libraries in Europe, and also TEL is the name of a project to implement TEL service. The vision of TEL stems from the characteristics that the national libraries offer, which is the comprehensiveness of collection, the national libraries' holdings of outstanding historical and special collection, reliability of information and high quality. Moreover, the national libraries are in a unique position to invest in creating added value to the digitized documents and to show the cultural diversity between EU members. From the viewpoint of digital library techniques, TEL explored some advanced methodologies to guarantee the interoperability between heterogenious collections and libraries. In this study, we examine the development of TEL including publisher relations, metadata developments, and retrieval features.

Network Traffic Analysis System Based on Data Engineering Methodology (데이터 엔지니어링 방법론을 기반으로한 네트워크 트래픽 분석 시스템)

  • Han, Young-Shin;Kim, Tae-Kyu;Jung, Jason J.;Jung, Chan-Ki;Lee, Chil-Gee
    • Journal of the Korea Society for Simulation
    • /
    • v.18 no.1
    • /
    • pp.27-34
    • /
    • 2009
  • Currently network users, especially the number of internet users, increase rapidly. Also, high quality of service is required and this requirement results a sudden network traffic increment. As a result, an efficient management system for huge network traffic becomes an important issue. Ontology/data engineering based context awareness using the System Entity Structure (SES) concepts enables network administrators to access traffic data easily and efficiently. The network traffic analysis system, which is studied in this paper, is designed and implemented based on a model and simulation using data engineering methodology to be avaiable in evaluating large network traffic data. Extensible Markup Language (XML) is used for metadata language in this system. The information which is extracted from the network traffic analysis system could be modeled and simulated in Discrete Event Simulation (DEVS) methodology for further works such as post simulation evaluation, web services, and etc.

A Review of the Application of Constructed Wetlands as Stormwater Treatment Systems

  • Reyes, Nash Jett;Geronimo, Franz Kevin;Guerra, Heidi;Jeon, Minsu;Kim, Lee-Hyung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2022.05a
    • /
    • pp.162-162
    • /
    • 2022
  • Stormwater management is an essential component of land-use planning and development. Due to the additional challenges posed by climate change and urbanization, various stormwater management schemes have been developed to limit flood damages and ease water quality concerns. Nature-based solutions (NBS) are increasingly used as cost-effective measures to manage stormwater runoff from various land uses. Specifically, constructed wetlands were already considered as socially acceptable green stormwater infrastructures that are widely used in different countries. There is a large collection of published literature regarding the effectiveness or efficiency of constructed wetlands in treating stormwater runoff; however, metadata analyses using bibliographic information are very limited or seldomly explored. This study was conducted to determine the trends of publication regarding stormwater treatment wetlands using a bibliometric analysis approach. Moreover, the research productivity of various countries, authors, and institutions were also identified in the study. The Web of Science (WoS) database was utilized to retrieve bibliographic information. The keywords ("constructed wetland*" OR "treatment wetland*" OR "engineered wetland*" OR "artificial wetland*") AND ("stormwater*" or "storm water*") were used to retrieve pertinent information on stormwater treatment wetlands-related publication from 1990 up to 2021. The network map of keyword co-occurrence map was generated through the VOSviewer software and the contingency matrices were obtained using the Cortext platform (www.cortext.net). The results obtained from this inquiry revealed the areas of research that have been adequately explored by past studies. Furthermore, the extensive collection of published scientific literature enabled the identification of existing knowledge gaps in the field of stormwater treatment wetlands.

  • PDF

Proposal of WebGIS-based Korean Archaeological Dictionary Information Service Model (WebGIS 기반 한국고고학사전 정보서비스 모델의 제안)

  • KANG Dongseok
    • Korean Journal of Heritage: History & Science
    • /
    • v.57 no.1
    • /
    • pp.6-19
    • /
    • 2024
  • The Korean Archaeological Dictionary, which represents Korean archaeological knowledge information, contains refined and high-quality information written by expert collective intelligence. This is a characteristic that clearly distinguishes it from overseas archaeological data archives, and can be called differentiated infrastructure data. However, it has not played a role as an information service or knowledge information platform reflecting the latest digital technology. As a way to maximize these strengths and compensate for weaknesses, it was proposed to develop and operate a GIS-based knowledge and information platform for Korean archaeology. To realize this, it is necessary to develop a title management system centered on repositories and metadata that can collect and store various information, link open linked data design and related systems, develop a search function that can analyze and visualize data in response to the big data era, and establish a WebGIS-based information service system. This will be a platform to continuously manage, supplement, and update Korean archaeological knowledge information, build a ubiquitous environment where anyone can use information anytime, anywhere, and create various types of business models.