• Title/Summary/Keyword: Change in Data Processing View

Search Result 22, Processing Time 0.028 seconds

An Efficient Incremental Maintenance of SPJ Materialized Views (SPJ 실체화 뷰의 효율적인 점진적 관리 기법)

  • Lee, Ki-Yong;Son, Jin-Hyun;Kim, Myoung-Ho
    • The KIPS Transactions:PartD
    • /
    • v.13D no.6 s.109
    • /
    • pp.797-806
    • /
    • 2006
  • In the data warehouse environment, materialized views are typically used to support efficient query processing. Materialized views need to be updated when source data change. Since the update of the views need impose a significant overhead, it is essential to update the views efficiently. Though various view maintenance strategies have been discussed in the past, the efficient maintenance of SPJ materialized views has not been sufficiently investigated. In this paper, we propose an efficient incremental view maintenance method for SPJ materialized views that minimizes the total accesses to data sources. The proposed method finds an optimal view maintenance strategy using a dynamic programming algorithm. We also present various experimental results that shows the efficiency of our proposed method.

An Exploratory Study on the Uniqueness of Crowds and its Implications for Public Data Platform Design from the Information Processing View (정보처리관점에서 본 대중의 특성과 공공데이터 플랫폼 설계 시사점에 관한 탐색 연구)

  • Kim, Sang Wook;Lee, Jae Sook
    • Journal of the Korea Convergence Society
    • /
    • v.8 no.11
    • /
    • pp.373-381
    • /
    • 2017
  • As the viewpoint of data evolves from business resources to value resources, the focus on the data processing is rapidly shifting from the cartesian (alphanumeric) to the contextual. In response to this trend, the government is actively promoting the utilization of public data by the private sectors. With a focus on the fact that the mainstream of public data users is the crowds, this study, therefore, seeks to identify differences between the members and the crowds from information processing view, followed by presenting directions and main points for the design of data platform. This study is perhaps to be a starting point for finding practical alternatives for creating 'collective intelligence ecosystem' and to be a basis for building a big data base in response to the opening of public data.

View-Invariant Body Pose Estimation based on Biased Manifold Learning (편향된 다양체 학습 기반 시점 변화에 강인한 인체 포즈 추정)

  • Hur, Dong-Cheol;Lee, Seong-Whan
    • Journal of KIISE:Software and Applications
    • /
    • v.36 no.11
    • /
    • pp.960-966
    • /
    • 2009
  • A manifold is used to represent a relationship between high-dimensional data samples in low-dimensional space. In human pose estimation, it is created in low-dimensional space for processing image and 3D body configuration data. Manifold learning is to build a manifold. But it is vulnerable to silhouette variations. Such silhouette variations are occurred due to view-change, person-change, distance-change, and noises. Representing silhouette variations in a single manifold is impossible. In this paper, we focus a silhouette variation problem occurred by view-change. In previous view invariant pose estimation methods based on manifold learning, there were two ways. One is modeling manifolds for all view points. The other is to extract view factors from mapping functions. But these methods do not support one by one mapping for silhouettes and corresponding body configurations because of unsupervised learning. Modeling manifold and extracting view factors are very complex. So we propose a method based on triple manifolds. These are view manifold, pose manifold, and body configuration manifold. In order to build manifolds, we employ biased manifold learning. After building manifolds, we learn mapping functions among spaces (2D image space, pose manifold space, view manifold space, body configuration manifold space, 3D body configuration space). In our experiments, we could estimate various body poses from 24 view points.

A New Data Warehousing System Architecture Supporting High Performance View Maintenance (고성능 뷰 관리르 지원하는 새로운 데이터 웨어하우징 시스템 구조)

  • Kim, Jeom-Su;Lee, Do-Heon;Lee, Dong-Ik
    • Journal of KIISE:Software and Applications
    • /
    • v.26 no.10
    • /
    • pp.1156-1166
    • /
    • 1999
  • 의사결정 시스템은 전사적인 의사결정과 전략적 정보수집을 위해 거대한 량의 정보를 빠른 시간내에 제공할 것을 요구한다. 데이타 웨어하우스는 이러한 정보를 신속히 제공하기 위해 여러 지역 데이타베이스로부터 필요한 정보를 사전에 추출하고 가공 및 통합하여 별도의 저장공간에 저장한다. 일반적으로, 웨어하우스 내의 정보는 지역 데이타베이스에 저장된 정보에 대한 실체화된 뷰로서 간주하며 지역 데이타의 변경에 따라 일관성을 유지하도록 반영해야 한다. 본 논문에서는 일관성을 유지하기 위해 정보 공유가 가능한 데이타 웨어하우스 시스템의 구조와 비-보상 실체 뷰 관리 기법을 제안한다. 본 논문에서 제안한 데이타 웨어하우스 시스템의 구조는 지역 데이타베이스에서 추출된 정보를 관리하는 별도의 지역 정보 관리자를 두어 뷰 관리자들 간의 정보 공유가 가능하게 한다. 비-보상 실체 뷰 관리 기법은 지역 데이타 변경 사건에 따른 뷰 관리 시 다른 사건에 의해 영향을 받지 않도록 하기 때문에 기본의 사전 보상이나 나중 보상 기법과는 달리 추가적인 질의 처리를 요구하지 않는 기법이다.Abstract A decision support system(DSS) commonly requires fast access to tremendous volume of information. A data warehouse is a database storing the information that is extracted, filtered and integrated from several relevant local databases to reply upon aggregated queries. The information stored in the data warehouse can be regarded as materialized views. The materialized view has to be modified according to the change of the corresponding local databases to preserve the data consistency. In this paper, we propose a data warehousing system architecture allowing information sharing (DAWINS), and a non-compensating materialized view maintenance algorithm(NCA). DAWINS architecture allows relevant information to be shared by individual view managers with local data manager for each local database. Unlikely to the pre- or post-compensating algorithms, which are required to remove the effects of some events to other view in the process of view maintenance, NCA does not require any additional query processing, since a local data manager in DAWINS already maintains the effects of update events occurring in local systems.

Semiautomated Analysis of Data from an Imaging Sonar for Fish Counting, Sizing, and Tracking in a Post-Processing Application

  • Kang, Myoung-Hee
    • Fisheries and Aquatic Sciences
    • /
    • v.14 no.3
    • /
    • pp.218-225
    • /
    • 2011
  • Dual frequency identification sonar (DIDSON) is an imaging sonar that has been used for numerous fisheries investigations in a diverse range of freshwater and marine environments. The main purpose of DIDSON is fish counting, fish sizing, and fish behavioral studies. DIDSON records video-quality data, so processing power for handling the vast amount of data with high speed is a priority. Therefore, a semiautomated analysis of DIDSON data for fish counting, sizing, and fish behavior in Echoview (fisheries acoustic data analysis software) was accomplished using testing data collected on the Rakaia River, New Zealand. Using this data, the methods and algorithms for background noise subtraction, image smoothing, target (fish) detection, and conversion to single targets were precisely illustrated. Verification by visualization identified the resulting targets. As a result, not only fish counts but also fish sizing information such as length, thickness, perimeter, compactness, and orientation were obtained. The alpha-beta fish tracking algorithm was employed to extract the speed, change in depth, and the distributed depth relating to fish behavior. Tail-beat pattern was depicted using the maximum intensity of all beams. This methodology can be used as a template and applied to data from BlueView two-dimensional imaging sonar.

Classification of Warm Temperate Vegetation Using Satellite Data and Management System (위성영상을 이용한 난대림 식생 분류와 관리 시스템)

  • 조성민;오구균
    • Korean Journal of Environment and Ecology
    • /
    • v.18 no.2
    • /
    • pp.231-235
    • /
    • 2004
  • Landsat satellite images were analyzed to study vegetation change patterns of warm-temperate forests from 1991 to 2002 in Wando. For this purpose, Landsat TM satellite image of 1991 and Landsat ETM image of 2002 were used for vegetation classification using ENVI image processing software. Four different forest types were set as a classification criteria; evergreen broadleaf, evergreen conifer, deciduous broadleaf, and others. Unsupervised classification method was applied to classily forest types. Although it was impossible to draw exact forest types in rocky areas because of differences in data detection time and rough resolution of image, 2002 data revealed that total 2,027ha of evergreen broadleaf forests were growing in Wando. Evergreen broadleaves and evergreen conifers increased in total areas compared to 11 years ago, but there was sharp decrease in deciduous broadleaves. GIS-based management system for warm-temperate forest was done using Arc/Info. Geographic and attribute database of Wando such as vegetation, soils, topography, land owners were built with Arc/Info and ArcView. Graphic user interface which manages and queries necessary data was developed using Avenue.

Incremental Maintenance of Horizontal Views Using a PIVOT Operation and a Differential File in Relational DBMSs (관계형 데이터베이스에서 PIVOT 연산과 차등 파일을 이용한 수평 뷰의 점진적인 관리)

  • Shin, Sung-Hyun;Kim, Jin-Ho;Moon, Yang-Sae;Kim, Sang-Wook
    • The KIPS Transactions:PartD
    • /
    • v.16D no.4
    • /
    • pp.463-474
    • /
    • 2009
  • To analyze multidimensional data conveniently and efficiently, OLAP (On-Line Analytical Processing) systems or e-business are widely using views in a horizontal form to represent measurement values over multiple dimensions. These views can be stored as materialized views derived from several sources in order to support accesses to the integrated data. The horizontal views can provide effective accesses to complex queries of OLAP or e-business. However, we have a problem of occurring maintenance of the horizontal views since data sources are distributed over remote sites. We need a method that propagates the changes of source tables to the corresponding horizontal views. In this paper, we address incremental maintenance of horizontal views that makes it possible to reflect the changes of source tables efficiently. We first propose an overall framework that processes queries over horizontal views transformed from source tables in a vertical form. Under the proposed framework, we propagate the change of vertical tables to the corresponding horizontal views. In order to execute this view maintenance process efficiently, we keep every change of vertical tables in a differential file and then modify the horizontal views with the differential file. Because the differential file is represented as a vertical form, its tuples should be converted to those in a horizontal form to apply them to the out-of-date horizontal view. With this mechanism, horizontal views can be efficiently refreshed with the changes in a differential file without accessing source tables. Experimental results show that the proposed method improves average performance by 1.2$\sim$5.0 times over the existing methods.

NURBS Post-Processing of Linear Tool Path (미소직선 공구경로의 NURBS 변환)

  • Kim, Su-Jin;Choi, In-Hugh;Yang, Min-Yang
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.27 no.7
    • /
    • pp.1227-1233
    • /
    • 2003
  • NURBS (Non Uniform Rational B-Spline) is widely used in CAD system and NC data for high speed machining. Conventional CAM system changes NURBS surface to tessellated meshes or Z-map model, and produces linear tool path. The linear tool path is not good fur precise machining and high speed machining. In this paper, an algorithm to change linear tool path to NURBS one was studied and the machining result of NURBS tool path was compared with that of linear tool path. The N-post including both a post-processing and a virtual machining software was developed. The N-Post transforms linear tool path to NURBS tool path and quickly shades a machined product on OpenGL view, while comparing a machined surface with a original CAD one. A virtulal machined model of original tool path and post-processed tool path was compared to original CAD model. The machining error and machining time of post-processed NURBS tool path were investigated.

NURBS Post-processing of Linear Tool Path (미소직선 공구경로의 NURBS 변환)

  • Kim, Su-Jin;Choi, In-Hugh;Yang, Min-Yang
    • Proceedings of the KSME Conference
    • /
    • 2003.04a
    • /
    • pp.1111-1117
    • /
    • 2003
  • NURBS (Non Uniform Rational B-Spline) is widely used in CAD system and NC data for high speed machining. Conventional CAM system changes NURBS surface to tessellated meshes or Z-map model, and produces linear tool path. The linear tool path is not good for precise machining and high speed machining. In this paper, an algorithm to change linear tool path to NURBS one was studied, and the machining result of NURBS tool path was compared with that of linear tool path. The N-post, post-processing and virtual machining software was developed. The N-Post post-processes linear tool path to NURBS tool path and quickly shades machined product on OpenGL view and compares a machined product with original CAD surface. A virtual machined model of original tool path and post-processed tool path was compared to original CAD model. The machining error of post-processed NURBS tool path was reduced to 43%. The original tool path and NURBS tool path was used to machine general model using same machine tool and machining condition. The machining time of post-processed NURBS tool path was reduced up to 38%.

  • PDF

A Study on the Efficient Use of Database and the Office Information System (데이터베이스의 효율적 이용을 위한 사무실 정보시스템에 관한 연구)

  • Ko Young-Man
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.21
    • /
    • pp.169-190
    • /
    • 1991
  • The purpose of this study is to investigate aspects of office information systems in japanese corporations in order to understand introduction strategies and to find out whether strategy elements could be transferred to Germany. In this study, three points of view played an important role. (a) Technological and infrastructural support systems What kind of role did the liberalization of telecommunication markets and the avaliability of computer hardware play to help develope of database industry and implement office information systems? (b) Strategies and forms of the implementation of office information system: Which strategies were successful, distribution or centralization? How were technical and organizational problems handled? (c) Process of data communication : How did the implementation of office information system change the data communication with in-house or commercial database systems? To answer these questions, this study centered around a two-step field research in Japan. (1) Screening stage: to gain a general overview of office information system in Japan. The results of this initial research have been analysed and carefully evaluated to prepare for the second and major part of field research in Japan. (2) Data collection stage: interviews with respective managers, heads offices, and data processing units in 20 enterprises. The major results of this study are as follows. Today in Japan, office information system is understood as the interconnection of the in-house and commercial database for the maximization of the use of information resource In an organization. In particular, developments in the direction of distributed systems and the 'intelligent office' by means of the new information and communication technologies are very important.

  • PDF