• Title/Summary/Keyword: Large dynamic data

Search Result 612, Processing Time 0.031 seconds

Efficient Continuous Skyline Query Processing Scheme over Large Dynamic Data Sets

  • Li, He;Yoo, Jaesoo
    • ETRI Journal
    • /
    • v.38 no.6
    • /
    • pp.1197-1206
    • /
    • 2016
  • Performing continuous skyline queries of dynamic data sets is now more challenging as the sizes of data sets increase and as they become more volatile due to the increase in dynamic updates. Although previous work proposed support for such queries, their efficiency was restricted to small data sets or uniformly distributed data sets. In a production database with many concurrent queries, the execution of continuous skyline queries impacts query performance due to update requirements to acquire exclusive locks, possibly blocking other query threads. Thus, the computational costs increase. In order to minimize computational requirements, we propose a method based on a multi-layer grid structure. First, relational data object, elements of an initial data set, are processed to obtain the corresponding multi-layer grid structure and the skyline influence regions over the data. Then, the dynamic data are processed only when they are identified within the skyline influence regions. Therefore, a large amount of computation can be pruned by adopting the proposed multi-layer grid structure. Using a variety of datasets, the performance evaluation confirms the efficiency of the proposed method.

Dynamic Equivalents Program combined with Graphic Environments (그래픽환경을 갖춘 동태등가프로그램)

  • 임성정;윤용한;김재철
    • Proceedings of the Korean Institute of IIIuminating and Electrical Installation Engineers Conference
    • /
    • 1992.11a
    • /
    • pp.32-36
    • /
    • 1992
  • This paper develops the dynamic equivalents program combined with graphic user interface(GUI), to solve the stability of large power system. The p개posed method is coherency-based dynamic equivalents for transient stability studies. The program also provides with pull-down menu and Hangout help information for users. The developed dynamic equivalents program is suitable for the transient stability studies of a large power system with lots of data. The dynamic equivalents demonstrated over the New England system with 39 buses and 10 generators.

  • PDF

Dynamic Replication Based on Availability and Popularity in the Presence of Failures

  • Meroufel, Bakhta;Belalem, Ghalem
    • Journal of Information Processing Systems
    • /
    • v.8 no.2
    • /
    • pp.263-278
    • /
    • 2012
  • The data grid provides geographically distributed resources for large-scale applications. It generates a large set of data. The replication of this data in several sites of the grid is an effective solution for achieving good performance. In this paper we propose an approach of dynamic replication in a hierarchical grid that takes into account crash failures in the system. The replication decision is taken based on two parameters: the availability and popularity of the data. The administrator requires a minimum rate of availability for each piece of data according to its access history in previous periods, but this availability may increase if the demand is high on this data. We also proposed a strategy to keep the desired availability respected even in case of a failure or rarity (no-popularity) of the data. The simulation results show the effectiveness of our replication strategy in terms of response time, the unavailability of requests, and availability.

Dynamic field monitoring data analysis of an ancient wooden building in seismic and operational environments

  • Lyu, Mengning;Zhu, Xinqun;Yang, Qingshan
    • Earthquakes and Structures
    • /
    • v.11 no.6
    • /
    • pp.1043-1060
    • /
    • 2016
  • The engineering background of this article is an ancient wooden building with extremely high historic and cultural values in Tibet. A full understanding of the dynamic behaviour of this historic building under in-service environments is the basis to assess the condition of the structure, especially its responses to earthquake, environmental and operational loading. A dynamic monitoring system has been installed in the building for over one year and the large amounts of high quality data have been obtained. The paper aims at studying the dynamic behaviour of the wooden building in seismic and operational conditions using the field monitoring data. Specifically the effects of earthquake and crowd loading on the structure's dynamic response are investigated. The monitoring data are decomposed into principal components using the Singular Spectrum Analysis (SSA) technique. The relationship between the average acceleration amplitude and frequencies of the principle components and operational conditions has been discussed. One main contribution is to understand the health condition of complex ancient building based on large databases collected on the field.

Volume Rendering using Grid Computing for Large-Scale Volume Data

  • Nishihashi, Kunihiko;Higaki, Toru;Okabe, Kenji;Raytchev, Bisser;Tamaki, Toru;Kaneda, Kazufumi
    • International Journal of CAD/CAM
    • /
    • v.9 no.1
    • /
    • pp.111-120
    • /
    • 2010
  • In this paper, we propose a volume rendering method using grid computing for large-scale volume data. Grid computing is attractive because medical institutions and research facilities often have a large number of idle computers. A large-scale volume data is divided into sub-volumes and the sub-volumes are rendered using grid computing. When using grid computing, different computers rarely have the same processor speeds. Thus the return order of results rarely matches the sending order. However order is vital when combining results to create a final image. Job-Scheduling is important in grid computing for volume rendering, so we use an obstacle-flag which changes priorities dynamically to manage sub-volume results. Obstacle-Flags manage visibility of each sub-volume when line of sight from the view point is obscured by other subvolumes. The proposed Dynamic Job-Scheduling based on visibility substantially increases efficiency. Our Dynamic Job-Scheduling method was implemented on our university's campus grid and we conducted comparative experiments, which showed that the proposed method provides significant improvements in efficiency for large-scale volume rendering.

A Dynamic Partitioning Scheme for Distributed Storage of Large-Scale RDF Data (대규모 RDF 데이터의 분산 저장을 위한 동적 분할 기법)

  • Kim, Cheon Jung;Kim, Ki Yeon;Yoo, Jong Hyeon;Lim, Jong Tae;Bok, Kyoung Soo;Yoo, Jae Soo
    • Journal of KIISE
    • /
    • v.41 no.12
    • /
    • pp.1126-1135
    • /
    • 2014
  • In recent years, RDF partitioning schemes have been studied for the effective distributed storage and management of large-scale RDF data. In this paper, we propose an RDF dynamic partitioning scheme to support load balancing in dynamic environments where the RDF data is continuously inserted and updated. The proposed scheme creates clusters and sub-clusters according to the frequency of the RDF data used by queries to set graph partitioning criteria. We partition the created clusters and sub-clusters by considering the workloads and data sizes for the servers. Therefore, we resolve the data concentration of a specific server, resulting from the continuous insertion and update of the RDF data, in such a way that the load is distributed among servers in dynamic environments. It is shown through performance evaluation that the proposed scheme significantly improves the query processing time over the existing scheme.

Dynamic Modeling and Model Reduction for a Large Marine Engine

  • Kim, Chae-Sil;Jung, Jong-Ha;Park, Hyung-Ho
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.27 no.4
    • /
    • pp.520-525
    • /
    • 2003
  • This article provides a dynamic modeling methodology of engines to be accurate with a small number of degrees of freedom for an active vibration control using a top bracing. First. a finite element (FE) model for the engine structure is constructed so that the size of model is as small as possible where the dynamic characteristics of engine are ensured. Second. a technique is studied to obtain the exact mass and stiffness matrices of the FE model. The size of matrices from the FE model is still too large to apply. Finally, a model reduction is. therefore. conducted to make an appropriate dynamic model for designing and simulating a top bracing. In this article, a dynamic model of a large 9 cylinder engine is constructed and reviewed by comparing its natural frequencies and steady state reponses with those of experimental data provided by manufacturer.

Thirty-Minute ToO (TMT) with KMTNet

  • Kim, Jae-Woo;Shin, Min-Su;Chang, Seo-Won;Ree, Chang Hee;Kim, Seung-Lee;Lee, Chung-Uk
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.44 no.1
    • /
    • pp.62.1-62.1
    • /
    • 2019
  • Current large observational projects perform both static and dynamic sky surveys. The Thirty-Minute Target of Opportunity (TMT) is the project focusing on the dynamic sky survey using Korea Microlensing Telescope Network (KMTNet) that is the best observing system to investigate the dynamic sky. TMT aims to perform and experiment on following components : 1) to select transient or variable sources having hour to day scale cadences for future science cases, 2) to optimize the observation strategy for these objects, 3) to provide automated photometric pipelines for the time series data, and 4) to test the data release environment for all astronomers. In the near future, it is expected that a huge number of events will be alerted through large area surveys such as LSST. Therefore, the TMT project will provide opportunities to prepare the future large survey era as well as to understand the nature of interesting astronomical events.

  • PDF

Large Eddy Simulation of Turbulent Premixed Flame Behavior with Dynamic Subgrid G-Equation Model (Dynamic Subgrid G-방정식을 적용한 난류 예혼합 화염의 LES 해석)

  • Park, Nam-Seob;Kim, Man-Young
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.33 no.11
    • /
    • pp.57-64
    • /
    • 2005
  • Large Eddy Simulation (LES) of turbulent premixed combustion flow is performed by using the dynamic subgrid scale model based on -equation describing the flame front propagation. After introducing the LES governing equations with dynamic subgrid scale (DSGS) model newly introduced into the -equation, the turbulent premixed combustion flow over backward facing step is analyzed to validate present formulation. The calculated results can predict the velocity and temperature of the combustion flow in good agreement with the experiment data.

Level Scale Interface Design for Real-Time Visualizing Large-Scale Data (대용량 자료 실시간 시각화를 위한 레벨 수준 표현 인터페이스 설계)

  • Lee, Do-Hoon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.13 no.2
    • /
    • pp.105-111
    • /
    • 2008
  • Various visualizing methods have been proposed according to the input and output types. To show complex and large-scale raw data and information. LOD and special region scale method have been used for them. In this paper, I propose level scale interface for dynamic and interactive controlling large scale data such as bio-data. The method has not only advantage of LOD and special region scale but also dynamic and real-time processing. In addition, the method supports elaborate control from large scale to small one for visualization on a region in detail. Proposed method was adopted for genome relationship visualization tool and showed reasonable control method.

  • PDF