• Title/Summary/Keyword: Storage and Index Structure

Search Result 96, Processing Time 0.035 seconds

A Study on Database Indexing Techniques and Their Limitations

  • Nasridinov, Aziz;Park, Young-Ho
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2013.05a
    • /
    • pp.898-899
    • /
    • 2013
  • There are numerous approaches to improve the performances of database systems. The most efficient ones are considered to be implementing an effective database indexing technique. This must guarantee the balance between the memory, storage resources and processor of the database server according to the type, structure, the physical organization and the cardinality of data, the type of queries and the number of competing transactions. The challenge is to find an appropriate index type that would suite these requirements. In this paper, we provide an overview of the most used database indexing techniques such as B-tree index and Bitmap index, present an analysis of these techniques and discuss their limitations.

Index Management Method using Page Mapping Log in B+-Tree based on NAND Flash Memory (NAND 플래시 메모리 기반 B+ 트리에서 페이지 매핑 로그를 이용한 색인 관리 기법)

  • Kim, Seon Hwan;Kwak, Jong Wook
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.5
    • /
    • pp.1-12
    • /
    • 2015
  • NAND flash memory has being used for storage systems widely, because it has good features which are low-price, low-power and fast access speed. However, NAND flash memory has an in-place update problem, and therefore it needs FTL(flash translation layer) to run for applications based on hard disk storage. The FTL includes complex functions, such as address mapping, garbage collection, wear leveling and so on. Futhermore, implementation of the FTL on low-power embedded systems is difficult due to its memory requirements and operation overhead. Accordingly, many index data structures for NAND flash memory have being studied for the embedded systems. Overall performances of the index data structures are enhanced by a decreasing of page write counts, whereas it has increased page read counts, as a side effect. Therefore, we propose an index management method using a page mapping log table in $B^+$-Tree based on NAND flash memory to decrease page write counts and not to increase page read counts. The page mapping log table registers page address information of changed index node and then it is exploited when retrieving records. In our experiment, the proposed method reduces the page read counts about 61% at maximum and the page write counts about 31% at maximum, compared to the related studies of index data structures.

Impact of assimilating the terrestrial water storage on the water and carbon cycles in CLM5-BGC

  • Chi, Heawon;Seo, Hocheol;Kim, Yeonjoo
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2021.06a
    • /
    • pp.204-204
    • /
    • 2021
  • Terrestrial water storage (TWS) includes all components of water (e.g., surface water, groundwater, snow and ice) over the land. So accurately predicting and estimating TWS is important in water resource management. Although many land surface models are used to predict the TWS, model output has errors and biases in comparison to the observation data due to the model deficiencies in the model structure, atmospheric forcing datasets, and parameters. In this study, Gravity Recovery And Climate Experiment (GRACE) satelite TWS data is assimilated in the Community Land Model version 5 with a biogeochemistry module (CLM5.0-BGC) over East Asia from 2003 to 2010 by employing the Ensemble Adjustment Kalman Filter (EAKF). Results showed that TWS over East Asia continued to decrease during the study period, and the ability to simulate the surface water storage, which is the component of the CLM derived TWS, was greatly improved. We further investigated the impact of assimilated TWS on the vegetated and carbon related variables, including the leaf area index and primary products of ecosystem. We also evaluated the simulated total ecosystem carbon and calculated its correlation with TWS. This study shows that how the better simulated TWS plays a role in capturing not only water but also carbon fluxes and states.

  • PDF

A Concurrency Control Scheme over T-tree in Main Memory Databases with Multiversion

  • Ying Xia;Cho, Sook-Kyoung;Oh, Young-Hwan;Kim, June;Bae, Hae-Young
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2000.10a
    • /
    • pp.210-212
    • /
    • 2000
  • In this paper, we present a comcurrency control scheme over the index structure in main memory databases using multiversion mechanism, and implement it on T-tree. As a well-known idea for comcurrency control, multiversion allows multiple transactions to reat and write different versions of the same data item, each transaction sees a consistent set of versions for all the data items it accesses[1]. Logical versioning and physical versioning techniques are used to keep versions of data item and versions of index node respectively. The main features of this multiversion indexing approach are (1)update operations and rotations on T-tree can take place concurrently, (2)the number of locking and latching requirement is sharply reduced because read-only transactions do not obtain any locks or latches and update transactions obtain latches only when actually performing the update, (3)it reduces storage overhead for tracking version and reclaims storage in time, and (4)it provides complete isolation of read-only transactions from update transactions, so the read-only transactions can get response information without any block.

  • PDF

A thermal stress and crack study by computer modelling (전산해석에 의한 온도응력 및 온도균열 검토)

  • 문수동;이상호;문한영
    • Proceedings of the Korea Concrete Institute Conference
    • /
    • 2002.10a
    • /
    • pp.375-380
    • /
    • 2002
  • Tong-young LNG tank is a LNG storage tank of 140,000 kl, and it is composed of Bottom Slab(Annular, Center), Outer Wall, Ring Beam and Roof. Generally, when concrete temperature arise, the complex thermal stress of inner and outer part can cause serious thermal crack and damage at structure. So in this paper, for the control of this thermal crack, we did the concrete mix design with the base of fly-ash 30% substitute at binder, and through the computer modelling at Bottom Slab(Annular, Center), Outer Wall, Ring Beam and Roof, we studied the probability of thermal crack by thermal crack index.

  • PDF

GDCS : Energy Efficient Grid based Data Centric Storage for Sensor Networks (GDCS : 센서네트워크를 위한 에너지 효율적인 그리드 기반 데이터 중심 저장 시스템)

  • Shin, Jae-Ryong;Yoo, Jae-Soo;Song, Seok-Il
    • The Journal of the Korea Contents Association
    • /
    • v.9 no.1
    • /
    • pp.98-105
    • /
    • 2009
  • In this paper, new data centric storage that is dynamically adapted to the change of work load is proposed. The proposed data centric storage distributes the load of hot spot area by using multilevel grid technique. Also, the proposed method is able to use existing routing protocol such as GPSR (Greedy Perimeter Stateless Routing) with small changes. Through simulation the proposed method enhances the lifetime of sensor networks over one of the state-of-the-art data centric storages. We implement the proposed method based on a operating system for sensor networks, and evaluate the performance through running based on a simulation tool.

Design and Implementation of High-dimensional Index Structure for the support of Concurrency Control (필터링에 기반한 고차원 색인구조의 동시성 제어기법의 설계 및 구현)

  • Lee, Yong-Ju;Chang, Jae-Woo;Kim, Hang-Young;Kim, Myung-Joon
    • The KIPS Transactions:PartD
    • /
    • v.10D no.1
    • /
    • pp.1-12
    • /
    • 2003
  • Recently, there have been many indexing schemes for multimedia data such as image, video data. But recent database applications, for example data mining and multimedia database, are required to support multi-user environment. In order for indexing schemes to be useful in multi-user environment, a concurrency control algorithm is required to handle it. So we propose a concurrency control algorithm that can be applied to CBF (cell-based filtering method), which uses the signature of the cell for alleviating the dimensional curse problem. In addition, we extend the SHORE storage system of Wisconsin university in order to handle high-dimensional data. This extended SHORE storage system provides conventional storage manager functions, guarantees the integrity of high-dimensional data and is flexible to the large scale of feature vectors for preventing the usage of large main memory. Finally, we implement the web-based image retrieval system by using the extended SHORE storage system. The key feature of this system is platform-independent access to the high-dimensional data as well as functionality of efficient content-based queries. Lastly. We evaluate an average response time of point query, range query and k-nearest query in terms of the number of threads.

Design and Implementation of an XML Document Management System Based on $O_2$ ($O_2$기반의 XML 문서관리 시스템 설계 및 구현)

  • 유재수
    • The Journal of Information Technology and Database
    • /
    • v.7 no.1
    • /
    • pp.27-39
    • /
    • 2000
  • In this paper, we design and implement a XML management system based on OODBMS that supports structured information retrieval of XML documents. We also propose an object oriented modeling to store and fetch XML documents, to manage image data, and to support versioning for the XML document management system(XMS). The XMS consists of a repository manager that maintains the interfaces for external application programs, a XML instance storage manager that stores XML documents in the database, a XML instance manager that fetches XML documents stored in the database, a XML index manager that creates index for the structure information and the contents of documents, and a query processor that processes various queries.

  • PDF

Query Optimization on Large Scale Nested Data with Service Tree and Frequent Trajectory

  • Wang, Li;Wang, Guodong
    • Journal of Information Processing Systems
    • /
    • v.17 no.1
    • /
    • pp.37-50
    • /
    • 2021
  • Query applications based on nested data, the most commonly used form of data representation on the web, especially precise query, is becoming more extensively used. MapReduce, a distributed architecture with parallel computing power, provides a good solution for big data processing. However, in practical application, query requests are usually concurrent, which causes bottlenecks in server processing. To solve this problem, this paper first combines a column storage structure and an inverted index to build index for nested data on MapReduce. On this basis, this paper puts forward an optimization strategy which combines query execution service tree and frequent sub-query trajectory to reduce the response time of frequent queries and further improve the efficiency of multi-user concurrent queries on large scale nested data. Experiments show that this method greatly improves the efficiency of nested data query.

Gold Storage and Cryopreservation of Grey Mullet(Mugil cephalus) Sperm (숭어(Mugil cephalus) 정자의 냉장.냉동보존)

  • 장영진;최윤희;임한규;고강희
    • Journal of Aquaculture
    • /
    • v.12 no.1
    • /
    • pp.57-62
    • /
    • 1999
  • Experiments were performed to study the activity and fertility of grey mullet (Mugil cephalus) sperm after the courses of cold storage and cryopreservation. The head of spermatozoon showing spherical shape was sized $1.26{\pm}0.08 \{mu}textrm{m}$ in diameter and its nucleus contained numerous granular chromatins. Flagellum of tail showed typical 9+2 structure. Preservation of grey mullet sperm was the most effective when it was stored with serum of the same species at $0^{\circ}C$ and sperm activity index was similar in egg-tris, 0.1 M, 0.3 M and 0.5 M glucose. When grey mullet sperm were cryopreserved in MFRS as diluent with 10% dimethyl sulfoxide was effective compared with other diluents. Some of post-thawed spermatozoa showed the enlarged head and ruptured plasma membrane compared with unfrozen spermatozoa.

  • PDF