• Title/Summary/Keyword: In-Page Logging

Search Result 11, Processing Time 0.023 seconds

Applying In-Page Logging to SQLite DBMS (SQLite DBMS에 IPL 기법 응용)

  • Na, Gap-Joo;Kim, Sang-Woo;Kim, Jae-Myung;Lee, Sang-Won
    • Journal of KIISE:Databases
    • /
    • v.35 no.5
    • /
    • pp.400-410
    • /
    • 2008
  • Flash memory has been widely used in mobile devices, such as mobile phone and digital camera. Recently flash SSD(Solid State Disk), having same interface of the disk drive, is replacing the hard disk of some laptop computers. However, flash memory still cannot be considered as the storage of database systems. The FTL(Flash Translation Layer) of commercial flash SSD, making flash memory operate exactly same as a hard disk, shows poor performance on the workload of databases with many random overwrites. Recently In-Page Logging(IPL) approach was proposed to solve this problem. In this paper, we implement IPL approach on SQLite, a popular open source embedded DBMS, and evaluate its performance. It improves the performance by up to 30 factors for update queries.

Page Logging System for Web Mining Systems (웹마이닝 시스템을 위한 페이지 로깅 시스템)

  • Yun, Seon-Hui;O, Hae-Seok
    • The KIPS Transactions:PartC
    • /
    • v.8C no.6
    • /
    • pp.847-854
    • /
    • 2001
  • The Web continues to grow fast rate in both a large aclae volume of traffic and the size and complexity of Web sites. Along with growth, the complexity of tasks such as Web site design Web server design and of navigating simply through a Web site have increased. An important input to these design tasks is the analysis of how a web site is being used. The is paper proposes a Page logging System(PLS) identifying reliably user sessions required in Web mining system PLS consists of Page Logger acquiring all the page accesses of the user Log processor producing user session from these data, and statements to incorporate a call to page logger applet. Proposed PLS abbreviates several preprocessing tasks which spends a log of time and efforts that must be performed in Web mining systems. In particular, it simplifies the complexity of transaction identification phase through acquiring directly the amount of time a user stays on a page. Also PLS solves local cache hits and proxy IPs that create problems with identifying user sessions from Web sever log.

  • PDF

A New Flash-aware Buffering Scheme Supporting Virtual Page Flushing

  • Lim, Seong-Chae
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.14 no.3
    • /
    • pp.161-170
    • /
    • 2022
  • Recently, NAND-type flash memory has been regarded to be new promising storage media for large-scale database systems. For flash memory to be employed for that purpose, we need to reduce its expensive update cost caused by the inablity of in-place updates. To remedy such a drawback in flash memory, we propose a new flash-aware buffering scheme that enables virtual flushing of dirty pages. To this end, we slightly alter the tradional algorithms used for the logging scheme and buffer management scheme. By using the mechanism of virtual flushing, our proposed buffering scheme can efficiently prevent the frequenct occureces of page updates in flash storage. Besides the advantage of reduced page updates, the proposed viurtual flushing mechanism works favorably for shorneing a recocery time in the presense of failure. This is because it can reduce the time for redo actions during a recovry process. Owing to those two benefits, we can say that our scheme couble be very profitable when it is incorporated into cutting-edge flash-based database systems.

An Auxiliary Log Area for In-Page Logging Scheme (In-Page 로깅 기법을 위한 보조 로그 영역)

  • Van, Jae-Kwang;Jin, Rize;Kim, Sungsoo;Chung, Tae-Sun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2014.04a
    • /
    • pp.729-731
    • /
    • 2014
  • 플래시 메모리에서 B-tree 데이터를 저장하고 관리[4, 5]할 때 빈번한 수정과 구조변동으로 인해 발생하는 블록에 대한 쓰기와 지우기 연산의 비용으로 인해 플래시 메모리의 사용 수명을 단축시키는 문제를 해결하기 위해 현재 많이 쓰이고 있는 로그 저장방식을 검토하고 이를 효율적으로 B-tree에 저장하고 관리하도록 동적 블록 그룹핑과 순환 순서 기반의 저장 알고리즘으로 제안 된 GRR (Ground Round Robin) 기법을 보조 로그 블록을 할당하여 머지횟수를 줄일 수 있는 알고리즘을 제안한다.

Development of Web-Based Wind Data Analysis System for HeMOSU-1 (웹기반 해모수-1 풍황자료 분석 시스템 개발)

  • Ryu, Ki-Wahn;Park, Kun-Sung;Lee, Jong-Hwa;Oh, Soo-Yun;Kim, Ji-Young;Park, Myoung-Ho
    • Journal of Wind Energy
    • /
    • v.4 no.1
    • /
    • pp.60-67
    • /
    • 2013
  • A web-based program was developed for analyzing weather and structure data from the HeMOSU-1 offshore meteorological mast installed by the KEPCO Research Institute, and 35 km west-southwestward away from Gyeokpo located in Jeonbuk province. All of the measured data are obtained through the data transmitter and the server systems equipped on the HeMOSU-1 and the aerodynamic laboratory in Chonbuk National University respectively. The dualised server system consists of two servers, one is for logging the 1 second based raw data with 10 minute averaged values, and the other is for managing web page with processed weather data. Daily or weekly 10-min averaged data can be provided based on the input date by users. Processed weather data such as wind rose, Weibull distribution, diurnal distribution, turbulence intensity according to wind speed, wind energy density, and so forth are visualized through the web page which would be both useful and informative for developing the wind farm or designing a wind blade for the wind farm nearby southwest sea around the Korean Peninsula. The URL for this web page is http://www.hemosu.org/.

Delayed Write Scheme to Enhance Write Performance of Flash Memory Based Embedded Database Systems (플래시 메모리 기반 임베디드 데이터베이스 시스템의 쓰기 성능 향상을 위한 지연쓰기 기법)

  • Song, Ha-Joo;Kwon, Oh-Heum
    • Journal of Korea Multimedia Society
    • /
    • v.12 no.2
    • /
    • pp.165-177
    • /
    • 2009
  • Embedded database systems (EDBMS) based on NAND flash memories are widely adopted for logging data on sensor nodes. Since write and erase operations of a flash memory are time consuming compared to read operations and wear memory cells, it is important to reduce these operations to enhance the EDBMS performance and to extend the memory life. In this paper, we propose a delayed write scheme to archive this goal. Proposed scheme stores updated parts of database pages into delayed write records to reduce the database page writes. By doing that, it decreases write and erase operations on a flash memory. Therefore, the proposed scheme enhances the logging performance of a write-intensive EDBMS on a sensor node and extends the flash memory life.

  • PDF

A Recovery Scheme of SSD-based Databases using Snapshot Log (스냅샷 로그를 사용한 SSD 기반 데이터베이스 복구 기법)

  • Lim, Seong-Chae
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.19 no.4
    • /
    • pp.85-91
    • /
    • 2019
  • In this paper, we propose a new logging and recovery scheme that is suited for the high-performance transaction processing system base on flash memory storage. The proposed scheme is designed by considering flash's I/O characteristic of asymmetric costs between page update/read operations. That is, we substitute the costly update operation with writing and real-time usage of snapshot log, which is for the page-level physical redo. From this, we can avoid costly rewriting of a dirty page when it is evicted form a buffering pool. while supporting efficient revery procedure. The proposed scheme would be not lucrative in the case of HDD-based system. However, the proposed scheme offers the performance advance sush as a reduced number of updates and the fast system recovery time, in the case of flash storage such as SSD (solid state drive). Because the proposed scheme can easily be applied to existing systems by saving our snapshot records and ordinary log records together, our scheme can be used for improving the performance of upcoming SSD-based database systems through a tiny modification to existing REDO algorithms.

IPL based Berkeley DBMS (IPL 기반의 Berkeley DBMS)

  • Kim, Kang-Nyeon;Na, Gap-Joo;Lee, Sang-Won
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2009.11a
    • /
    • pp.773-774
    • /
    • 2009
  • 최근 낸드 플래시 메모리가 차세대 저장장치로 부상하면서 수십 년간 DBMS의 저장장치였던 하드디스크의 대안으로 주목 받고 있다. 낸드 플래시 메모리는 하드 디스크와 인터페이스가 다르기 때문에 일반적으로 플래시 변환 계층을 사용하여 기존 소프트웨어와 호환성을 유지한다. 하지만 플래시 변환 계층은 소량의 랜덤 쓰기가 빈번한 DBMS 환경에서 비효율적인 방식이다. 이러한 문제점을 극복하기 위해 DBMS의 특성을 고려한 In-Page Logging(IPL) 기법이 제안되었다. IPL 기법은 우수한 성능과 복구의 용이성 외에도 DBMS 구조를 크게 변경하지 않고 구현이 가능한 것이 장점이다. 본 논문의 목적은 IPL 기법을 활용하여 상용 DBMS에서 최소한의 변화만으로 낸드 플래시 메모리를 저장 장치로 사용 할 수 있음을 증명하는 것이다. 이를 위해 Berkeley DBMS에 IPL 기법을 구현하며 성능 평가를 통해 IPL 기법이 상용 DBMS 에서도 우수한 성능을 보이는 것을 확인한다.

Efficient Flash Memory Access Power Reduction Techniques for IoT-Driven Rare-Event Logging Application (IoT 기반 간헐적 이벤트 로깅 응용에 최적화된 효율적 플래시 메모리 전력 소모 감소기법)

  • Kwon, Jisu;Cho, Jeonghun;Park, Daejin
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.14 no.2
    • /
    • pp.87-96
    • /
    • 2019
  • Low power issue is one of the most critical problems in the Internet of Things (IoT), which are powered by battery. To solve this problem, various approaches have been presented so far. In this paper, we propose a method to reduce the power consumption by reducing the numbers of accesses into the flash memory consuming a large amount of power for on-chip software execution. Our approach is based on using cooperative logging structure to distribute the sampling overhead in single sensor node to adjacent nodes in case of rare-event applications. The proposed algorithm to identify event occurrence is newly introduced with negative feedback method by observing difference between past data and recent data coming from the sensor. When an event with need of flash access is determined, the proposed approach only allows access to write the sampled data in flash memory. The proposed event detection algorithm (EDA) result in 30% reduction of power consumption compared to the conventional flash write scheme for all cases of event. The sampled data from the sensor is first traced into the random access memory (RAM), and write access to the flash memory is delayed until the page buffer of the on-chip flash memory controller in the micro controller unit (MCU) is full of the numbers of the traced data, thereby reducing the frequency of accessing flash memory. This technique additionally reduces power consumption by 40% compared to flash-write all data. By sharing the sampling information via LoRa channel, the overhead in sampling data is distributed, to reduce the sampling load on each node, so that the 66% reduction of total power consumption is achieved in several IoT edge nodes by removing the sampling operation of duplicated data.

Support of a Web Transaction Processing System for Preserving Consistency (웹 트랜잭션 처리 시스템의 일관성 유지 지원)

  • Lee, Gang-U;Kim, Hyeong-Ju
    • Journal of KIISE:Software and Applications
    • /
    • v.26 no.8
    • /
    • pp.946-954
    • /
    • 1999
  • 웹의 등장으로 전자 업무 처리는 급격한 성장을 보여왔다. 많은 업계에서는 업무 처리에 있어 핵심이 되는 트랜잭션을 웹에서 처리하기 위한 시스템 개발에 많은 노력을 기울여왔다. 그러나 대부분의 웹 트랜잭션 연구는 주로 CGI 방식의 트랜잭션 처리 성능의 한계를 극복하거나, 여러 HTTP 요청간의 상태 유지 방법 또는 시스템의 확장성 등에 대해 연구가 집중된 반면, 부적합한 웹 환경으로 유발되는 시스템의 일관성 손실에 대해서는 많은 관심을 받지 못했다.본 논문에서는 웹 상에서 신뢰성 있는 트랜잭션을 처리하는 경우 발생되는 세 가지 문제점을 지적하고, 이를 막기 위해 웹 트랜잭션 처리 시스템인 WebTP에서 제공하는 해결책을 제안한다. 제안한 해결책은 쿠키 로깅, 웹 페이지 로깅, 그리고 일방적으로 철회된 트랜잭션의 상태를 유지하는 기법을 근간으로 한다. 또한 제안된 방법은 유사 구조의 타 웹 트랜잭션 처리 시스템에서도 적용 가능하다.Abstract Electronic business processing has drastically grown since the advent of the World Wide Web. As transaction processing is at heart of business processing, many companies have been interested in transaction processing on the Web. However, little attention has been paid to supporting consistent transaction processing on the Web, while most of the work has been focused on performance enhancement, processing multiple HTTP requests in a single context, and scalability.This paper identifies three problems in consistent transaction processing on the Web, and proposes corresponding solutions for each problem. The results are implemented in the Web transaction processing system WebTP. These solutions are based on cookie logging, Web page logging and keeping information for unilaterally aborted transactions. The solutions proposed in this paper also can be applied to other Web transaction processing system of similar architecture.