• 한국산학기술학회논문지
• /
• 제14권5호
• /
• pp.2449-2456
• /
• 2013

컬럼-기반 데이터베이스 저장소는 우수한 입출력 성능으로 대용량 데이터 분석 시스템을 위한 매우 진보적인 모델이다. 전통적인 데이터 저장소는 빠른 쓰기 연산을 위하여 한 레코드의 속성들을 하드 디스크에 연속적으로 배치되어 있는 가로-지향 저장 모델을 활용하였다. 하지만 검색이 대부분인 데이터웨어하우스 시스템을 위해서는 월등한 판독 성능 때문에 컬럼-지향 저장소가 더 적합한 모델이 되고 있다. 또한 최근에는 MLC 플래시 메모리를 사용한 SSD가 고속 데이터 분석 시스템을 위한 적합한 저장 매체로 인식되고 있다. 본 논문에서는 고속 컬럼-지향 데이터 저장소 모델을 도입하고, 고속 컬럼-지향 데이터웨어하우스 시스템을 위한 교차 압축 이중화를 활용하는 새로운 저장소 관리 기법을 제안한다. 본 저장소 관리 기법은 두 개의 MLC SSD에 기반하며, 압축과 비압축된 세그먼트의 교차 이중화를 통하여 높은 CPU 및 입출력 부하에서도 우수한 저장 성능과 안정성을 얻는다. 성능 평가 결과를 통하여 본 저장소 관리 기법이 기존 기법보다 컬럼 세그먼트 갱신 처리치 및 그 응답시간 측면에서 더 우수함을 확인하였다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제10권9호
• /
• pp.4063-4086
• /
• 2016

Cloud computing is a robust technology, which facilitate to resolve many parallel distributed computing issues in the modern Big Data environment. Hadoop is an ecosystem, which process large data-sets in distributed computing environment. The HDFS is a filesystem of Hadoop, which process data blocks to the cluster nodes. The data block placement has become a bottleneck to overall performance in a Hadoop cluster. The current placement policy assumes that, all Datanodes have equal computing capacity to process data blocks. This computing capacity includes availability of same storage media and same processing performances of a node. As a result, Hadoop cluster performance gets effected with unbalanced workloads, inefficient storage-tier, network traffic congestion and HDFS integrity issues. This paper proposes a storage-tier-aware Robust Data Placement (RDP) scheme, which systematically resolves unbalanced workloads, reduces network congestion to an optimal state, utilizes storage-tier in a useful manner and minimizes the HDFS integrity issues. The experimental results show that the proposed approach reduced unbalanced workload issue to 72%. Moreover, the presented approach resolve storage-tier compatibility problem to 81% by predicting storage for block jobs and improved overall data block placement by 78% through pre-calculated computing capacity allocations and execution of map files over respective Namenode and Datanodes.

• 정보저장시스템학회논문집
• /
• 제1권2호
• /
• pp.155-160
• /
• 2005

In this paper, the channel decoder promising reliable data retrieving in noisy holographic channel has been developed for holographic WORM(write once read many) system. It covers various DSP(digital signal processing) blocks, such as align mark detector, adaptive channel equalizer, modulation decoder and ECC(error correction code) decoder. The specific schemes of DSP are designed to reduce the effect of noises in holographic WORM(H-WORM) system, particularly in prototype of DAEWOO electronics(DEPROTO). For real time data retrieving, the channel decoder is redesigned for FPGA(field programmable gate array) based hardware, where DSP blocks calculate in parallel sense with memory buffers between blocks and controllers for driving peripherals of FPGA. As an input source of the experiments, MPEG2 TS(transport stream) data was used and recorded to DEPROTO system. During retrieving, the CCD(charge coupled device), capturing device of DEPROTO, detects retrieved images and transmits signals of them to the FPGA of hardware channel decoder. Finally, the output data stream of the channel decoder was transferred to the MPEG decoding board for monitoring video signals. The experimental results showed the error corrected BER(bit error rate) of less than $10^{-9}$, from the raw BER of DEPROTO, about $10^{-3}$. With the developed hardware channel decoder, the real-time video demonstration was possible during the experiments. The operating clock of the FPGA was 60 MHz, of which speed was capable of decoding up to 120 mega channel bits per sec.

• Genomics & Informatics
• /
• 제18권2호
• /
• pp.16.1-16.5
• /
• 2020

There has been a dramatic increase in the popularity of utilizing social media data for research purposes within the biomedical community. In PubMed alone, there have been nearly 2,500 publication entries since 2014 that deal with analyzing social media data from Twitter and Reddit. However, the vast majority of those works do not share their code or data for replicating their studies. With minimal exceptions, the few that do, place the burden on the researcher to figure out how to fetch the data, how to best format their data, and how to create automatic and manual annotations on the acquired data. In order to address this pressing issue, we introduce the Social Media Mining Toolkit (SMMT), a suite of tools aimed to encapsulate the cumbersome details of acquiring, preprocessing, annotating and standardizing social media data. The purpose of our toolkit is for researchers to focus on answering research questions, and not the technical aspects of using social media data. By using a standard toolkit, researchers will be able to acquire, use, and release data in a consistent way that is transparent for everybody using the toolkit, hence, simplifying research reproducibility and accessibility in the social media domain.

• 정보저장시스템학회:학술대회논문집
• /
• 정보저장시스템학회 2005년도 추계학술대회 논문집
• /
• pp.47-52
• /
• 2005

A lot of information storage devices have been introduced and developed for recently years. The trends of those devices are high capacity, compact size, low power consumption, reliability, and removability for data interchange with other device. As a satisfaction of these trends, near-field technique is in the spotlight as the next generation device. In order for a near-field recording to be successfully implemented in the storage device, a slider and suspension is introduced as actuating mechanism. The optical slider is designed considering near-filed optics. Suspension is not only supports slider performance, and tracking servo capacity but also meets the optical characteristics such as tilt aberration, and guarantee to satisfy shock performances for the mobility fir the actuator. In this study, the optical slider and the suspension for near-field probe array are designed and analyzed considering dynamic performance of head-gimbal assembly and shock simulation..

• Journal of Information Processing Systems
• /
• 제11권3호
• /
• pp.389-405
• /
• 2015

Most traditional database systems exploit a record-oriented model where the attributes of a record are placed contiguously in a hard disk to achieve high performance writes. However, for read-mostly data warehouse systems, the column-oriented database has become a proper model because of its superior read performance. Today, flash memory is largely recognized as the preferred storage media for high-speed database systems. In this paper, we introduce a column-oriented database model based on flash memory and then propose a new column-aware flash indexing scheme for the high-speed column-oriented data warehouse systems. Our index management scheme, which uses an enhanced $B^+$-Tree, achieves superior search performance by indexing an embedded segment and packing an unused space in internal and leaf nodes. Based on the performance results of two test databases, we concluded that the column-aware flash index management outperforms the traditional scheme in the respect of the mixed operation throughput and its response time.

• 스마트미디어저널
• /
• 제12권11호
• /
• pp.145-153
• /
• 2023

피어들의 접속과 이탈이 빈번한 P2P 기반의 분산 저장 시스템에서 실시간 제약 조건을 가지는 비디오 파일에 대해 데이터 가용성뿐만 아니라 재생 시 로컬 저장 장치에서 제공하는 수준의 품질을 보장하는 것이 필수적이다. 또한, 분산 저장 시스템 기반의 클라우드 저장 서비스에서는 각 사용자가 자신의 파일을 다른 사용자와 공유하는 기능을 제공하기 때문에 여러 사용자가 동일한 비디오 파일에 대해 동시에 재생을 요청하는 경우 모든 재생이 실시간으로 끊김 없이 지원되어야 한다. 따라서, 본 논문에서는 파일 공유를 지원하는 P2P 기반의 분산 저장 시스템에서 데이터 가용성뿐만 아니라 각 비디오 파일에 대해 동시에 요청되는 여러 재생들을 실시간 처리할 수 있는 기법을 제안한다. 이 기법은 각 비디오 파일에 대한 사용자의 재생 요청 수에 맞게 이레이져 코딩으로 인코딩된 중복 데이터의 양을 조절하여 실시간 동시 재생을 지원할 수 있으며 저장 공간을 효율적으로 사용할 수 있다.

• E2M - 전기 전자와 첨단 소재
• /
• 제8권2호
• /
• pp.229-236
• /
• 1995

Multimedia has created a system environment that needs a combination of diverse peripherals, faster I/O, and easier configuration. The sheer volume of data one can expect with multimedia hardware and applications storage systems of higher capacity and faster data transfer rate. Unlike the magneto-optical(MO)disk technology which uses bias magnetic field in writing, both the reading and the writing in the phase change (PC) technology are performed only by laser light. In PC optical media, an active layer is reversibly converted between amorphous state and crystalline state by changing irradiation conditions of focused laser beam. Thus, as compared with MO disk, the PC disk has such great advantages that signals can be reproduced by change of reflectance of laser beams in the same manner as the compact disc. The reflectivity of a phase-change spot can be altered in a single pass under the head only through modulation of laser power. The principles and the current status of phase-change optical recording media combined with possible applications are discussed in the present article.

• 한국정밀공학회지
• /
• 제18권4호
• /
• pp.37-45
• /
• 2001

• Restorative Dentistry and Endodontics
• /
• 제49권1호
• /
• pp.6.1-6.16
• /
• 2024

Objectives: This study aimed to investigate the elemental analysis and microhardness of a bioactive material (Activa) and marginal tooth structure after storage in different media. Materials and Methods: Fifteen teeth received cervical restorations with occlusal enamel and gingival dentin margins using the tested material bonded with a universal adhesive, 5 of them on the 4 axial surfaces and the other 10 on only the 2 proximal surfaces. The first 5 teeth were sectioned into 4 restorations each, then stored in 4 different media; deionized water, Dulbecco's phosphate buffered saline (DPBS), Tris buffer, and saliva. The storage period for deionized water was 24 hours while it was 3 months for the other media. Each part was analyzed by scanning electron microscopy-energy dispersive spectroscopy (SEM-EDS) analysis for different substrates/distances and the wt% of calcium, phosphorus, silica, and fluoride were calculated. The other 10 teeth were sectioned across the restoration, stored in either Tris buffer or saliva for 24 hours or 3 months, and were evaluated for microhardness of different substrates/areas. Data were analyzed using analysis of variance and Tukey's post hoc test. Results: Enamel and dentin interfaces in the DPBS group exhibited a significant increase in calcium and phosphorus wt%. Both silica and fluoride significantly increased in tooth structure up to a distance of 75 ㎛ in the 3-month-media groups than the immediate group. Storage media did not affect the microhardness values. Conclusions: SEM-EDS analysis suggests an ion movement between Activa and tooth structure through a universal adhesive while stored in DPBS.