• 제목/요약/키워드: Erasure Codes

검색결과 30건 처리시간 0.02초

IR-RBT Codes: A New Scheme of Regenerating Codes for Tolerating Node and Intra-node Failures in Distributed Storage Systems

  • Bian, Jianchao;Luo, Shoushan;Li, Wei;Zha, Yaxing;Yang, Yixian
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제13권10호
    • /
    • pp.5058-5077
    • /
    • 2019
  • Traditional regenerating codes are designed to tolerate node failures with optimal bandwidth overhead. However, there are many types of partial failures inside the node, such as latent sector failures. Recently, proposed regenerating codes can also repair intra-node failures with node-level redundancy but incur significant bandwidth and I/O overhead. In this paper, we construct a new scheme of regenerating codes, called IR-RBT codes, which employs intra-node redundancy to tolerate intra-node failures and serve as the help data for other nodes during the repair operation. We propose 2 algorithms for assigning the intra-node redundancy and RBT-Helpers according to the failure probability of each node, which can flexibly adjust the helping relationship between nodes to address changes in the actual situation. We demonstrate that the IR-RBT codes improve the bandwidth and I/O efficiency during intra-node failure repair over traditional regenerating codes but sacrifice the storage efficiency.

파운틴 코드의 개요 (Overview of Fountain codes)

  • 박도형;김민규;정세영
    • 정보와 통신
    • /
    • 제24권4호
    • /
    • pp.95-105
    • /
    • 2007
  • 최근 들어 다중 사용자 환경에서 효율적인 정보 전송에 관한 연구가 진행되면서 새로운 방식의 채널 부호화 기술들이 탄생하였다. 파운틴 코드는 Erasure 채널로 표현되는 네트워크 상에서 다수에게 전송하는 브로드캐스팅 및 멀티캐스팅에 적합하도록 개발된 채널 부호화 기술로서, 정보를 무한히 많은 양으로 부호화하여 전송하는 것을 특징으로 한다. 이와 같은 방식의 채널 부호화 기술은 최근 몇 년간 이론적인 측면뿐만 아니라 실제 표준화 측면에서도 활발하게 연구되고 있다. 본 논문에서는 파운틴 코드에 대하여 소개하고 실제 개발된 몇 가지 파운틴 코드를 소개한다. 그리고 파운틴 코드의 향후 응용 가능성에 대해서도 논의한다.

Novel construction of quasi-cyclic low-density parity-check codes with variable code rates for cloud data storage systems

  • Vairaperumal Bhuvaneshwari;Chandrapragasam Tharini
    • ETRI Journal
    • /
    • 제45권3호
    • /
    • pp.404-417
    • /
    • 2023
  • This paper proposed a novel method for constructing quasi-cyclic low-density parity-check (QC-LDPC) codes of medium to high code rates that can be applied in cloud data storage systems, requiring better error correction capabilities. The novelty of this method lies in the construction of sparse base matrices, using a girth greater than 4 that can then be expanded with a lift factor to produce high code rate QC-LDPC codes. Investigations revealed that the proposed large-sized QC-LDPC codes with high code rates displayed low encoding complexities and provided a low bit error rate (BER) of 10-10 at 3.5 dB Eb/N0 than conventional LDPC codes, which showed a BER of 10-7 at 3 dB Eb/N0. Subsequently, implementation of the proposed QC-LDPC code in a softwaredefined radio, using the NI USRP 2920 hardware platform, was conducted. As a result, a BER of 10-6 at 4.2 dB Eb/N0 was achieved. Then, the performance of the proposed codes based on their encoding-decoding speeds and storage overhead was investigated when applied to a cloud data storage (GCP). Our results revealed that the proposed codes required much less time for encoding and decoding (of data files having a 10 MB size) and produced less storage overhead than the conventional LDPC and Reed-Solomon codes.

Redundancy Minimizing Techniques for Robust Transmission in Wireless Networks

  • Kacewicz, Anna;Wicker, Stephen B.
    • Journal of Communications and Networks
    • /
    • 제11권6호
    • /
    • pp.564-573
    • /
    • 2009
  • In this paper, we consider a wireless multiple path network in which a transmitting node would like to send a message to the receiving node with a certain probability of success. These two nodes are separated by N erasure paths, and we devise two algorithms to determine minimum redundancy and optimal symbol allocation for this setup. We discuss the case with N = 3 and then extend the case to an arbitrary number of paths. One of the algorithms minimum redundancy algorithm in exponential time is shown to be optimal in several cases, but has exponential running time. The other algorithm, minimum redundancy algorithm in polynomial time, is sub-optimal but has polynomial worstcase running time. These algorithms are based off the theory of maximum-distance separable codes. We apply the MRAET algorithm on maximum-distance separable, Luby transform, and Raptor codes and compare their performance.

A Simple Coded ARQ for Satellite Broadcasting

  • Liva, Gianluigi;Kissling, Christian;Hausl, Christoph
    • Journal of Communications and Networks
    • /
    • 제12권6호
    • /
    • pp.577-581
    • /
    • 2010
  • We introduce a novel packet retransmission technique which improves the efficiency of automatic retransmission query (ARQ) protocols in the context of satellite broadcast/multicast systems. The proposed coded ARQ technique, similarly to fountain coding, performs transmission of redundant packets, which are made by linear combinations of the packets composing the source block. Differently from fountain codes, the packets for the linear combinations are selected on the basis of the retransmission requests coming from the user terminals. The selection is performed in a way that, at the terminals, the source packets can be recovered iteratively by means of simple back-substitutions. This work aims at providing a simple and efficient alternative to reliable multicast protocols based on erasure correction coding techniques.

Reliable Data Transmission Based on Erasure-resilient Code in Wireless Sensor Networks

  • Lei, Jian-Jun;Kwon, Gu-In
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제4권1호
    • /
    • pp.62-77
    • /
    • 2010
  • Emerging applications with high data rates will need to transport bulk data reliably in wireless sensor networks. ARQ (Automatic Repeat request) or Forward Error Correction (FEC) code schemes can be used to provide reliable transmission in a sensor network. However, the naive ARQ approach drops the whole frame, even though there is a bit error in the frame and the FEC at the bit level scheme may require a highly complex method to adjust the amount of FEC redundancy. We propose a bulk data transmission scheme based on erasure-resilient code in this paper to overcome these inefficiencies. The sender fragments bulk data into many small blocks, encodes the blocks with LT codes and packages several such blocks into a frame. The receiver only drops the corrupted blocks (compared to the entire frame) and the original data can be reconstructed if sufficient error-free blocks are received. An incidental benefit is that the frame error rate (FER) becomes irrelevant to frame size (error recovery). A frame can therefore be sufficiently large to provide high utilization of the wireless channel bandwidth without sacrificing the effectiveness of error recovery. The scheme has been implemented as a new data link layer in TinyOS, and evaluated through experiments in a testbed of Zigbex motes. Results show single hop transmission throughput can be improved by at least 20% under typical wireless channel conditions. It also reduces the transmission time of a reasonable range of size files by more than 30%, compared to a frame ARQ scheme. The total number of bytes sent by all nodes in the multi-hop communication is reduced by more than 60% compared to the frame ARQ scheme.

펄스형 Jamming 신호가 존재하는 주파수 도약 대역확산 통신환경에서 쇄상부호 시스템의 적응 복호화 방식 (Adaptive Decoding Scheme of Concatenated Codes for Frequency-Hopped Spread-Spectrum Communications with a Pulse-Burst Jamming)

  • 김정곤;김성대;김형명
    • 한국통신학회논문지
    • /
    • 제19권7호
    • /
    • pp.1234-1243
    • /
    • 1994
  • 본 논문에서는 pulse burst jammer가 존재하는 주파수 도약 대역확산 통신 환경하에서 쇄상부호 시스템의 적응 복호화 방식을 제안하고, 그것의 성능을 분석하였다. 쇄상부호 시스템의 내부부호로는 이진 BCH 부호를 사용하였고, 외부부호로는 널리 알려진 리드 솔로몬(Reed-Solomon) 부호를 사용하였다. 본 논문에서 고려된 복호화 방식은 통식채널을 통과할 때 발생하는 일반적인 잡음에 의한 비트오류 뿐만 아니라, Jammer에 대한 side information을 이용하여 발생되는 erasure까지 동시에 정정할 수 있는 복호화 기법을 사용하였으며, 특히 제안된 적응 복호화 방식에서는 가해지는 jamming 신호의 크기에 따라 적응적으로 복호화 방식을 변화시킴으로써 jamming 신호의 변화에 효과적으로 대처할 수 있도록 하였다. 복호화 방식의 성능 평가를 위해 전체 블록 오류 확률이 사용되었으며, 컴퓨터 계산 결과, 제안된 적응 복호화 방식의 성능이 기존의 복호화 방식보다 훨씬 우수함을 볼 수 있다.

  • PDF

군집 소실 채널 상에서의 인터리빙된 짧은 코드의 성능 분석 (Performance Analysis of Interleaved Short Length Codes over Burst Erasure Channel)

  • 장재윤;장민;김상효;이성준
    • 한국방송∙미디어공학회:학술대회논문집
    • /
    • 한국방송공학회 2009년도 추계학술대회
    • /
    • pp.281-283
    • /
    • 2009
  • 본 논문에서는 군집 소실 채널 상에서 동작할 수 있는 짧은 길이의 인터리빙 된 코드들의 성능을 분석한다. 먼저 좋은 성능을 갖는 짧은 길이의 그래프 부호와 해밍부호를 설계한다. 이 후 군집 소실에 잘 대응하기 위하여 인터리빙 기능을 채널 부호화 방법에 적용한다. 생성된 짧은 코드에 적용한 인터리빙 부호를 군집 소실에 최적의 성능을 보이는 Reed-Solomon (RS) 부호와 성능을 비교한다. 짧은 길이의 부호이므로, ML(Maximum Likelihood)방법과 BP(Belief propagation)의 두 가지 복호 방법들을 이용한 경우 성능의 차이 또한 비교해 본다.

  • PDF

효율적인 정도 생성기 및 새로운 순열 기법을 가진 LT 코덱 구조 (A LT Codec Architecture with an Efficient Degree Generator and New Permutation Technique)

  • 하산 타릭;최광석
    • 디지털산업정보학회논문지
    • /
    • 제10권4호
    • /
    • pp.117-125
    • /
    • 2014
  • In this paper, a novel hardware architecture of the LT codec is presented where non-BP based decoding algorithm is applied. Novel LT codec architecture is designed with an efficient degree distribution unit using Verilog HDL. To perform permutation operation, different initial valued or time shifted counters have been used to get pretty well permutations and an effect of randomness. The codec will take 128 bits as input and produce 256 encoded output bits. The simulation results show expected performances as the implemented distribution and the original distribution are pretty same. The proposed LT codec takes 257.5 cycle counts and $2.575{\mu}s$ for encoding and decoding instead of 5,204,861 minimum cycle counts and 4.43s of the design mentioned in the previous works where iterative soft BP decoding was used in ASIC and ASIP implementation of the LT codec.

대칭용량 달성을 위한 극 퀀텀 채널 코딩 (Polar Quantum Channel Coding for Symmetric Capacity Achieving)

  • 양재승;박주용;이문호
    • 전자공학회논문지
    • /
    • 제50권8호
    • /
    • pp.3-14
    • /
    • 2013
  • 본 논문에서는 어떠한 이진 입력 이산 퀀텀채널(quantum channel)이 주어지더라도 대칭 용량을 달성할 수 있는 qubit(quantum bit)를 생성하기 위해, 극(polar) 퀀텀 채널 코딩이라 부르는 퀀텀 채널의 결합과 분리 형태를 제시한다. 현재의 용량은 동등 확률을 갖는 임의의 qubit 입력에 따라서 결정된다. 퀀텀채널의 분극은 대칭채널이 1에 근접하면 rate 1로 아니면 rate 0으로 전송하는 채널을 통해 퀀텀 데이터를 부분적으로 전송하는 퀀텀 오류정정 부호화에 아주 적합하다.