• Title/Summary/Keyword: Lempel-Ziv

Search Result 28, Processing Time 0.035 seconds

Development on Improved of LZW Compression Algorithm by Mixed Text File for Embedded System (임베디드시스템을 위한 혼용텍스트 파일의 개선된 LZW 압축 알고리즘 구현)

  • Cho, Mi-Nam;Ji, Yoo-Kang
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.12
    • /
    • pp.70-76
    • /
    • 2010
  • This paper Extended ELZW(EBCDIC Lempel Ziv Welch) algorithm uses 2 byte prefix field for pointer of a table and 1 byte suffix field for repeat counter. where, a prefix field uses a pointer(index) of compression table and a suffix field uses a counter of overlapping or recursion text data in compression table. To increase compression ratio, after construction of compression table, table data are properly packed as different bit string in accordance with a alphabet, Hangeul, and pointer respectively. Therefore, proposed ELZW algorithm is superior to 1byte LZW algorithm as 5.22 percent and superior to 2byte LZW algorithm as 8.96 percent.

Data compresson for high speed data transmission (고속전송을 위한 V.42bis 데이터 압축 기법의 개선)

  • Cho, Sung-Ryul;Choi, Hyuk;Kim, Tae-Young;Kim, Tae-Jeong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.23 no.7
    • /
    • pp.1817-1823
    • /
    • 1998
  • V.42bis, a type of LZW(Lempel-Ziv-Welch) code, is well-known as theinter national standard is asynchronous data compression. In this paper, we analyze several undesirable phenomena arising from the application of v.42bis to high speed data transmission, and we propose a modified technique to overcome them. the proposed technique determines the proper size of the dictionary, one of important factors affecting the compression ratio, and improves the method of dictionary generation for a higher compression ratio. Furthermore, we analyze the problem of excessive mode changes and solve it to a certain degree by adjusting the threshold for mode change. By doing this, we can achieve smiller variation of the compression ratio in time. This improvement chtributes to easier and better design and control of the buffer in high speed data transmission.

  • PDF

Energy Efficient and Low-Cost Server Architecture for Hadoop Storage Appliance

  • Choi, Do Young;Oh, Jung Hwan;Kim, Ji Kwang;Lee, Seung Eun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.12
    • /
    • pp.4648-4663
    • /
    • 2020
  • This paper proposes the Lempel-Ziv 4(LZ4) compression accelerator optimized for scale-out servers in data centers. In order to reduce CPU loads caused by compression, we propose an accelerator solution and implement the accelerator on an Field Programmable Gate Array(FPGA) as heterogeneous computing. The LZ4 compression hardware accelerator is a fully pipelined architecture and applies 16 dictionaries to enhance the parallelism for high throughput compressor. Our hardware accelerator is based on the 20-stage pipeline and dictionary architecture, highly customized to LZ4 compression algorithm and parallel hardware implementation. Proposing dictionary architecture allows achieving high throughput by comparing input sequences in multiple dictionaries simultaneously compared to a single dictionary. The experimental results provide the high throughput with intensively optimized in the FPGA. Additionally, we compare our implementation to CPU implementation results of LZ4 to provide insights on FPGA-based data centers. The proposed accelerator achieves the compression throughput of 639MB/s with fine parallelism to be deployed into scale-out servers. This approach enables the low power Intel Atom processor to realize the Hadoop storage along with the compression accelerator.

Design of the ICMEP Algorithm for the Highly Efficient Entropy Encoding (고효율 엔트로피 부호화를 위한 ICMEP 알고리즘 설계)

  • 이선근;임순자;김환용
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.41 no.4
    • /
    • pp.75-82
    • /
    • 2004
  • The channel transmission ratio is speeded up by the combination of the Huffman algorithm, the model scheme of the lossy transform having minimum average code lengths for the image information and good instantaneous decoding capability, with the Lempel-Ziv algorithm showing the fast processing performance during the compression process. In order to increase the processing speed during the compression process, ICMEP algorithm is proposed and the entropy encoder of HDTV is designed and inspected. The ICMEP entropy encoder have been designed by choosing the top-down method and consisted of the source codes and the test benches by the behavior expression with VHDL. As a simulation results, implemented ICMEP entropy encoder confirmed that whole system efficiency by memory saturation prevention and compressibility increase improves.

Data compression algorithm with two-byte codeword representation (2바이트 코드워드 표현방법에 의한 자료압축 알고리듬)

  • 양영일;김도현
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.34C no.3
    • /
    • pp.23-36
    • /
    • 1997
  • In tis paper, sthe new data model for the hardware implementation of lempel-ziv compression algorithm was proposed. Traditional model generates the codeword which consists of 3 bytes, the last symbol, the position and the matched length. MSB (most significant bit) of the last symbol is the comparession flag and the remaining seven bits represent the character. We confined the value of the matched length to 128 instead of 256, which can be coded with seven bits only. In the proposed model, the codeword consists of 2 bytes, the merged symbol and the position. MSB of the merged symbol is the comression flag. The remaining seven bits represent the character or the matched length according to the value of the compression flag. The proposed model reduces the compression ratio by 5% compared with the traditional model. The proposed model can be adopted to the existing hardware architectures. The incremental factors of the compression ratio are also analyzed in this paper.

  • PDF

A Lossless compression of Medical Images using Global & Local redundancy (전역적.국부적 중복성을 이용한 의료영상의 무손실 압축)

  • Lee, J.S.;Kwon, O.S.;Han, Y.H.;Hong, S.H.
    • Proceedings of the KOSOMBE Conference
    • /
    • v.1996 no.11
    • /
    • pp.293-296
    • /
    • 1996
  • In this paper, we studied two image characteristics, similarity and smoothness, which give rise to local and global redundancy in image representation. The similarty means that any patterns in the image repeat itself anywhere in the rest of image. The smoothness means that the gray level values within a given block vary gradually rather than abruptly. In this sense, we propose a lossless medical image compression scheme which exploits both types of redundancy. This method segments the image into variable size blocks and encodes them depending on characteristics of the block. The proposed compression schemes works better than other compression schemes such as the huffman, the arithmetic, the Lempel-Ziv and the lossless scheme of JPEG.

  • PDF

Design of LZW-Bit Vector Compression Algorithm for Effective BiometricData Transmission in M2M Environment (M2M기반 효율적인 생체데이터 전송을 위한 LZW-BitVector 압축 알고리즘 설계)

  • Kang, San;Park, Seok-Cheon;Park, Jung-Hwan
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2015.04a
    • /
    • pp.652-654
    • /
    • 2015
  • 최근 ICT융합 기술의 비약적인 발전에 따라 소형 휴대가 가능한 다양한 종류의 생체신호 측정센서의 출현으로 유헬스케어 관련 기술이 비약적으로 발전하게 되면서, 실시간으로 발생하는 생체데이터에 대한 효율적인 처리가 중요하게 되었다. 따라서 본 논문에서는 M2M기반에서 발생되는 생체데이터의 효율적인 전송을 위해 LZW(Lempel-Ziv-Welch) 압축 알고리즘과, BitVector압축 알고리즘을 결합한 LZW-BitVector 압축 알고리즘을 제안한다.

Impacts of Non-Uniform Source on BER for SSC NOMA (Part II): Improved BER Performance Analysis

  • Chung, Kyuhyuk
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.13 no.4
    • /
    • pp.48-54
    • /
    • 2021
  • In most existing researches on non-orthogonal multiple access (NOMA) with symmetric superposition coding (SSC), uniform sources have been usually considered. For the first part in this two-part paper, for the strongest channel gain user, we showed that the bit-error rate (BER) for the optimal maximum a-posteriori (MAP) receiver for the non-uniform source improves slightly, compared to that of the conventional receiver for the uniform sources. We demonstrate that in communication scenarios of the non-uniform source NOMA schemes, for the weakest channel gain user, the BER performance of the optimal MAP receiver for a non-uniform source improves greatly, compared to that of the conventional receiver for uniform sources. We first derive an analytical expression of the BER for non-uniform source NOMA with SSC. Then, simulations demonstrate that the BER of the optimal MAP receiver for the non-uniform source improves, compared with that of the conventional maximum likelihood (ML) receiver for the uniform sources. In result, the proposed optimal MAP receiver for the non-uniform source could be a promising scheme for SSC NOMA, with improved BER performances.

BTS Based Improved BER for Stronger Channel User in Non-Uniform Source SSC NOMA

  • Chung, Kyuhyuk
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.14 no.1
    • /
    • pp.78-84
    • /
    • 2022
  • In this paper, to improve further the bit-error rate (BER) performance of the stronger channel user in non-uniform source non-orthogonal multiple access (NOMA) with symmetric superposition coding (SSC), we propose a smart bit-to-symbol (BTS) mapping of SSC. First, the analytical expression for the total allocated power of the proposed BTS mapping scheme is derived, and then we show that the BER of the proposed BTS mapping scheme improves further, compared to that of the existing BTS mapping scheme. Moreover, based on the simulations, the signal-to-noise (SNR) gain of the proposed BTS mapping scheme over the existing BTS mapping scheme is calculated. In result, the proposed BTS mapping could be a candidate scheme for non-uniform source SSC NOMA with the SNR gain.

Performance Analysis for Weaker Channel User in Non-Uniform Source SSC NOMA with Novel BTS

  • Chung, Kyuhyuk
    • International journal of advanced smart convergence
    • /
    • v.11 no.1
    • /
    • pp.36-41
    • /
    • 2022
  • Recently, to improve the performance of the strongest channel gain user in non-orthogonal multiple access (NOMA) with a non-uniform source and symmetric superposition coding (SSC), a novel bit-to-symbol (BTS) mapping have been proposed. However, only the performance of the user with the stronger channel gain was analyzed. Thus, we compare the bit-error rate (BER) of the new BTS scheme with that of uniform sources, especially for the user with weakest channel gain. First, we show that the performance of the novel BTS scheme for the user with weakest channel gain also improves, compared to that of the uniform sources. Furthermore, the signal-to-noise (SNR) gain of the new BTS scheme over the uniform sourcesis calculated. As a consequence, the novel BTS scheme would improve the performance of the user with weakest channel gain as well as that with the stronger channel gain for SSC NOMA with a non-uniform source.