Browse > Article
http://dx.doi.org/10.3837/tiis.2020.04.015

Convolutional auto-encoder based multiple description coding network  

Meng, Lili (School of Information Science and Engineering, Shandong Normal University)
Li, Hongfei (School of Information Science and Engineering, Shandong Normal University)
Zhang, Jia (School of Information Science and Engineering, Shandong Normal University)
Tan, Yanyan (School of Information Science and Engineering, Shandong Normal University)
Ren, Yuwei (School of Information Science and Engineering, Shandong Normal University)
Zhang, Huaxiang (School of Information Science and Engineering, Shandong Normal University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.4, 2020 , pp. 1689-1703 More about this Journal
Abstract
When data is transmitted over an unreliable channel, the error of the data packet may result in serious degradation. The multiple description coding (MDC) can solve this problem and save transmission costs. In this paper, we propose a deep multiple description coding network (MDCN) to realize efficient image compression. Firstly, our network framework is based on convolutional auto-encoder (CAE), which include multiple description encoder network (MDEN) and multiple description decoder network (MDDN). Secondly, in order to obtain high-quality reconstructed images at low bit rates, the encoding network and decoding network are integrated into an end-to-end compression framework. Thirdly, the multiple description decoder network includes side decoder network and central decoder network. When the decoder receives only one of the two multiple description code streams, side decoder network is used to obtain side reconstructed image of acceptable quality. When two descriptions are received, the high quality reconstructed image is obtained. In addition, instead of quantization with additive uniform noise, and SSIM loss and distance loss combine to train multiple description encoder networks to ensure that they can share structural information. Experimental results show that the proposed framework performs better than traditional multiple description coding methods.
Keywords
Multiple description coding network (MDCN); Convolutional auto-encoder (CAE); Additive noise;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Goyal,V.K, "Multiple description coding:compression meets the network," IEEE Signal Processing Magazine, vol. 18, no. 5, pp. 74-93, 2001.   DOI
2 Vaishampayan V A, "Design of multiple description scalar quantizers," IEEE Transactions on Information Theory, vol. 39, no. 3, pp.821-834, 1993.   DOI
3 Vaishampayan V A, Domaszewicz J, "Design of entropy-constrained multiple-description scalar quantizers," IEEE Transactions on Information Theory, vol. 40, no. 1, pp. 245-250, 1994.   DOI
4 Tian C, Hemami S S, "Universal multiple description scalar quantization: analysis and design," IEEE Transactions on Information Theory, vol. 50, no. 9, pp. 2089-2102, 2004.   DOI
5 Fleming M, Effros M, "Generalized multiple description vector quantization," in Proc. of DCC'99 Data Compression Conference (Cat. No. PR00096). IEEE, pp. 3-12, 1999.
6 Servetto S D, Vaishampayan V A, Sloane N J A, "Multiple description lattice vector quantization," in Proc. of DCC'99 Data Compression Conference (Cat. No. PR00096). IEEE, pp. 13-22, 1999.
7 Vaishampayan V A, Sloane N J A, Servetto S D, "Multiple Description Vector Quantization with Lattice Codebooks: Design and Analysis," IEEE Transactions on Information Theory, vol. 47, no. 5, pp. 1718-1734, 2001.   DOI
8 Goyal V K, Kovacevic J, "Generalized multiple description coding with correlating transforms," IEEE Transactions on Information Theory, vol. 47, no. 6, pp. 2199-2224, 2001.   DOI
9 Goyal V K, Kelner J A, Kovacevic J, "Multiple description vector quantization with a coarse lattice," IEEE Transactions on Information Theory, vol. 48, no. 3, pp. 781-788, 2002.   DOI
10 Wang Y, Orchard M T, Vaishampayan V, et al, "Multiple description coding using pairwise correlating transforms," IEEE Transactions on Image Processing, vol. 10, no. 3, pp. 351-366, 2001.   DOI
11 Orchard M T, Wang Y, Vaishampayan V, et al, "Redundancy rate-distortion analysis of multiple description coding using pairwise correlating transforms," in Proc. of of International Conference on Image Processing. IEEE, vol.1, pp. 608-611, 1997.
12 Meng L, Liang J, Samarawickrama U, et al, "Multiple description coding with randomly and uniformly offset quantizers," IEEE Transactions on Image Processing, vol. 23, no. 2, pp. 582-595, 2013.   DOI
13 Zong J, Meng L, Tan Y, et al, "Adaptive reconstruction based multiple description coding with randomly offset quantizations," Multimedia Tools and Applications, vol. 77, no. 20, pp. 26293-26313, 2018.   DOI
14 Zong J, Meng L, Tan Y, et al, "Perceptual multiple description coding with randomly offset quantizers," in Proc. of 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). IEEE, pp. 1-5, 2016.
15 Wang Y, Orchard M T, Reibman A R, "Multiple description image coding for noisy channels by pairing transform coefficients," in Proc. of of First Signal Processing Society Workshop on Multimedia Signal Processing. IEEE, pp. 419-424, 1997.
16 Servetto S D, Ramchandran K, Vaishampayan V A, et al, "Multiple description wavelet based image coding," IEEE Transactions on Image Processing, vol. 9, no. 5, pp. 813-826, 2000.   DOI
17 Goyal V K, Kovacevic J, "Optimal multiple description transform coding of Gaussian vectors," in Proc. of DCC'98 Data Compression Conference (Cat. No. 98TB100225). IEEE, pp. 388-397, 1998.
18 Goyal V K, Vetterli M, Kovacevic J, "Multiple description transform coding: Robustness to erasures using tight frame expansions," in Proc. of 1998 IEEE International Symposium on Information Theory (Cat. No. 98CH36252).IEEE, pp. 408, 1998.
19 Zong J, Meng L, Zhang H, et al, "JND-based Multiple Description Image Coding," KSII Transactions on Internet and Information Systems, vol. 11, no. 8, pp. 3935-3949, 2017.   DOI
20 Wang Y, Reibman A R, Lin S, "Multiple description coding for video delivery," Proceedings. of the IEEE, vol. 93, no. 1, pp. 57-70, 2005.
21 Wang Y, Lin S, "Error-resilient video coding using multiple description motion compensation," IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, no. 6, pp.438-452, 2002.   DOI
22 Wenger S, "Video redundancy coding in H. 263+," in Proc. of 1997 International Workshop on Audio-Visual Services over Packet Networks, 1997.
23 Fan Y, Wang J, Sun J, "Distributed Multiple Description Video Coding on Packet Loss Channels," IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, vol. 20, no. 6, pp. 1768, 2001.
24 Zhao L, Bai H, Wang A, et al, "Multiple Description Convolutional Neural Networks for Image Compression," IEEE Transactions on Circuits and Systems for Video Technology, vol. 29, no. 8, pp. 2494-2508, 2019.   DOI
25 Goyal V K, Kovacevic J, Arean R, et al, "Multiple description transform coding of images," in Proc. of International conference on image processing, vol. 1, pp. 674-678, 1998.
26 Bajic I V, Woods J W, "Domain-based multiple description coding of images and video," IEEE Transactions on Image Processing, vol. 12, no. 10, pp. 1211-1225, 2003.   DOI
27 Cheng Z, Sun H, Takeuchi M, et al., "Deep convolutional autoencoder-based lossy image compression," in Proc. of 2018 Picture Coding Symposium (PCS). IEEE, pp. 253-257, 2018.
28 Cheng Z, Sun H, Takeuchi M, et al., "Performance Comparison of Convolutional AutoEncoders, Generative Adversarial Networks and SuperResolution for Image Compression," in Proc. of CVPR Workshops, pp. 2613-2616, 2018.
29 Theis L, Shi W, Cunningham A, et al, "Lossy Image Compression with Compressive Autoencoders," arXiv preprint arXiv:1703.00395, 2017.
30 Shi W, Caballero J, Huszr F, et al, "Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network," in Proc. of of the IEEE conference on computer vision and pattern recognition, pp. 1874-1883, 2016.
31 Li H, Meng L, Zhang J, et al, "Multiple Description Coding Based on Convolutional Auto-encoder," IEEE Access, vol. 7, pp. 26013-26021, 2019.   DOI
32 Gamal A A E, Cover T M, "Achievable Rates for Multiple Descriptions," IEEE Transactions on Information Theory, vol. 28, no. 6, pp. 851-857, 1982.   DOI
33 Ball, Johannes, Laparra V, Simoncelli E P, "End-to-end optimization of nonlinear transform codes for perceptual quality," in Proc. of 2016 Picture Coding Symposium (PCS). IEEE, pp. 1-5, 2016.
34 Dumas T, Roumy A, Guillemot C, "Autoencoder based image compression: can the learning be quantization independent?," in Proc. of 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, pp. 1188-1192, 2018.
35 Wang Z, Simoncelli E P, Bovik A C, "Multiscale structural similarity for image quality assessment," in Proc. of The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003. Ieee, Vol. 2, pp. 1398-1402, 2003.
36 Tao W, Jiang F, Zhang S, et al, "An End-to-End Compression Framework Based on Convolutional Neural Networks," IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 10, pp. 3007-3018, 2018.   DOI
37 Ball J, Laparra V, Simoncelli E P, "End-to-end optimized image compression," arXiv preprint arXiv:1611.01704, 2016.
38 Toderici G, O'Malley S M, Hwang S J, et al, "Variable Rate Image Compression with Recurrent Neural Networks," arXiv preprint arXiv:1511.06085, 2015.
39 Wang Z, Bovik A C, Sheikh H R, et al, "Image Quality Assessment: From Error Visibility to Structural Similarity," IEEE Transactions on Image Processing, vol. 13, no. 4, 2004.
40 Zeiler, Matthew D., Graham W. Taylor, and Rob Fergus, "Adaptive deconvolutional networks for mid and high level feature learning," ICCV, Vol. 1, No. 2, 2011.
41 Abadi M, Agarwal A, Barham P, et al., "TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems," arXiv preprint arXiv:1603.04467, 2016.
42 Chen Y, Pock T, "Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration," IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 39, no. 6, pp. 1256-1272, 2015.   DOI
43 Kingma D P, Ba J, "Adam: A method for stochastic optimization," in Proc. of conference paper at ICLR 2015, pp.1-15, 2015.
44 Wallace G K, "The JPEG still picture compression standard," IEEE transactions on consumer electronics, vol. 38, no. 1, pp. xviii-xxxiv, 1992.   DOI