Browse > Article
http://dx.doi.org/10.5909/JBE.2019.24.7.1246

Focal Stack Based Light Field Coding for Refocusing Applications  

Duong, Vinh Van (Department of Electrical and Computer Engineering, Sungkyunkwan University)
Canh, Thuong Nguyen (Department of Electrical and Computer Engineering, Sungkyunkwan University)
Huu, Thuc Nguyen (Department of Electrical and Computer Engineering, Sungkyunkwan University)
Jeon, Byeungwoo (Department of Electrical and Computer Engineering, Sungkyunkwan University)
Publication Information
Journal of Broadcast Engineering / v.24, no.7, 2019 , pp. 1246-1258 More about this Journal
Abstract
Since light field (LF) image has huge data volume, it requires high-performance compression technique for efficient transmission and storage of its data. Camera users may like to represent parts of image at different levels of focus at their choice anytime. To address this refocusing functionality, in this paper, we first render a focal stack consisting of multi-focus images, then compress it instead of original LF data. The proposed method has advantage of minimizing the amount of LF data to realize the targeted refocusing applications. Our experiment results show that the proposed method outperforms the state-of-the-art for LF image compression method.
Keywords
Light field compression; video compression; focal stack;
Citations & Related Records
연도 인용수 순위
  • Reference
1 G. Lippmann, "Epreuves reversibles, photographies integrales," Academie des sciences, pp. 446-451, 1908.
2 H. Ives, "A Camera for Making Parallax Panoramagrams," J. Opt. Soc. Am., vol. 17, no. 4, pp. 435-439, 1928.   DOI
3 M. Levoy, et al., "Light field microscopy," ACM Trans. Graph., vol. 25, no. 3, pp. 924-934, Jul. 2006.   DOI
4 K. Fife, et al., "A 3mpixel multi-aperture image sensor with 0.7um pixels in 0.11um cmos," IEEE ISSCC Digest of Technical Papers, pp.48-49, 2008.
5 R. Ng, et al., "Light field photography with a hand-held plenoptic camera," in Computer Science Technical Report, vol. 2, no. 11, pp. 111, 2005.
6 ISO/IEC JTC 1/SC29/WG1 JPEG, "JPEG Pleno Call for Proposals on Light Field Coding," in ISO/IEC JTC 1/SC29/WG1 JPEG, Doc. N74014, Jan 2017.
7 M. Rerabek, et al., "ICME 2016 grand challenge: Light-field image compression," Call for proposals and evaluation procedure, 2016.
8 I. Viola and T. Ebrahimi, "Quality Assessment of Compression Solutions for ICIP 2017 Grand Challenge on Light Field Image Coding," in Proc. 9th Workshop on Hot Topics in 3D Multimedia, July 2018.
9 ICME 2018 Grand Challenge on Densely Sampled Light Field Reconstruction, available at http://www.tut.fi/civit/icme-2018-grandchallenge-densely-sampled-light-field-reconstruction/.
10 M. Rizkallah, et al., "Impact of light field compression on refocused and extended focus images," in Proc. European Conf. Sig. Process., pp. 898-902, 2016.
11 C. Perra, et al., "Effect of light field subsampling on the quality of experience in refocusing applications," in Proc. IEEE Int. Conf. Quality Multi. Exper., 2018.
12 P. Paudyal, et al., "Towards the perceptual quality evaluation of compressed light field images," IEEE Trans. Broadcast., vol. 63, no. 3, pp. 507-522, Sep. 2017.   DOI
13 P. A. Kara, et al., "Evaluation of the Concept of Dynamic Adaptive Streaming of Light Field Video," IEEE Trans. Broadcast., vol. 64, no. 2, pp. 407-421, June 2018.   DOI
14 A. Levin and F. Durand, "Linear views sythesis using a dimensionality gap light field prior," in Proc. IEEE Conf. Comp. Vision Pattern Recog., pp. 1831-1838, 2010.
15 S. Pertuz, et al., "Focus model for metric depth estimation in standard plenoptic cameras," in SPRS Journal of Photogrammetry and Remote Sensing, vol. 144, pp. 38-47, Oct. 2018.   DOI
16 M. Levoy and P. Hanrahan, "Light field rendering," in SIGGRAPH, 1996, pp. 31-42.
17 D. Dansereau, "Light Field Toolbox v0.4", available at https://www.mathworks.com/matlabcentral/fileexchange/49683-light-field-toolbox-v0-4.
18 I. Viola, et al., "Comparison and evaluation of light field image coding approaches," IEEE J. Select. Topic Sig. Process., vol. 11, no. 7, pp. 1092-1106, 2017.   DOI
19 T. N. Canh, V. V. Duong, and B. Jeon, "Boundary handling for video based light field coding with a new hybrid scan order," in Proc. Inter. Workshop on Advanced Image Tech., pp. 1-4, Jan. 2019.
20 V. V. Duong, T. N. Canh, and B. Jeon, "Light Field Image Coding for Efficient Refocusing," in Proc. IEEE 12th Inter. Symp. Emb. Multi./Many-core Sys. On Chip, pp. 74-78, Sept. 2018.
21 T. Sakamoto, et al., "A study on efficient compression of multi-focus images for dense light field reconstruction," in Proc. Vis. Commum. Image Processing(VCIP), pp. 1-4, Nov 2016.
22 A. Mousnier, et al., "Partial light field tomographic reconstruction from a fixed camera focal stack," available at http://www.irisa.fr/temics/demos/lightField/LightFieldPartialReconstruction.html.
23 G. Bjontegaard, "Calculation of Average PSNR Differences Between RDCurves," document ITU-T SG16 Q.6, VCEG-M33, Geneva, Switzerland, Apr. 2001.
24 Y. Boykov, O. Veksler, and R. Zabih, "Efficient approximate energy minimization via graph cuts," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 20, no. 12, pp. 1222-1239, Nov. 2001.
25 HEVC reference software, HM 16.17, available at https://hevc.hhi.fraunhofer. de/svn/svn_HEVCSoftware/.
26 M. Rerabek and T. Ebrahimi, "New light field image dataset," in Proc. 8th Int. Conf. Quality Multi. Exp., pp. 1 -2, 2016.
27 F. Perez, et al., "Lightfield recovery from its focal stack," J. Math. Imag. Vis., vol. 56, no. 3, pp. 573-590, 2016.   DOI