Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Free-view Pixels of Elemental Image Rearrangement Technique (FPERT)

  • Lee, Jaehoon (Department of Computer Science and Electronics, Kyushu Institute of Technology) ;
  • Cho, Myungjin (Department of Electrical, Electronics, and Control Engineering, IITC, Hankyong University) ;
  • Inoue, Kotaro (Department of Electrical, Electronics, and Control Engineering, IITC, Hankyong University) ;
  • Tashiro, Masaharu (Department of Computer Science and Electronics, Kyushu Institute of Technology) ;
  • Lee, Min-Chul (Department of Computer Science and Electronics, Kyushu Institute of Technology)
  • Received : 2018.11.01
  • Accepted : 2019.02.06
  • Published : 2019.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new free-view three-dimensional (3D) computational reconstruction of integral imaging to improve the visual quality of reconstructed 3D images when low-resolution elemental images are used. In a conventional free-view reconstruction, the visual quality of the reconstructed 3D images is insufficient to provide 3D information to applications because of the shift and sum process. In addition, its processing speed is slow. To solve these problems, our proposed method uses a pixel rearrangement technique (PERT) with locally selective elemental images. In general, PERT can reconstruct 3D images with a high visual quality at a fast processing speed. However, PERT cannot provide a free-view reconstruction. Therefore, using our proposed method, free-view reconstructed 3D images with high visual qualities can be generated when low-resolution elemental images are used. To show the feasibility of our proposed method, we applied it to optical experiments.

Keywords

E1ICAW_2019_v17n1_60_f0001.png 이미지

Fig. 1. Basic concept of integral imaging.

E1ICAW_2019_v17n1_60_f0002.png 이미지

Fig. 2. Concept of VCR.

E1ICAW_2019_v17n1_60_f0003.png 이미지

Fig. 3. Concept of PERT.

E1ICAW_2019_v17n1_60_f0004.png 이미지

Fig. 4. Arrangement of x-axis pixels of PERT.

E1ICAW_2019_v17n1_60_f0005.png 이미지

Fig. 5. Arrangement of x-axis pixels of FPERT.

E1ICAW_2019_v17n1_60_f0006.png 이미지

Fig. 6. Experiment setup.

E1ICAW_2019_v17n1_60_f0007.png 이미지

Fig. 7. Elemental images.

E1ICAW_2019_v17n1_60_f0008.png 이미지

Fig. 8. FPERT results: (a) upper-left-side view, (b) upper-right-side view, (c)lower-side-view, and (d) lower-right-side view.

E1ICAW_2019_v17n1_60_f0009.png 이미지

Fig. 9. VCR and FPERT results using 2 × 2 elemental images: (a) image reconstructed using a VCR, (b) enlarged VCR result, (c) reconstructed image using FPERT, and (d) enlarged FPERT result.

E1ICAW_2019_v17n1_60_f0010.png 이미지

Fig. 10. Resulting images using VCR and FPERT: (a) resulting image (using 3 × 3 elemental images) from VCR, (b) enlarged resulting image using VCR, (c) resulting image from FPERT, and (d) enlarged resulting image using FPERT.

E1ICAW_2019_v17n1_60_f0011.png 이미지

Fig. 11. Results of VCR and FPERT using 3 × 3 elemental images: (a) reference image with high resolution, (b) result using VCR, and (c) result using FPERT.

E1ICAW_2019_v17n1_60_f0012.png 이미지

Fig. 12. Results of (a) PSNR, (b) SSIM, and (c) correlation peak.

References

  1. G. Lippmann, "Epreuves reversibles. Photographies integrals," Comptes-Rendus Academie des Sciences, vol. 146, pp. 446-451, 1908.
  2. A. Stern and B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proceedings of the IEEE, vol. 94, no. 3, pp. 591-607, 2006. DOI: 10.1109/JPROC.2006.870696.
  3. H. Arimoto and B. Javidi, "Integral three-dimensional imaging with computed reconstruction," Optics Letters, vol. 26, no. 3, pp. 157-159, 2001. DOI: 10.1364/OL.26.000157.
  4. S. H. Hong, J. S. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Optics Express, vol. 12, no. 3, pp. 483-491, 2004. DOI: 10.1364/OPEX.12.000483.
  5. J. S. Jang and B. Javidi, "Improved viewing resolution of threedimensional integral imaging bu use of nonstationary micro-optics," Optic Letters, vol. 27, no. 2, pp. 324-326, 2002. DOI: 10.1364/OL.27.000324.
  6. D. H. Shin and H. Yoo, "Image quality enhancement in 3D computational integral imaging by use of interpolation methods," Optics Express, vol. 15, no. 19, pp. 12039-12049, 2007. DOI: 10.1364/OE.15.012039.
  7. J. S. Jang and B. Javidi, "Three-dimensional synthetic aperture integral imaging," Optic Letters, vol. 27, no. 13, pp. 1144-1146, 2002. DOI: 10.1364/OL.27.001144.
  8. M. J. Cho and B. Javidi, "Free view reconstruction of threedimensional integral imaging using tilted reconstruction planes with locally nonuniform magnification," Journal of Display Technology, vol. 5, no. 9, pp. 345-349, 2009 DOI: 10.1109/JDT.2009.2028035.
  9. M. C. Lee, J. S. Han, and M. J. Cho, "3D visualization technique for occluded objects in integral imaging using modified smart pixel mapping," Journal of Information and Communication Convergence Engineering, vol. 15, no. 4, pp. 256-261, 2017. DOI: 10.6109/jicce.2017.15.4.256.
  10. Y. S. Hwang, S. H. Hong, and B. Javidi, "Free view 3D visualization of occluded objects by using computational synthetic aperture integral imaging," Journal of Display Technology, vol. 3, no. 1, pp. 64-70, 2007. DOI: 10.1109/JDT.2006.890702 .
  11. D. H. Shin, B. G. Lee, and E. S. Kim, "Modified smart pixel mapping method for displaying orthoscopic 3D images in integral imaging," Optics and Lasers in Engineering, vol. 50, no. 6, pp. 862-868, 2012. DOI: 10.1016/j.optlaseng.2009.06.004.
  12. B. H. Lee, S. Y. Jung, and J. H. Park, "Viewing-angle-enhanced integral imaging by lens switching," Optical Letters, vol. 27, no. 10, pp. 818-120, 2002. DOI: 10.1364/OL.27.000818.
  13. M. C. Lee, K. Inoue, and M. J. Cho, "Three-dimensional automatic target recognition system based on optical integral imaging," Journal of Information and Communication Convergence Engineering, vol. 14, no. 1, pp. 51-56, 2016 DOI: 10.6109/jicce.2016.14.1.051.
  14. M. J. Cho and B. Javidi, "Computational reconstruction of threedimensional integral imaging by rearrangement of elemental image pixels," Journal of Display Technology, vol. 5, no. 2, pp. 61-65, 2009. DOI: 10.1109/JDT.2008.2004857.
  15. K. Inoue, M. C. Lee, B. Javidi, and M. J. Cho, "Improved 3D integral imaging reconstruction with elemental image pixel rearrangement," Journal of Optics, vol. 20, no. 2, pp. 8, 2018. DOI: 10.1088/2040-8986/aaa391.