방송공학회논문지 (Journal of Broadcast Engineering)

  • 제21권6호
  • /
  • Pages.845-860
  • /
  • 2016
  • /
  • 1226-7953(pISSN)
  • /
  • 2287-9137(eISSN)
한국방송∙미디어공학회 (The Korean Institute of Broadcast and Media Engineers)
권호 표지
DOI QR코드

DOI QR Code

깊이변화지도를 이용한 DIBR 공격의 강인성 블라인드 워터마킹

Robust and Blind Watermarking for DIBR Using a Depth Variation Map

  • 이용석 (광운대학교 전자재료공학과) ;
  • 서영호 (광운대학교 교양학부) ;
  • 김동욱 (광운대학교 전자재료공학과)
  • Lee, Yong-Seok (Department of Electronic Materials Engineering, Kwangwoon University) ;
  • Seo, Young-Ho (School of Liberal Arts, Kwangwoon University) ;
  • Kim, Dong-Wook (Department of Electronic Materials Engineering, Kwangwoon University)
  • 투고 : 2016.06.23
  • 심사 : 2016.11.16
  • 발행 : 2016.11.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 시청자측에서 수신한 텍스처 영상과 그 깊이영상으로 임의의 시점 영상을 렌더링하여 시청하는 자유시점 2D 또는 3D 영상의 지적재산권 보호를 위한 디지털 워터마킹 기술을 제안한다. 이 경우 악의적이지는 않지만 시점이동공격이 필연적으로 발생되며, 여기에 삽입된 워터마크 정보를 제거하기 위한 악의적인 공격을 추가로 고려하여야 한다. 본 논문에서는 시점이동에 덜 민감한 부분을 찾기 위해 깊이영상을 이용하여 깊이변화지도를 생성하고, 원 영상을 3 레벨 2DDWT를 수행하여 각 레벨의 LH 부대역에서 깊이변화지도를 참조하여 워터마킹할 위치를 결정한다. 각 화소에 한 워터마크 비트를 삽입하는 방법은 선형 양자화기를 사용하는데, 양자화 스텝은 각 부대역의 에너지 값에 따라 결정한다. 워터마크 추출방법은 공격된 영상에서 원 워터마크 정보와의 상관도를 이용하여 가능한 후보들을 추출하고, 각 위치의 추출된 값들은 통계적인 방법으로 최종 추출된 워터마크로 결정한다. 제안한 방법을 다양한 영상으로 다양한 공격에 대해 실험하고 기존의 방법들과 비교하여 이 방법이 우수한 성능을 가졌음을 보인다.

This paper proposes a digital watermarking scheme to protect the ownership of the freeview 2D or 3D image such that the viewer watches the image(s) by rendering a arbitrary viewpoint image(s) with the received texture image and its depth image. In this case a viewpoint change attack essentially occurs, even if it is not malicious. In addition some malicious attacks should be considered, which is to remove the embedded watermark information. In this paper, we generate a depth variation map (DVM) to find the locations less sensitive to the viewpoint change. For each LH subband after 3-level 2DDWT for the texture image, the watermarking locations are found by referring the DVM. The method to embed a watermark bit to a pixel uses a linear quantizer whose quantization step is determined according to the energy of the subband. To extract the watermark information, all the possible candidates are first extracted from the attacked image by considering the correlation to the original watermark information. For each bit position, the final extracted bit is determined by a statistical treatment with all the candidates corresponding that position. The proposed method is experimented with various test images for the various attacks and compared to the previous methods to show that the proposed one has excellent performance.

키워드

참고문헌

  1. Diniel Minoli, 3DTV, Content capture, encoding and transmission, IEEE-Wiley, 2010.
  2. Y. Mori, N. Fukushima, T. Yendo, T. Fujii, and M. Tanimato, "View generation with 3D warping using depth information for FTV", Signal Processing: Image Communication 24(2009) 65-72. https://doi.org/10.1016/j.image.2008.10.013
  3. T-Y. Ho, D-N. Yang, and W. Liao, "Efficient resource allocation of mobile multi-view 3D videos with depth-image-based rendering", IEEE Trans. on Mobile Computing, Vol. 14, No. 12, pp. 344-357, Feb. 2015. https://doi.org/10.1109/TMC.2014.2321401
  4. Y-H. Seo, Y-H. Lee, J-M. Koo, J-S. Yoo, and D-W. Kim, "Digital holographic video service system for natural color scene", Optical Engineering, 52(11), 113106 (Nov. 2013). https://doi.org/10.1117/1.OE.52.11.113106
  5. Aljoscha Smoloc, "3D video and freeviewpoint video-From capture to display," ELsevier Pattern Recognition, 44(2011) 1958-1968. https://doi.org/10.1016/j.patcog.2010.09.005
  6. 김성열, 이진성, 최상미, "다시점 영상처리를 이용한 무안경 3차원 디스플레이의 크로스톡 저감방법," 방송공학회논문지, 제21권, 제1호, pp. 66-75, 2016년 1월. (Sung-Yeol Kim, Jin-Sung Lee, Sang-Mi Choi, "Crosstalk Reduction of Glasses-free 3D Displays using Multiview Image Processing," J of Broadcast Engineering, Vol. 21, No. 1, pp. 66-75, Jan. 2016.) https://doi.org/10.5909/JBE.2016.21.1.66
  7. 이재경, 김재곤, 한종기, "3차원스케일러블 비디오 코덱 설계 및 성능 분석," 방송공학회논문지, 제1권, 제2호, pp. 219-236, 2016년 3월. (Jae-Yung Lee, Jae-Gon Kim, Jing-Ki Han, "Design and Analysis of 3D Scalable Video Codec," J of Broadcast Engineering, Vol. 21, No. 2, pp. 219-236, Mar. 2016.) https://doi.org/10.5909/JBE.2016.21.2.219
  8. J. Cox, M. Miller, J. Bloom, T. Kalker, Digital watermarking and steganography, 2nd Ed., Elsevier, 2008.
  9. 용 녹 투이 덩, 손 원, "DWT/RDWT/SVD에 기반한 특이벡터를 사용한 블라인드 워터마킹 방안," 방송공학회논문지, 제21권, 제2호, pp. 149-156, 2016년 3월. (Luong Ngoc Thuy Dung, Won Sohn, "A Blind Watermarking Scheme Using Singular Vector Based on DWT/RDWT/SVD," J of Broadcast Engineering, Vol. 21, No. 2, pp. 149-156, Mar. 2016.) https://doi.org/10.5909/JBE.2016.21.2.149
  10. A. Smolic, et al., "Coding Algorithm for 3DTV-A sunrvey," IEEE Trans.. on Circuits and Sytems for Video Technology, Vol. 17, No. 11, pp. 1606-1621, Nov. 2007. https://doi.org/10.1109/TCSVT.2007.909972
  11. A. Koz, C. Cigla, and A. Alatan, "Free-view watermarking for free-view television," ICIP 2006, pp. 1405-1408. 2006.
  12. N. Zhu, G. Ding, and J. Wing, "A novel digital watermarking method for new viewpoint video based on depth map," Intl. Conf. on Intelligent Systems Design and Applications, pp. 3-7, 2008.
  13. M-J. Lee, J-W. Lee, and H-K. Lee, "Perceptual watermarking for 3D stereoscopic video using depth information," IEEE Intl. Conf. Intelligent Information Hiding and Multimedia Signal Processing, pp. 81-84, 2001.
  14. J-W. Lee, H-D Kim, H-Y. Choi, S-H. Choi, and H-K. Lee, "Stereoscopic watermarking by horizontal noise mean shift," Proc. of SPIE Vol. 8303, 830307-1, 2012.
  15. Y-H. Lin and J-L Wu, "A digital blind watermarking for depth-image-based rendering 3D images," IEEE Trans. on Broadcasting, Vol. 57, No. 2, pp. 602-611, June 2011. https://doi.org/10.1109/TBC.2011.2131470
  16. H-D Kim, and J-W Lee, "Robust DT-CWT Watermarking for DIBR 3D Images." IEEE Transactions on Broadcasting, Vol. 58, No. 4, pp.533-543, Oct. 2012. https://doi.org/10.1109/TBC.2012.2206851
  17. S. Wang, C. Cui, and X. Niu, "Watermarking for DIBR 3D images based on SIFT feature points," Elsevier Measurement 48(2014) 54-62.
  18. Y. Guan, Y, Zhu, X. Liu, G. Luo, Z. Sun, and L. Zhang, "A digital blind watermarking scheme based on quantization index modulation in depth map for 3D video," ICARCV, We43.6, 2014.
  19. S-C Pei and Y-Y Wang, "Auxiliary metadata delivery in view synthesis using depth no synthesis error model," IEEE Trans. on Multimedia, Vol. 17, No. 1, pp. 128-133, Jan. 2015. https://doi.org/10.1109/TMM.2014.2368255
  20. S. Rana and A. Sur, "3D video watermarking using DT-DWT to resist synthesis view attack," EUSIPCO, pp. 46-50, Aug. 2015.
  21. I. Prathap and R. Anitha, "Robust and blind watermarking scheme for three dimensional anaglyph images," Elsevier Computers and Electrical Engineering 40 (2014) 51-58.
  22. Y. Gao. G.Cheung, T. Maugey, P. Frossard, and J. Liang, "Encoder-driven inpainting strategy in multiview video compression." IEEE Trans. on Image Processing, Vol. 25, No. 1, pp. 134-149, Jan. 2016. https://doi.org/10.1109/TIP.2015.2498400
  23. 이용석, 김동욱, 서영호, " 해상도에 따른 DWT 기반 디지털 영상의 강인성 블라인드 워터마킹," 방송공학회논문지, 제20권, 제6호, pp. 888-900, 2015년 11월. (Y-S. Lee, D-W. Kim, Y-H. Seo, "A Robust Blind Watermarking for Digital Image Using DWT According to its Resolution," J of Broadcast Engineering, Vol. 20, No. 6, pp. 888-900, Nov. 2015.) https://doi.org/10.5909/JBE.2015.20.6.888
  24. W, Stalling, Cryptography and network security, 6th Ed., Pearson, 2014.
  25. http://www.newwaveinstruments.com/resources/articles/m_sequence_linear_feedback_shift_register_lfsr.htm
  26. http://research.microsoft.com/en-us/downloads/5e4675af-03f4-4b16-b3bc-a85c5bafb21d/
  27. http://vision.middlebury.edu/stereo/data/