Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Augmenting Text Document by Controlling Its IR-Reflectance

적외선 반사 특성 제어를 통한 텍스트 문서 증강

  • Park, Hanhoon (Dept. of Electronic Engineering, Pukyong National University) ;
  • Moon, Kwang-Seok (Dept. of Electronic Engineering, Pukyong National University)
  • Received : 2017.02.20
  • Accepted : 2017.05.18
  • Published : 2017.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Locally Likely Arrangement Hashing (LLAH) is a method that describes image features based on the geometry between their neighbors. Thus, it has been preferred to implement augmented reality on poorly-textured objects such as text documents. However, LLAH strongly requires that image features be detected with high repeatability and located at a distance from one another. To fulfill the requirement for text document, this paper proposes a method that facilitates the word detection in infrared (IR) range by adjusting the IR-reflectance of words. Specifically, the words are printed out with two different black inks: one is using the K(carbon black) ink only, the other is mixing the C(cyan), M(magenta), Y(yellow) inks. Since only the words printed out with the K ink is visible in IR range, a part of words are selected in advance to be used as features and printed out the K ink. The selected words can be robustly detected with high repeatability in IR range and this enables to implement augmented reality on text documents with high fidelity. The validity of the proposed method was verified through experiments.

Keywords

References

  1. C. Scherrer, J. Pilet, P. Fua, and V. Lepetit, "The Haunted Book," Proceeding of International Symposium on Mixed and Augmented Reality, pp. 163-164, 2008.
  2. K. Kim, V. Lepetit, and W. Woo, "Scalable Real-time Planar Targets Tracking for Digilog Books," The Visual Computer, Vol. 26, No. 6-8, pp. 1145-1154, 2010. https://doi.org/10.1007/s00371-010-0490-6
  3. A. Clark and A. Dunser, "An Interactive Augmented Reality Coloring Book," Proceeding of 3D User Interfaces, pp. 7-10, 2012.
  4. Vuforia AR SDK, https://www.vuforia.com/ (accessed Feb., 27, 2017).
  5. D. Lowe, "Distinctive Image Features from Scale-invariant Keypoints," International Journal of Computer Vision, Vol. 60, No. 2, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  6. H. Bay, T. Tuytelaars, and L.V. Gool, "SURF: Speeded up Robust Features," Proceeding of European Conference on Computer Vision, pp. 404-417, 2006.
  7. T. Nakai, K. Kise, and M. Iwamura. "Use of Affine Invariants in Locally Likely Arrangement Hashing for Camera-based Document Image Retrieval," Proceeding of International Workshop on Document Analysis Systems, pp. 541-552, 2006.
  8. H. Uchiyama and H. Saito, "Augmenting Text Document by On-line Learning of Local Arrangement of Keypoints," Proceeding of International Symposium on Mixed and Augmented Reality, pp. 95-98, 2009.
  9. H. Uchiyama and H. Saito, "Random Dot Markers," Proceeding of Virtual Reality Conference, pp. 35-38, 2011.
  10. B.K. Seo, H. Uchiyama, and J.I. Park, "stAR: Visualizing Constellations with Star Retrieval," Proceeding of the Special Interest Group on Computer GRAPHics and Interactive Techniques Asia, article no. 53, 2011.
  11. H. Uchiyama and E. Marchand, "Toward Augmenting Everything: Detecting and Tracking Geometrical Features on Planar Objects," Proceeding of International Symposium on Mixed and Augmented Reality, pp. 17-25, 2011.
  12. H. Park, "Performance Optimization of LLAH for Tracking Random Dots under Gaussian Noise," Journal of Broadcast Engineering, Vol. 20, No. 6, pp. 912-920, 2015. https://doi.org/10.5909/JBE.2015.20.6.912
  13. V. Ziljak, K. Pap, and I. Ziljak, "CMYKIR Security Graphics Separation in the Infrared Area," Infrared Physics and Technology, Vol. 52, No. 2-3, pp. 62-69, 2009. https://doi.org/10.1016/j.infrared.2009.01.001
  14. J. Park and W. Woo, "Hybrid Document Matching Method for Page Identification of Digilog Books," Transactions on Edutainment, Vol. 8, pp. 24-34, 2012.
  15. H.S. Ryu and H. Park, "A System for Supporting Paper-based Augmented Reality," Multimedia Tools and Applications, Vol. 75, No. 6, pp. 3375-3390, 2016. https://doi.org/10.1007/s11042-014-2439-7
  16. J.J. Hull, B. Erol, J. Graham, Q. Ke, H. Kishi, J. Moraleda, et al., "Paper-based Augmented Reality," Proceeding of International Center for Automotive Technology, pp. 205-209, 2007.
  17. SITT-A Simple Robust Scaleinvariant Text Feature Detector for Document Mosaicing, http://www.inf.fu-berlin.de/inst/pubs/B-07-02.pdf (accessed Feb., 27, 2017).
  18. B. Erol, E. Antunez, and J.J. Hull, "HOTPAPER: Multimedia Interaction with Paper Using Mobile Phones," Proceeding of ACM International Conference on Multimedia, pp. 399-409, 2008.
  19. Project Tango, https://developers.google.com/tango/ (accessed Feb., 27, 2017).
  20. Structure Sensor, http://structure.io/core (accessed Feb., 27, 2017).
  21. Snooperscope, http://www.snooperscope.co.uk/(accessed Feb., 27, 2017).
  22. OpenCV, http://opencv.org (accessed Feb., 27, 2017).
  23. H. Park, K.S. Moon, K. Kim, and J.I. Park, "Implementation of Mobile Augmented Reality Using a Fast Plane-based Camera Tracking Method," Telecommunications Review, Vol. 23, No. 3, pp. 356-365, 2013.
  24. H. Park and K.S. Moon, "Performance Analysis of Brightness-Combined LLAH," Journal of Korea Multimedia Society, Vol. 19, No. 2, pp. 138-145, 2016. https://doi.org/10.9717/kmms.2016.19.2.138