Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2010.17B.4.295

Example-based Super Resolution Text Image Reconstruction Using Image Observation Model  

Park, Gyu-Ro (한동대학교 정보통신공학과)
Kim, In-Jung (한동대학교)
Publication Information
The KIPS Transactions:PartB / v.17B, no.4, 2010 , pp. 295-302 More about this Journal
Abstract
Example-based super resolution(EBSR) is a method to reconstruct high-resolution images by learning patch-wise correspondence between high-resolution and low-resolution images. It can reconstruct a high-resolution from just a single low-resolution image. However, when it is applied to a text image whose font type and size are different from those of training images, it often produces lots of noise. The primary reason is that, in the patch matching step of the reconstruction process, input patches can be inappropriately matched to the high-resolution patches in the patch dictionary. In this paper, we propose a new patch matching method to overcome this problem. Using an image observation model, it preserves the correlation between the input and the output images. Therefore, it effectively suppresses spurious noise caused by inappropriately matched patches. This does not only improve the quality of the output image but also allows the system to use a huge dictionary containing a variety of font types and sizes, which significantly improves the adaptability to variation in font type and size. In experiments, the proposed method outperformed conventional methods in reconstruction of multi-font and multi-size images. Moreover, it improved recognition performance from 88.58% to 93.54%, which confirms the practical effect of the proposed method on recognition performance.
Keywords
Example-Based Super Resolution; Patch Matching Criterion; Image Observation Model; Text Image Reconstruction;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 C. L. Liu, "Normalization-Cooperated Gradient Feature Extraction for Handwritten Character Recognition," IEEE TPAMI, Vol.29, No.8, pp.1465-1469. 2007.   DOI   ScienceOn
2 C. L. Liu, I. J. Kim, and J. H. Kim, "High Accuracy Handwritten Chinese Character Recognition by Improved Feature Matching Method," Proc. 4th ICDAR, Ulm, Germany, pp.1033-1037, 1997.
3 M. E. Tipping and C. M. Bishop, "Bayesian image super-resolution," Advances in Neural Information Processing Systems 15, MIT Press, Cambridge, MA, pp.1279-1286, 2003.
4 W. T. Freeman, T. R. Jones, and E. C Pasztor, "Example-Based Super-Resolution," IEEE Computer Graphics and Applications, Vol.22, No.2, pp.56-65, 2002.   DOI   ScienceOn
5 J.Park, Y.Kwon, J.Kim, "An Example-Based Prior Model for Text Image Super-resolution," Proc. of ICDAR2005, Seoul, Korea, pp.374-378, 2005.
6 D. P. Capel, "Image Mosaicing and Super-resolution," Ph.D. thesis, University of Oxford, 2001.
7 L. C. Pickup, D. P. Capel, S. J. Roberts, and A. Zisserman, "Bayesian image super-resolution, continued," Advances in Neural Information Processing Systems 19, pp.1089-1096, Cambridge, Mass, USA, December, 2006.
8 D. Chekhlov, "Super-Resolution of Images," Ph.D. Thesis, Bristol, pp.1-12, 2005.
9 L.G. Brown, "A survey of image registration techniques," ACM. Computing Surveys, Vol.24, pp.326-376, 1992.
10 K. Donaldson and G. K. Myers, "Bayesian Super-Resolution of Text in Video with a Text-Specific Bimodal Prior," IJDAR, Vol.7, No.2, pp.1433-2833, 2005.
11 http://people.csail.mit.edu/hasinoff/320/sliding-notes.pdf
12 박규로, 김인중, "단계적 후보 축소에 의한 예제기반 초해상도 영상복원을 위한 고속 패치 검색", 정보과학회논문지, Vol.37, No.4, pp.264-272, 2010.   과학기술학회마을
13 http://ai.kaist.ac.kr/Resource/dbase/Image%20Database.htm
14 http://en.wikipedia.org/wiki/Interpolation
15 http://en.wikipedia.org/wiki/RMSE
16 R.O. Duda, P.E. Hart and D.G. Stork, Pattern Classification 2nd ed., pp.36-45, Wiley-Interscience, 2001.
17 S. C. Park, M. K. Park, and M. G. Kang," Super-resolution image reconstruction: a technical overview," IEEE Signal Processing Magazine, Vol.20, No.3, pp.21-36, 2003.   DOI   ScienceOn
18 류상진, 김인중, "저화질 영상 인식을 위한 화질 저하 모델 기반 다중 인식기 결합", 정보처리학회논문지B, 제17-B권, 제3호, pp.233-238, 2010.   과학기술학회마을   DOI   ScienceOn