Browse > Article

Fast Patch Retrieval for Example-based Super Resolution by Multi-phase Candidate Reduction  

Park, Gyu-Ro (한동대학교 정보통신공학과)
Kim, In-Jung (한동대학교 전산전자공학부)
Abstract
Example-based super resolution is a method to restore a high resolution image from low resolution images through training and retrieval of image patches. It is not only good in its performance but also available for a single frame low-resolution image. However, its time complexity is very high because it requires lots of comparisons to retrieve image patches in restoration process. In order to improve the restoration speed, an efficient patch retrieval algorithm is essential. In this paper, we applied various high-dimensional feature retrieval methods, available for the patch retrieval, to a practical example-based super resolution system and compared their speed. As well, we propose to apply the multi-phase candidate reduction approach to the patch retrieval process, which was successfully applied in character recognition fields but not used for the super resolution. In the experiments, LSH was the fastest among conventional methods. The multi-phase candidate reduction method, proposed in this paper, was even faster than LSH: For $1024{\times}1024$ images, it was 3.12 times faster than LSH.
Keywords
Example-based super resolution; Fast Patch Retrieval; Multi-phase Candidate Reduction; LSH;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Transactions on Image Processing, vol.13, no.4, pp. 600-612, Apr. 2004.   DOI   ScienceOn
2 Kim, Sang-Wook, Charu Aggarwal, Philip Yu, "최근접 질의를 위한 고차원 인덱싱 방법", 한국정보과학회 논문지 : 데이타베이스, vol.28, no.4, pp.632-642, Dec. 2001.
3 Bentley, J. L., "K-d trees for semidynamic point sets," In Proceedings of the Sixth Annual Symposium on Computational Geometry, SCG '90. ACM, New York, NY, 187-197. 1990.
4 Wang, Q., Tang, X., and Shum, H. "Patch Based Blind Image Super Resolution," In Proceedings of the Tenth IEEE international Conference on Computer Vision, 2005.
5 Simon Baker, Takeo Kanade, "Limits on Super- Resolution and How to Break Them," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.24, no.9, pp.1167-1183, September, 2002.   DOI   ScienceOn
6 M. E. Tipping and C. M. Bishop. "Bayesian image super-resolution," In S. Thrun S. Becker and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, pp.1279-1286, MIT Press, Cambridge, MA, 2003.
7 B. Battulga, "Anisotropic Total Variation Method for Text Image Super-Resolution," pp.1-34, Master Thesis, KAIST, 2007.
8 S. C. Ahalt, A. K. Krishnamurthy, P. Chen, and D. E. Melton. Competitive learning algorithms for vector quantization. Neural Networks, 3(3):277- 290, 1990.   DOI   ScienceOn
9 J.Park, Y.Kwon, J.Kim, "An Example-Based Prior Model for Text Image Super-resolution," 8th International Conference on Document Analysis and Recognition (ICDAR2005), Seoul, Korea, pp.374-378, 2005.
10 L. C. Pickup, D. P. Capel, S. J. Roberts, and A. Zisserman, "Bayesian image super-resolution, continued," Advances in Neural Information Processing Systems 19, pp.1089-1096, Cambridge, Mass, USA, December 2006.
11 William T. Freeman, Thouis R. Jones, Egon C Pasztor, "Example-Based Super-Resolution," IEEE Computer Graphics and Applications, vol.22, no.2, pp.56-65, March/April, 2002.   DOI   ScienceOn
12 Roger Weber, Hans-J. Schek, Stephen Blott, "A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-Dimensional Spaces," Proc. 24th Int. Conf. VLDB, pp.194-205, 1998.
13 Jeffrey S. Beis, David G. Lowe, "Indexing without Invariants in 3D Object Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.21, no.10, pp. 1000-1015, Oct., 1999.   DOI   ScienceOn
14 Gionis, A., Indyk, P., and Motwani, R, "Similarity Search in High Dimensions via Hashing," In Proceedings of the 25th international Conference on Very Large Data Bases, Sep. 1999.
15 Ching-Lin Liu, Ryuji Mine, Masashi Koga, "Building Compact Classifier for Large Character Set Recognition Using Discriminative Feature Extraction," icdar, pp.846-850, 2005.
16 King-ip Lin, H. V. Jagadish, Christos Faloutsos, "The TV-tree: an index structure for high-dimensional data," VLDB, 1994.