Browse > Article
http://dx.doi.org/10.3745/KIPSTA.2005.12A.1.041

An Active Prefetch Filtering Schemes using Exclusive Prefetch Cache  

Chon Young-Suk (충북대학교 대학원 컴퓨터과학과)
Kim Suk-il (충북대학교 전기전자컴퓨터공학부)
Jeon Joong-nam (충북대학교 전기전자컴퓨터공학부)
Abstract
Memory reference instruction caused by cache miss is the critical factor that limits the processing power of processor. Cache prefetching technique is an effective way to reduce the latency due to memory access. However, excessively aggressive prefetch leads to cache pollution and finally to cancel out the advantage of prefetch. In this study, an active prefetch filtering scheme is introduced which dynamically decides whether to commence prefetching after referring a filtering table to reduce the cache pollution due to unnecessary prefetches. For the precision filtering, an evicted address referencing scheme has been proposed where the filter directly compares the current prefetch address with previous unnecessary prefetch addresses stored in filtering table. Moreover, a small sized exclusive prefetch cache has been introduced to increase the amount of eviction of unnecessarily prefetched addresses to enhance the accuracy of dynamic filtering. The exclusive prefetch cache also prevents useful demand data from being pushed out by prefetched data, while the evicted address direct referencing scheme enables the prefetch cache to keep most of useful prefetch data within its small size. Experimental results from commonly used general and multimedia benchmarks show that the average cache miss ratio has been decreased by $13.3{\%}$ by virtue of enhanced filtering accuracy compared with conventional schemes.
Keywords
Cache Memory; Prefetch algorithm; Filtering; Prefetch Cache Architecture;
Citations & Related Records
연도 인용수 순위
  • Reference
1 X. Zhuang and H-H S. Lee, 'Hardware-based Cache Pollution Filtering Mechanism for Aggressive Prefetches', in Proc. IEEE Int. conf. on Parallel Processing, pp.286-293, Oct., 2003   DOI
2 A. Srivastava and A. Eustace, 'ATOM: A System for Building Customized Program Analysis Tools', Proceedings of the ACM SIGPLAN 94, pp.196-205, 1994   DOI
3 M. D. Hill, 'Dinero III Cache Simulator', Technical Report, Department Computer Science, University of Wisconsin, Madison. 1990
4 J. H. Lee, S. W. Jeong, S. D. Kim and C. C. Weems, 'An Intelligent Cache System with Hardware Prefetching for High Performance', IEEE Trans. on computers, Vol.52, No.5, May, 2003   DOI   ScienceOn
5 D. Joshep and D. Grunwald, 'Prefetching Using Markov Predictors', in proc. Of the 24th. Annual IntI. Symp. On Computer Architecture, pp.252-263, June, 1997   DOI
6 J. Kim, K. V. Palem and W-F. Wong, 'A Framwork for Data Prefetching using Off-line Training of Markovian Predictors', in Proc. IEEE IntI. Conf. on Computer Design(JCCD), pp.340-347, Sep., 2002   DOI
7 G. Hariprakash, R. Achutharaman, A. R. Omondi, 'DSTRIDE : Data-cache miss-address-based stride prefetching scheme for multimedia processors', 6th Australasian Computer Systems Architecture Conference (AustCSAC'01), pp.62-70, Jan, 29-30, 2001   DOI
8 Y. Solihin, J. Lee and J. Torrellas, 'Correlation Prefetching with a User-Level Memory Thread', IEEE Trans. Computers, Vol.14, No.6, June, 2003
9 J. L. Baer and T-Fu Chen, 'An effective on-chip preloading scheme to reduce data access penalty', In Proceedings of Supercomputing '91, pp.176-186, Nov., 1991   DOI
10 A. J. Smith, 'Cache Memories', ACM Computing Surveys, 14:473-530, Sep., 1982   DOI   ScienceOn
11 N. P. Jouppi, 'Improving directed-mapped cache performance by the addition of a small fully-associative cache and prefetch buffers', Proc. of the 17 Annual International Symposium on Computer Architecture, pp.364-373, May, 1990
12 D. Joseph and D. Grunwald, 'Prefetching Using Markov Predictors', IEEE Trans. on computers, Vol. 48, No.2, Feb., 1999   DOI   ScienceOn
13 V. Srinivasan, E. S. Davidson and G. S. Tyson, 'A Prefetch Taxonomy', IEEE Trans. Computers, Vol.53, No.2, pp.126-140, Feb., 2004   DOI   ScienceOn
14 T-Fu Chen and J-L Baer, 'Effective Hardware -Based data prefetching for High-Performance Processors', IEEE Trans. Computers, Vol.44, No.5, pp.609-623, May, 1995   DOI   ScienceOn