go-v.orgdoi

Using the compiler to improve cache replacement decisions

Zhenlin Wang, Kathryn S. McKinley, Arnold L. Rosenberg, Charles Weems · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · 2002

  • DOI 10.5555/645989.674328
  • Publisher University of Massachusetts Amherst
  • Type article
  • Issued 2002

Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.

ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · University of Massachusetts Amherst · article · 2002

Abstract

Memory performance is increasingly determining microprocessor performance and technology trends are exacerbating this problem. Most architectures use set-associative caches with LRU replacement policies to combine fast access with relatively low miss rates. To improve replacement decisions in set-associative caches, we develop a new set of compiler algorithms that predict which data will and will not be reused and provide these hints to the architecture. We prove that the hints either match or improve hit rates over LRU. We describe a practical one-bit cache-line tag implementation of our algorithm, called evict-me.

On a cache replacement, the architecture will replace a line for which the evict-me bit is set, or if none is set, it will use the LRU bits. We implement our compiler analysis and its output in the Scale compiler. On a variety of scientific programs, using the evict-me algorithm in both the level 1 and 2 caches improves simulated cycle times by up to 34% over the LRU policy by increasing hit rates. In addition, a combination of simple hardware prefetching and evict-me works together to further improve performance.

Open the resolved locator · 10.5555/645989.674328

Metadata licence: OpenAlex metadata (CC0)

Registry
OpenAlex DOI index + API
Fetched
2026-11-20 03:34 UTC
Cache state
not cached yet (bulk-index+openalex)
Locator
https://scholarworks.umass.edu/cs_faculty_pubs/1244
Metadata licence
OpenAlex metadata (CC0)
Scope
Metadata as returned by the resolver; abstracts are never generated here.