Performance of a cache by detecting cache lines that have been reused

• US 7,552,286 B2
• Filed: 03/19/2008
• Issued: 06/23/2009
• Est. Priority Date: 03/30/2005
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Leon, Santiago A., Tast, Hans-Werner, Davis, Gordon T.
• Primary Examiner(s): Elmore; Reba I
• Application Number:
  US12/051,012
• Publication Number:
  US 20080168236A1
• Time in Patent Office: 461 Days
• Field of Search: 711/134, 711/144, 711/221
• US Class Current: 711/134
• CPC Class Codes: G06F 12/127 using additional replacement algorithms

Abstract

A method and system for improving the performance of a cache. The cache may include an array of tag entries where each tag entry includes an additional bit (“reused bit”) used to indicate whether its associated cache line has been reused, i.e., has been requested or referenced by the processor. By tracking whether a cache line has been reused, data (cache line) that may not be reused may be replaced with the new incoming cache line prior to replacing data (cache line) that may be reused. By replacing data in the cache memory that might not be reused prior to replacing data that might be reused, the cache hit may be improved thereby improving performance.

Claims

1. A system, comprising:

a processor, wherein said processor has a cache associated with it;

a system memory for storing data of said processor;

a bus system coupling said processor to said system memory;

wherein said cache comprises;

a data array comprising a plurality of congruence classes, wherein each of said congruence classes groups a plurality of cache lines;

a tag array comprising a plurality of tags, wherein each of said plurality of tags is associated with one of said plurality of cache lines, wherein each of said plurality tags comprises a bit used to indicate whether its associated cache line has been reused;

logic for receiving a request of an address of data;

logic determining if said requested data is located in said cache;

logic for setting said bit in said tag associated with a cache line in a congruence class to a second state if said requested data is located within said cache line of said cache; and

logic for resetting said bit for one of said plurality of cache lines in said congruence class if a number of cache lines in said congruence class identified as being reused exceeds a threshold.

2. The system as recited in claim 1, wherein each of said plurality of tags comprises a field used to indicate a least recently used status of its associated cache line, wherein said cache further comprises:

logic for modifying said field of said tag associated with said cache line to indicate said cache line is most recently used.

3. The system as recited in claim 2, wherein said cache further comprises:

logic for adjusting least recently used statuses of other cache lines in said congruence class.

4. The system as recited in claim 1, wherein said cache further comprises:

logic for leaving said bit in said tag associated with said cache line to remain in a first state if said request is a write request.

5. The system as recited in claim 1, wherein said cache further comprises:

logic for hashing said address to select said congruence class.

6. The system as recited in claim 5, wherein said cache further comprises:

logic for selecting a least recently used cache line in said congruence class with said bit in said tag associated with said least recently used cache line indicating said least recently used cache line has not been reused;

logic for invaliding current contents of said selected least recently used cache line; and

logic for loading new data in said selected least recently used cache line.

7. The system as recited in claim 6, wherein said cache further comprises:

logic for clearing said bit in said tag associated with said selected least recently used cache line.

8. The system as recited in claim 5, wherein said cache further comprises:

logic for selecting a least recently used cache line in said congruence class with said bit in said tag associated with said least recently used cache line indicating said least recently used cache line has been reused if there are no cache lines in said congruence class that has not been reused.