Cache management mechanism to enable information-type dependent cache policies

• US 6,425,058 B1
• Filed: 09/07/1999
• Issued: 07/23/2002
• Est. Priority Date: 09/07/1999
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fields, James Stephen Jr., Arimilli, Ravi Kumar, Arimilli, Lakshminarayana Baba
• Primary Examiner(s): Kim, Matthew
• Assistant Examiner(s): BATAILLE, PIERRE MICHE
• Application Number:
  US09/390,186
• Time in Patent Office: 1,050 Days
• Field of Search: 711/128, 711/129, 711/133, 711/134, 711/123, 711/135
• US Class Current: 711/134
• CPC Class Codes: G06F 12/121 using replacement algorithms

Abstract

A set associative cache includes a cache controller, a directory, and an array including at least one congruence class containing a plurality of sets. The plurality of sets are partitioned into multiple groups according to which of a plurality of information types each set can store. The sets are partitioned so that at least two of the groups include the same set and at least one of the sets can store fewer than all of the information types. The cache controller then implements different cache policies for at least two of the plurality of groups, thus permitting the operation of the cache to be individually optimized for different information types.

Claims

1. A cache comprising:

at least one congruence class that contains a plurality of sets;

a directory that specifies a partitioning of said plurality of sets into a plurality of groups according to which of a plurality of information types each set can store, wherein at least two of said groups include a same set among said plurality of sets and at least one set among said plurality of sets can store fewer than all of said plurality of information types; and

a cache controller that concurrently implements different cache policies for at least two of said plurality of groups, wherein said cache controller implements a particular cache policy for fewer than all of said plurality of groups in response to receipt of an indication that a particular instruction has been executed by the processor, and wherein said cache controller implements said particular cache policy by selecting one of a plurality of predetermined possible settings.

2. The cache of claim 1, wherein said different cache policies comprise different allocation policies.

3. The cache of claim 1, wherein said different cache policies comprise different cache line replacement policies.

4. The cache of claim 1, wherein said plurality of predetermined possible settings comprise associativities of said plurality of groups.

5. A data processing system, comprising:

a processor; and

a cache, coupled to said processor, that includes;

at least one congruence class that contains a plurality of sets;

a directory that specifies a partitioning of said plurality of sets into a plurality of groups according to which of a plurality of information types each set can store, wherein at least two of said groups include a same set among said plurality of sets and at least one set among said plurality of sets can store fewer than all of said plurality of information types; and

a cache controller that concurrently implements different cache policies for at least two of said plurality of groups,wherein said cache controller implements a particular cache policy for fewer than all of said plurality of groups in response to receipt of an indication that a particular instruction has been executed by the processor, and wherein said cache controller implements said particular cache policy by selecting one of a plurality of predetermined possible settings.

6. The data processing system of claim 5, wherein said different cache policies comprise different allocation policies.

7. The data processing system of claim 5, wherein said different cache policies comprise different cache line replacement policies.

8. The data processing system of claim 5, wherein said plurality of predetermined possible setting comprise associativities of said plurality of groups.

9. The data processing system of claim 5, and further comprising a memory coupled to said cache, wherein said cache can concurrently store only a subset of information contained within said memory.

10. A method of managing the storage of information in a single set associative cache having a cache controller, a directory, and an array including at least one congruence class containing a plurality of sets, wherein said cache is associated with a processor, said method comprising:

partitioning said plurality of sets into a plurality of groups according to which of a plurality of information types each set can store, wherein at least two of said groups include a same set among said plurality of sets and at least one set among said plurality of sets can store fewer than all of said plurality of information types; and

utilizing a cache controller of said single set associative cache, concurrently implementing different cache policies for at least two of said plurality of groups, wherein said implementing comprises selecting one of a plurality of predetermined possible settings for a particular cache policy to be applied to fewer than all of said plurality of groups in response to execution of an instruction by the processor.

11. The method of claim 10, wherein concurrently implementing different cache policies for at least two of said plurality of groups comprises implementing different allocation policies.

12. The method of claim 10, wherein concurrently implementing different cache policies for at least two of said plurality of groups comprises implementing different cache line replacement policies.

13. The method of claim 10, wherein selecting one of a plurality of predetermined possible settings for said particular cache policy comprises selecting one of a plurality of possible associativities for said plurality of groups.