Dynamic prioritization of cache access
First Claim
1. A method comprising:
- determining that a first memory access request results in a cache miss;
determining an amount of cache resources used to service cache misses within a past period in response to determining that the first memory access request results in the cache miss;
determining that servicing the first memory access request would increase the amount of cache resources used to service cache misses within the past period to exceed a threshold, wherein the threshold corresponds to reservation of a given amount of cache resources for potential cache hits;
rejecting the first memory access request in response to the determining that servicing the first memory access request would increase the amount of cache resources used to service cache misses within the past period to exceed the threshold; and
tentatively accepting a second memory access request after rejecting the first memory access request.
2 Assignments
0 Petitions
Accused Products
Abstract
Some embodiments of the inventive subject matter are directed to determining that a memory access request results in a cache miss and determining an amount of cache resources used to service cache misses within a past period in response to determining that the memory access request results in the cache miss. Some embodiments are further directed to determining that servicing the memory access request would increase the amount of cache resources used to service cache misses within the past period to exceed a threshold. In some embodiments, the threshold corresponds to reservation of a given amount of cache resources for potential cache hits. Some embodiments are further directed to rejecting the memory access request in response to the determining that servicing the memory access request would increase the amount of cache resources used to service cache misses within the past period to exceed the threshold.
13 Citations
13 Claims
-
1. A method comprising:
-
determining that a first memory access request results in a cache miss; determining an amount of cache resources used to service cache misses within a past period in response to determining that the first memory access request results in the cache miss; determining that servicing the first memory access request would increase the amount of cache resources used to service cache misses within the past period to exceed a threshold, wherein the threshold corresponds to reservation of a given amount of cache resources for potential cache hits; rejecting the first memory access request in response to the determining that servicing the first memory access request would increase the amount of cache resources used to service cache misses within the past period to exceed the threshold; and tentatively accepting a second memory access request after rejecting the first memory access request. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method comprising:
-
tentatively accepting a memory access request for service by at least one of a plurality of cache state machines; determining that the memory access request results in a cache miss; determining an amount of usage of the plurality of cache state machines within a past period; determining that the at least one of a plurality of cache state machines is to be reserved for potential future cache hits based on the amount of usage of the plurality of cache state machines within the past period; and rejecting the memory access request for service by the at least one of the plurality of cache state machines in response to determining that the at least one of a plurality of cache state machines is to be reserved for the potential future cache hits. - View Dependent Claims (8, 9, 10, 11, 12, 13)
-
Specification