Cache eviction
First Claim
1. A machine-readable storage medium comprising instructions which, when executed, cause a machine to:
- evict cached entities of a centralized shared cache memory in accordance with an eviction policy being executed by a framework manager of the cache memory, wherein evicting the cached entities includes versioning the cached entities as they are being referred to by fill metrics, wherein versioning the cached entities includes duplicating the cached entities such that the duplicate cached entities are dynamically updated while the cached entities are being referred to by the fill metrics in compliance with the eviction policy, wherein the cached entities are referred to by the fill metrics that are associated with multiple thresholds that are further associated with multiple distinct processes, and depending on which of the multiple thresholds is exceeded, a corresponding process of the multiple processes is triggered, wherein the instructions which, when executed, further cause the machine to compute a fill level corresponding to a fill metric, the fill level at the cache memory having the cached entities, the computing of the fill level including computing a measurement of each of the fill metrics, wherein the fill level exceeds a threshold if each of the fill metrics exceeds an associated threshold level;
evict one or more of the cached entities in the cache memory in accordance with a first eviction technique if the fill level exceeds a first threshold but not a second threshold;
evict one or more of the cached entities in the cache memory in accordance with a second eviction technique if the fill level exceeds the second threshold but not a third threshold; and
decline subsequent requests to store additional entities in the cache memory if the fill level exceeds the third threshold.
2 Assignments
0 Petitions
Accused Products
Abstract
Described herein are methods and apparatus, including computer program products, that implement cache eviction for runtime systems. A computer program product can cause a data processing apparatus to compute a fill level of a cache memory; use a first eviction process to evict one or more of the entities in the cache memory if the fill level exceeds a first threshold but not a second threshold; use a second, distinct eviction process to evict one or more of the entities in the cache memory if the fill level exceeds the second threshold but not a third threshold; and decline subsequent requests to store additional entities in the cache memory if the fill level exceeds the third threshold.
200 Citations
24 Claims
-
1. A machine-readable storage medium comprising instructions which, when executed, cause a machine to:
-
evict cached entities of a centralized shared cache memory in accordance with an eviction policy being executed by a framework manager of the cache memory, wherein evicting the cached entities includes versioning the cached entities as they are being referred to by fill metrics, wherein versioning the cached entities includes duplicating the cached entities such that the duplicate cached entities are dynamically updated while the cached entities are being referred to by the fill metrics in compliance with the eviction policy, wherein the cached entities are referred to by the fill metrics that are associated with multiple thresholds that are further associated with multiple distinct processes, and depending on which of the multiple thresholds is exceeded, a corresponding process of the multiple processes is triggered, wherein the instructions which, when executed, further cause the machine to compute a fill level corresponding to a fill metric, the fill level at the cache memory having the cached entities, the computing of the fill level including computing a measurement of each of the fill metrics, wherein the fill level exceeds a threshold if each of the fill metrics exceeds an associated threshold level; evict one or more of the cached entities in the cache memory in accordance with a first eviction technique if the fill level exceeds a first threshold but not a second threshold; evict one or more of the cached entities in the cache memory in accordance with a second eviction technique if the fill level exceeds the second threshold but not a third threshold; and decline subsequent requests to store additional entities in the cache memory if the fill level exceeds the third threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method comprising:
-
evicting cached entities of a centralized shared cache memory in accordance with an eviction policy being executed by a framework manager of the cache memory, wherein evicting the cached entities includes versioning the cached entities as they are being referred to by fill metrics, wherein versioning the cached entities includes duplicating the cached entities such that the duplicate cached entities are dynamically updated while the cached entities are being referred to by the fill metrics in compliance with the eviction policy, wherein the cached entities are referred to by the fill metrics that are associated with multiple thresholds that are further associated with multiple distinct processes, and depending on which of the multiple thresholds is exceeded, a corresponding process of the multiple processes is triggered, wherein the evicting of the cached entities includes computing a fill level corresponding to a fill metric, the fill level at the cache memory having the cached entities, the computing of the fill level including computing a measurement of each of the fill metrics, wherein the fill level exceeds a threshold if each of the fill metrics exceeds the associated threshold level; evicting one or more of the entities in the cache memory in accordance with a first eviction technique if the fill level exceeds a first threshold but not a second threshold; evicting one or more of the entities in the cache memory in accordance with a second eviction technique if the fill level exceeds the second threshold but not a third threshold; and declining subsequent requests to store additional entities in the cache memory if the fill level exceeds the third threshold. - View Dependent Claims (15, 16, 17, 18)
-
-
19. A system comprising:
-
means for evicting cached entities of a centralized shared cache memory in accordance with an eviction policy being executed by a framework manager of the cache memory, wherein evicting the cached entities includes versioning the cached entities as they are being referred to by fill metrics, wherein versioning the cached entities includes duplicating the cached entities such that the duplicate cached entities are dynamically updated while the cached entities are being referred to by the fill metrics in compliance with the eviction policy, wherein the cached entities are referred to by the fill metrics that are associated with multiple thresholds that are further associated with multiple distinct processes, and depending on which of the multiple thresholds is exceeded, a corresponding process of the multiple processes is triggered, wherein the server computer system is further to compute a fill level corresponding to a fill metric, the fill level at the cache memory having the cached entities, the computing of the fill level including computing a measurement of each of the fill metrics, wherein the fill level exceeds a threshold if each of the fill metrics exceeds the associated threshold level; means for evicting one or more of the entities in the cache memory in accordance with a first eviction technique if the fill level exceeds a first threshold but not a second threshold; means for evicting one or more of the entities in the cache memory in accordance with a second eviction technique if the fill level exceeds the second threshold but not a third threshold; and means for declining subsequent requests to store additional entities in the cache memory if the fill level exceeds the third threshold. - View Dependent Claims (20, 21, 22, 23, 24)
-
Specification