Dynamic cache allocating techniques for cloud computing systems

• US 9,992,076 B2
• Filed: 10/15/2014
• Issued: 06/05/2018
• Est. Priority Date: 10/15/2014
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Mason, Seth
• Primary Examiner(s): Milef, Elda G
• Application Number:
  US14/514,480
• Publication Number:
  US 20160112281A1
• Time in Patent Office: 1,329 Days
• CPC Class Codes: G06Q 20/145 Payments according to the detected use or quantity
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/122 of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV]
• CPC Class Codes: H04L 41/5051 Service on demand, e.g. definition and deployment of services in real time
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04W 4/60 Subscription-based services using application servers or record carriers, e.g. SIM application toolkits

Abstract

Techniques are presented herein to allow a tenant application in a cloud computing environment to automatically adjust storage infrastructure cache allocation according to performance needs and cost associated with use of the cache. Information is stored for a spot price of a cache of a storage infrastructure used for data storage in a cloud computing environment. A request is received to allocate additional cache for use by one or more applications associated with a first tenant running in the cloud computing environment. Information is sent to the one or more applications indicating a current spot price of the cache of the storage infrastructure. An instruction is received from the one or more applications to purchase the additional allocation of the cache based on the current spot price or based on a predetermined fixed price. An allocation request is sent to the storage infrastructure for additional allocation of the cache.

Claims

1. A computer-implemented method comprising:

storing information for a spot price of a cache of a storage infrastructure used for data storage in a cloud computing environment, the spot price representing a variable price per memory size allocation for use of the cache of the storage infrastructure and being determined based on supply and demand of the cache;

receiving a request for allocation of additional cache for use by one or more applications associated with a first tenant running in the cloud computing environment;

sending, to the one or more applications, information indicating a current spot price of the cache of the storage infrastructure;

receiving, from the one or more applications, an instruction to purchase the allocation of additional cache based on the current spot price or based on a predetermined fixed price;

sending, to the storage infrastructure, an allocation request for allocation of the additional cache based on the current spot price or the predetermined fixed price;

receiving from one or more applications associated with a second tenant a request to purchase allocation of the cache at the predetermined fixed price;

determining whether there is sufficient cache available to fulfill the request for allocation of the cache for the second tenant at the predetermined fixed price;

automatically de-allocating the additional cache for use by the one or more applications of the first tenant if it is determined that there is insufficient cache available to fulfill the request for allocation of the cache for the second tenant so as to fulfill the request for allocation of the cache for the second tenant; and

sending, to a network controller that manages a network over which the one or more applications communicate with the storage infrastructure, a request for a minimum amount of bandwidth for traffic in the network for the first tenant based on an amount of cache allocated to the one or more applications for the first tenant.

2. The method of claim 1, wherein the instruction received from the one or more applications specifies to purchase the allocation of additional cache based on the current spot price.

3. The method of claim 2, further comprising determining whether there is availability in the cache for the allocation of additional cache contained in the request.

4. The method of claim 2, further comprising:

receiving, from the storage infrastructure, an allocation request complete notification that indicates that the allocation of additional cache has been completed; and

sending a notification to the one or more applications to indicate that the allocation of additional cache is complete.

5. The method of claim 4, further comprising executing a financial charge to the first tenant for the allocation of additional cache.

6. The method of claim 1, further comprising:

receiving a request from the one or more applications to de-allocate the additional cache; and

sending a de-allocation request to the storage infrastructure to de-allocate the additional cache for the one or more applications.

7. The method of claim 6, further comprising receiving a de-allocation complete notification from the storage infrastructure indicating that the allocation of additional cache has been de-allocated.

8. The method of claim 7, further comprising adjusting financial charges to the first tenant for the de-allocation of the additional cache.

9. The method of claim 1, wherein the request for allocation of additional cache is generated by the one or more applications associated with the first tenant based on a determination that a number of Input/Output Operations per Second (IOPS) being executed is decreasing, a working data set of most commonly accessed data has increased, or a workload is about to start which requires an increase in IOPS.

10. A non-transitory computer readable storage media encoded with instructions that, when executed by a computer, cause the computer to perform operations comprising:

storing information for a spot price of a cache of a storage infrastructure used for data storage in a cloud computing environment, the spot price representing a variable price per memory size allocation for use of the cache of the storage infrastructure and being determined based on supply and demand of the cache;

receiving a request for allocation of additional cache for use by one or more applications associated with a first tenant running in the cloud computing environment;

sending, to the one or more applications, information indicating a current spot price of the cache of the storage infrastructure;

receiving, from the one or more applications, an instruction to purchase the allocation of additional cache based on the current spot price or based on a predetermined fixed price;

sending, to the storage infrastructure, an allocation request for allocation of the additional cache based on the current spot price or the predetermined fixed price;

receiving from one or more applications associated with a second tenant a request to purchase allocation of the cache at the predetermined fixed price;

determining whether there is sufficient cache available to fulfill the request for allocation of the cache for the second tenant at the predetermined fixed price;

automatically de-allocating the additional cache for use by the one or more applications of the first tenant if it is determined that there is insufficient cache available to fulfill the request for allocation of the cache for the second tenant so as to fulfill the request for allocation of the cache for the second tenant; and

sending, to a network controller that manages a network over which the one or more applications communicate with the storage infrastructure, a request for a minimum amount of bandwidth for traffic in the network for the first tenant based on an amount of cache allocated to the one or more applications for the first tenant.

11. The non-transitory computer readable storage media of claim 10, wherein the instruction received, from the one or more applications, specifies to purchase the allocation of additional cache based on the spot price.

12. The non-transitory computer readable storage media of claim 11, further comprising instructions that, when executed by the computer, cause the computer to perform operations comprising:

determining whether there is availability in the cache for the allocation of additional cache contained in the request.

13. The non-transitory computer readable storage media of claim 11, further comprising instructions that, when executed by the computer, cause the computer to perform operations comprising:

receiving, from the storage infrastructure, an allocation request complete notification that indicates that the allocation of additional cache has been completed;

sending a notification to the one or more applications to indicate that the allocation of additional cache is complete; and

executing a financial charge to the first tenant for the allocation of additional cache.

14. The non-transitory computer readable storage media of claim 10, further comprising instructions that, when executed by the computer, cause the computer to perform operations comprising:

receiving a request from the one or more applications to de-allocate the additional cache; and

sending a de-allocation request to the storage infrastructure to de-allocate the additional cache for the one or more applications.

15. The non-transitory computer readable storage media of claim 14, further comprising instructions that, when executed by the computer, cause the computer to perform operations comprising:

receiving a de-allocation complete notification from the storage infrastructure indicating that the allocation of additional cache has been de-allocated; and

adjusting financial charges to the first tenant for the de-allocation of the additional cache.

16. The non-transitory computer readable storage media of claim 10, wherein the request to allocate additional cache is generated by the one or more applications associated with the first tenant based on a determination that a number of Input/Output Operations per Second (IOPS) being executed is decreasing, a working data set of most commonly accessed data has increased, or a workload is about to start which requires an increase in IOPS.

17. A system comprising:

a storage infrastructure subsystem including at least one storage array and non-volatile cache memory;

a computer subsystem running one or more applications associated with a first tenant, wherein the computer subsystem interfaces with the storage infrastructure subsystem; and

a processor that is in communication with the storage infrastructure subsystem and the computer subsystem, wherein the processor;

stores information for a spot price of the cache memory, the spot price representing a variable price per memory size allocation for use of the cache memory determined based on supply and demand of the cache memory;

receives a request for allocation of additional cache for use by one or more applications associated with a first tenant running in the cloud computing environment;

causes information indicating a current spot price of the cache memory to be sent to the one or more applications;

receives, from the one or more applications, an instruction to purchase the allocation of additional cache memory based on the current spot price or based on a predetermined fixed price;

causes to be sent, to the storage infrastructure subsystem, an allocation request for the allocation of additional cache memory based on the current spot price or the predetermined fixed price;

receives from one or more applications associated with a second tenant a request to purchase allocation of the cache memory at the predetermined fixed price;

determines whether there is sufficient cache available to fulfill the request for allocation of the cache memory for the second tenant at the predetermined fixed price;

automatically de-allocates the additional cache memory for use by the one or more applications of the first tenant if it is determined that there is insufficient cache memory available to fulfill the request for allocation of the cache memory for the second tenant so as to fulfill the request for allocation of the cache for the second tenant; and

causes to be sent, to a network controller that manages a network over which the one or more applications communicate with the storage infrastructure, a request for a minimum amount of bandwidth for traffic in the network for the first tenant based on an amount of cache allocated to the one or more applications for the first tenant.

18. The system of claim 17, wherein the instruction received from the one or more applications specifies to purchase the allocation of additional cache memory based on the spot price.

19. The system of claim 18, wherein the processor further:

determines whether there is availability in the cache memory for the allocation of additional cache memory contained in the request;

receives, from the storage infrastructure subsystem, an allocation request complete notification that indicates that the allocation of additional cache memory has been completed;

causes to be sent, to the one or more applications, a notification to indicate that the allocation of additional cache memory is complete; and

executes a financial charge to the first tenant for the allocation of additional cache memory.

20. The system of claim 18, wherein the processor further:

receives a request from the one or more applications to de-allocate the additional cache memory; and

causes to be sent, to the storage infrastructure subsystem, a de-allocation request to de-allocate the allocation of additional cache memory for the one or more applications.

21. The system of claim 20, wherein the processor further:

receives a de-allocation complete notification from the storage infrastructure indicating that the allocation of additional cache memory has been de-allocated; and

adjusts financial charges to the first tenant for the de-allocation of the additional cache memory.

22. The system of claim 17, wherein the request to allocate additional cache memory is generated by the one or more applications associated with the first tenant based on a determination that a number of Input/Output Operations per Second (IOPS) being executed is decreasing, a working data set of most commonly accessed data has increased, or a workload is about to start which requires an increase in IOPS.