Computer program and method for managing resources in a distributed storage system

• US 7,694,082 B2
• Filed: 07/29/2005
• Issued: 04/06/2010
• Est. Priority Date: 07/29/2005
• Status: Active Grant

• Current Assignee: Twitter Inc (X Holdings Corp.)
• Original Assignee: International Business Machines Corporation
• Inventors: Golding, Richard Andrew, Wong, Theodore Ming-Tao, Zaki, Omer Ahmed
• Primary Examiner(s): Chace; Christian P
• Assistant Examiner(s): BRADLEY, MATTHEW A
• Application Number:
  US11/192,665
• Publication Number:
  US 20070028068A1
• Time in Patent Office: 1,712 Days
• Field of Search: 711/154
• US Class Current: 711/154
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/0875 with dedicated cache, e.g. instruction or stack
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A resource management system uses a virtual resource pool distributed across a set of storage devices to manage resources in a distributed storage system. The storage devices dedicate a resource in an allocation pool available to the virtual resource pool. The virtual resource pool is a virtual storage server in which an application receives at least a predetermined amount of storage capacity, a predetermined level of performance, or a predetermined reliability, represented by tokens. A virtual resource pool manager gives the tokens to an application. The application transmits the tokens along with the commands to the storage device. The token represents a right to consume up to some limit of resources on a specific storage device in a computing session. The storage device locally tracks resource consumption through the token.

Claims

1. A method of managing a resource in a distributed storage system having a plurality of storage devices, comprising:

generating a virtual pool of resources;

distributing the resources among a set of allocation pools on the storage devices;

where each allocation pool comprises;

a specification of minimum and maximum resources that the allocation pool can consume; and

a measure of current resource usage of the allocation pool;

examining a request for resources by an application to determine availability of requested resources within the set of allocation pools;

if the requested resources are available, then generating a virtual session in response to the request;

generating a set of tokens corresponding to the set of allocation pools, where each token represents a right to consume a minimum guaranteed amount and a maximum limit for a specific resource;

sending the set of tokens to the application for selective transmission to the storage device with a command;

maintaining, at each of the storage devices, a cache entry of the tokens that were recently sent to said storage devices; and

tracking the token in a token cache to monitor and limit consumption of the resources in the storage devices.

2. The method of claim 1, wherein each of the storage devices monitors resource usage associated with each of the tokens.

3. The method of claim 2, wherein if no client sends a command on the virtual session, determining that recent usage dropped below a predetermined threshold, and removing the cache entry associated with the virtual session.

4. The method of claim 3, wherein the tokens carry an indication of the performance expected on the virtual session and the storage devices use, for determining a level of performance to provide to an application.

5. The method of claim 2, wherein the tokens comprise expiration and authentication information to prevent improper copying of the tokens, and to ensure that only an authorized resource management system is capable of generating the tokens.

6. The method of claim 3, wherein a first client sharing tokens with a second client to share the virtual session so that the first and second clients are capable of sharing the virtual session.

7. A computer program product comprising:

one or more computer-readable storage media having stored computer-executable instructions for implementing a method for providing any of a minimum level of performance or a maximum level of performance, to an application in a distributed storage architecture for a plurality of storage devices, said method comprising;

managing resource capabilities represented by a plurality of tokens via a resource management system;

where each token from the plurality of tokens represents a right to consume a minimum guaranteed amount and a maximum limit for a specific resource;

negotiating between the application and the resource management system with regard to the application obtaining at least some of the tokens;

generating a virtual pool of resources for distributing the tokens to the application;

comparing the tokens against a minimum performance utilization of recently-seen tokens and determining whether there are sufficient resources available to accept the tokens, wherein each of the storage devices maintains a cache entry of the tokens that were recently sent to said storage devices;

adding an allocation pool to the pool of resource when sufficient resources are not available in the pool of resources; and

opening a session between the application and the storage devices upon determining there are sufficient resources available to accept the tokens.

8. The system product of claim 7, wherein each of the storage devices monitors resource usage associated with each of the tokens.

9. The product of claim 8, wherein if no client sends a command on the virtual session, the allocation pool manager determines that recent usage dropped below a predetermined threshold, and removing the cache entry associated with the virtual session.

10. The system product of claim 9, wherein the tokens carry an indication of the performance expected on the virtual session and the storage devices use, for determining a level of performance to provide to an application.

11. The product of claim 8, wherein the tokens comprise expiration and authentication information to prevent improper copying of the tokens, and to ensure that only an authorized resource management system is capable of generating the tokens.

12. The system product of claim 9, wherein a first client sharing tokens with a second client to share the virtual session so that the first and second clients are capable of sharing the virtual session.

13. A computer program product having a plurality of executable instruction codes that are stored on a computer-readable medium, for managing a resource in a distributed storage system having a plurality of storage devices, comprising:

a first set of instruction codes for generating a virtual pool of resources;

a second set of instruction codes for distributing the resources among a set of allocation pools on the storage devices;

where each allocation pool comprises;

a specification of minimum and maximum resources that the allocation pool can consume; and

a measure of current resource usage of the allocation pool;

a third set of instruction codes for examining a request for resources by an application to determine availability of requested resources within the set of allocation pools;

a fourth set of instruction codes for generating a virtual session in response to a request for resources by an application if the requested resources are available;

a fifth set of instruction codes for generating a set of tokens representing the resources in the allocation pools;

a sixth set of instruction codes for sending the set of tokens to the application for selective transmission to the storage device with a command, wherein each of the storage devices maintains a cache entry of the tokens that were recently sent to said storage devices; and

a seventh set of instruction codes for tracking the token in a token cache to monitor and limit consumption of the resources in the storage devices.

14. The computer program product of claim 13, wherein each of the storage devices monitors resource usage associated with each of the tokens.

15. The computer program product of claim 14, wherein if no client sends a command on the virtual session, determining that recent usage dropped below a predetermined threshold, and removing the cache entry associated with the virtual session.

16. The computer program product of claim 15, wherein the tokens carry an indication of the performance expected on the virtual session and the storage devices use, for determining a level of performance to provide to an application.

17. The computer program product of claim 14, wherein the tokens comprise expiration and authentication information to prevent improper copying of the tokens, and to ensure that only an authorized resource management system is capable of generating the tokens.