Model-based resource allocation

• US 8,364,710 B2
• Filed: 07/10/2008
• Issued: 01/29/2013
• Est. Priority Date: 07/10/2008
• Status: Active Grant

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Gerovac, Branko J., Carver, David C.
• Primary Examiner(s): Saeed, Usmaan
• Application Number:
  US12/170,646
• Publication Number:
  US 20100011002A1
• Time in Patent Office: 1,664 Days
• Field of Search: None
• US Class Current: 707/781
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A computer-implemented method includes receiving a description of a pattern of access to a first group of items of content; and partitioning a storage space based at least in part on the description of the pattern of access. The description of the pattern of access is a function of at least a first attribute that characterizes one or more operational objectives of a second group of items of content to be stored in a storage system. The partitioning the storage space includes defining each one of a plurality of categories in relation to a range of values of the first attribute; and associating each one of the plurality of categories with a respective one of a plurality of resource allocation arrangements.

Claims

1. A computer-implemented method comprising:

receiving a description of a pattern of access to a first group of items of content, the description of the pattern of access being based on a attribute that is associated with a second group of items of content;

partitioning a storage space, of a storage system, based on the description of the pattern of access, partitioning the storage space including;

defining each one of a plurality of categories in relation to a range of values of the first attribute; and

associating each one of the plurality of categories with a respective one of a plurality of resource allocation arrangements;

receiving a request to store the second group of items of content;

selecting, based on receiving the request, a particular resource allocation arrangement, from the plurality of resource allocation arrangements, based on a particular category, of the plurality of categories, that is associated with the second group of items of content,

the particular resource allocation arrangement including;

first information identifying a quantity of copies, of one or more items of content of the second group of items of content, to store, and

second information identifying an amount of bandwidth associated with accessing the one or more items of content of the second group of items of content; and

storing the second group of items of content, in the storage system, based on the particular resource allocation arrangement.

2. The method of claim 1, further comprising:

determining each one of the plurality of resource allocation arrangements such that an aggregate of resource requirements, associated with the plurality of resource allocation arrangements, is compatible with a particular configuration of the storage system.

3. The method of claim 2, where the aggregate of resource requirements includes:

a requirement relating to an access capacity associated with the storage system, and

a requirement relating to a storage capacity associated with the storage system.

4. The method of claim 1, further comprising:

determining, based on a result of partitioning the storage space, a configuration of the storage system for storing the second group of items of content.

5. The method of claim 4, where determining the configuration of the storage system includes determining characteristics of each one of a set of storage components of the storage system.

6. The method of claim 4, where determining the configuration of the storage system includes:

iteratively generating a candidate configuration of the storage system based on the result of partitioning the storage space; and

selecting a particular configuration of the storage system according to a particular design objective associated with storing the second group of items of content.

7. The method of claim 6, where the particular design objective is characterized by a design objective function, and

where iteratively generating the candidate configuration includes:

providing an initial set of definitions to each one of the plurality of categories in relation to the range of values of the first attribute; and

adjusting to the initial set of definitions to optimize the design objective function.

8. The method of claim 6, where the particular design objective includes minimizing a level of resources requirements for the storage system.

9. The method of claim 6, where the particular design objective includes minimizing a degree of contention between potential resource consumption associated with storing different items of content in the second group of items of content.

10. The method of claim 1, where the description of the pattern of access is a function of a plurality of attributes associated with the second group of items of content,

where the plurality of attributes include:

the first attribute, where the first attribute relates to a popularity associated with the one or more items of content of the second group of items of content,

a second attribute relating to a type of data associated with the one or more items of content of the second group of items of content, and

a third attribute relating to a length associated with the one or more items of content of the second group of items of content.

11. The method of claim 10,

where the first attribute is associated with a plurality of ranges of values, and

where each range of values, of the plurality of ranges of values associated with the first attribute, is associated with a different one of the plurality of categories.

12. The method of claim 1, where the plurality of categories collectively represents a full range of values of the first attribute, and

where the full range of values includes a plurality of different ranges of values associated with the first attribute, and

where each range of values, of the plurality of different ranges of values, is associated with a different one of the plurality of categories.

13. The method of claim 1, where one or more objectives associated with storing the second group of items of content comprise one or more of:

information identifying accessibility of the one or more items of content of the second group of items of content,

information identifying integrity of the one or more items of content,

information identifying resilience associated with the one or more items of content, or

information identifying power consumption associated with the one or more items of content, and

where the second group of items of content is stored based on the one or more objectives.

14. The method of claim 1, where the description of the pattern of access relates to a description of one or more of:

an access rate associated with the one or more items of content of the second group of items of content,

a level of bandwidth consumption associated with the one or more items of content,

a statistical usage distribution associated with the one or more items of content,

a geographical usage distribution associated with the one or more items of content, or

a projected usage distribution, associated with the one or more items of content, that is based on empirical data.

15. The method of claim 1, where, for each category of the plurality of categories, the respective resource allocation arrangement includes information identifying a number of instances of an item of content, of the second group of items of content, to be stored in the storage system, and

where the item of content is associated with the category.

16. The method of claim 1, where the first group of items of content share a common characteristic with the second group of items of content the method further comprising:

projecting a pattern of access to the second group of items based on the common characteristic and the pattern of access to the first group of items of content.

17. The method of claim 16, where each item of content of the first group of items of content and the second group of items of content includes a collection of movie titles.

18. The method of claim 16, where each item of content of the first group of items of content and the second group of items of content includes one or more of:

a type of content associated with online video ads,

a type of content associated with user-generated content,

a type of content associated with music video,

a type of content associated with video of sport-event,

a type of content associated with news segments, or

a type of content associated with TV episodes.

19. The method of claim 1, where the second group of items of content includes at least a subgroup of items of content that is included in the first group of items of content.

20. The method of claim 1, where content included in the second group of items of content is different from content included in the first group of items of content.

21. The method of claim 20, where the second group of items of content does not include any item of content included in the first group of items of content.

22. A system comprising:

a network device to;

partition a storage space, of a storage system, based on a description of a pattern of access to a first group of items of content,

the description of the pattern of access being based on a first attribute associated with a second group of items of content to be stored on the storage system,

when partitioning the storage space, the network device being to;

define each one of a plurality of categories, associated with the first attribute, based on a respective one of a plurality of ranges of values of the first attribute,

each range of values, of the plurality of ranges of values, being associated with a different one of the plurality of categories, and

associate each one of the plurality of categories with a respective one of a plurality of resource allocation arrangements,

store the plurality of resource allocation arrangements in a memory associated with the network device,

receive, via a first network, a request to store the second group of items of content,

select a particular resource allocation arrangement, from the plurality of resource allocation arrangements, based on a particular category, of the plurality of categories, that is associated with the second group of items of content, the particular resource allocation arrangement including;

first information identifying a quantity of copies of the one or more items of content of the second group of items of content to store in the storage system, and

second information identifying an amount of bandwidth associated with accessing the one or more items of content after the one or more items of content have been stored, and

store, via a second network and based on the particular category, the second group of items of content in the storage system,

the second network being different than the first network.

23. The system of claim 22, where, when partitioning the storage space, the network device is further to:

determine a configuration of the storage system to store the second group of items of content based on a result of partitioning the storage space.

24. The system of claim 22, where, when partitioning the storage space, the network device is further to:

define a design objective function that characterizes a particular design objective of the storage system; and

compute a particular configuration of the storage system that optimizes the design objective function.

25. The system of claim 24, where the design objective includes reducing a level of resource requirements for the storage system.

26. The system of claim 25, where the design objective further includes minimizing the level of resource requirements for the storage system.

27. The system of claim 24, where the design objective includes reducing a degree of contention between potential resource consumption associated with different items of content in the second group of items of content.

28. The system of claim 27, where the design objective further includes minimizing the degree of contention between potential resource consumption associated with different items of content in the second group of items of content.

29. The system of claim 22, where the particular resource allocation arrangement further includes:

third information identifying a quantity of storage devices, of the storage system, that are used to store one or more items of content of the second group of items of content.