Data access in distributed systems

• US 9,176,779 B2
• Filed: 07/10/2008
• Issued: 11/03/2015
• Est. Priority Date: 07/10/2008
• Status: Expired due to Fees

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Gerovac, Branko J., Carver, David C.
• Primary Examiner(s): Truong, Dennis
• Application Number:
  US12/170,685
• Publication Number:
  US 20100010999A1
• Time in Patent Office: 2,672 Days
• Field of Search: 709/226, 709/233, 707/694, 707/705, 707/770, 707/812
• US Class Current: 1/1
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]

Abstract

Methods, systems, and apparatus, including computer program products for receiving a request for access to a first item of content stored on resources of a storage environment, the request for access being initiated by a first user, identifying an existing resource allocation arrangement associating elements of the first item of content with respective elements of the resources of the storage environment, performing an inquiry to determine whether an admission condition is satisfied, and upon satisfaction of the admission condition, generating a specification of an access operation, the access operation configured to enable a selected set of elements among the respective elements of the resources of the storage environment to be accessed.

Claims

1. A method comprising:

receiving, by a server device, a request to upload a first item of content;

selecting, by the server device and based on receiving the request, a particular schema, from a plurality of schemas, to use for storing the first item of content,

the particular schema being selected based on an anticipated demand for the first item of content, and

the particular schema including;

first information identifying a quantity of stored copies of the first item of content, and

second information identifying an amount of bandwidth associated with accessing the first item of content;

storing, by the server device and based on selecting the particular schema, the first item of content on resources of a storage environment associated with the server device;

receiving, by the server device, a request for access to the first item of content,

the request for access being initiated by a user device;

identifying, by the server device and based on receiving the request for the access to the first item of content, the particular schema;

analyzing, by the server device, a quantity of bandwidth allocated to one or more existing sessions associated with providing the first item of content;

determining, by the server device, whether an admission condition is satisfied based on the particular schema, a usage of the resources of the storage environment, and an availability of the resources of the storage environment,

the admission condition being satisfied based on determining, based on analyzing the quantity of bandwidth allocated to the one or more existing sessions associated with providing the first item of content, that a session associated with the request will not cause oversubscription;

receiving, by the server device and when the admission condition is satisfied, a particular mapping of a copy of the first item of content; and

providing, by the server device, the copy of the first item of content to the user device.

2. The method of claim 1, where determining whether the admission condition is satisfied further comprises:

determining an available capacity of a first storage component,

the first storage component including elements of the resources associated with the first item of content.

3. The method of claim 2, where the available capacity of the first storage component includes an access capacity based on a maximum data readout rate of the first storage component.

4. The method of claim 2, where the first storage component includes one or more storage devices selected from at least one of:

a disk drive,

a solid-state memory, or

a non-volatile memory.

5. The method of claim 1, where information associated with the particular schema is stored in a first memory, the information including:

information associated with a plurality of mappings,

each of the plurality of mappings being associated with each one of multiple instances of the first item of content stored in the resources of the storage environment.

6. The method of claim 5, where receiving the particular mapping of the copy of the first item of content comprises:

evaluating the plurality of mappings, associated with the first item of content, based on particular criteria; and

selecting the particular mapping based on evaluating the plurality of mappings based on the particular criteria.

7. The method of claim 6, where the particular criteria is associated with an allocation of the resources of the storage environment.

8. The method of claim 1, where the access request includes at least one attribute associated with the first item of content.

9. The method of claim 8, where receiving the particular mapping of the copy of the first item of content is based on the at least one attribute associated with the first item of content.

10. The method of claim 8, where the at least one attribute associated with the first item of content includes one or more of:

a file name of the first item of content,

a data length associated with the first item of content,

a data type of the first item of content, or

a universal resource identifier (URI) associated with the first item of content.

11. The method of claim 1, where the particular mapping is based on at least one of:

a measure of popularity of the first item of content,

a measure of resilience associated with the first item of content, or

a level of integrity associated with the first item of content.

12. The method of claim 1, where the particular mapping is based on a statistical spread associated with elements of the resources of the storage environment.

13. A system comprising:

a processor; and

a memory to store instructions, which when executed by the processor, cause the processor to;

receive a request to upload a first item of content;

select, based on receiving the request, a particular schema, from a plurality of schemas, to use for storing the first item of content,

the particular schema being selected based on an anticipated demand for the first item of content, and

the particular schema including;

first information identifying a quantity of stored copies of the first item of content, and

second information identifying an amount of bandwidth associated with accessing the first item of content;

store, based on selecting the particular schema, the first item of content on resources of a storage environment associated with the system;

receive, from a user device, a request for access to the first item of content;

identify, based on receiving the request for the access to the first item of content, the particular schema;

analyze a quantity of bandwidth allocated to one or more existing sessions associated with providing the first item of content;

determine whether an admission condition is satisfied based on the particular schema, a usage of the resources of the storage environment, and availability of the resources of the storage environment,

the admission condition being satisfied based on determining, based on analyzing the quantity of bandwidth allocated to the one or more existing sessions associated with providing the first item of content, that a session associated with the request will not cause oversubscription;

receive, when the admission condition is satisfied, a particular mapping of a copy of the first item of content; and

provide the copy of the first item of content to the user device.

14. The system of claim 13, where, when determining whether the admission condition is satisfied, the processor further is to:

determine an available capacity of a first storage component,

the first storage component including one or more of the respective elements of the resources associated with the first item of content.

15. The system of claim 14, where the available capacity of the first storage component includes an access capacity based on a maximum data readout rate of the first storage component.

16. The system of claim 14, where the first storage component includes one or more storage devices selected from at least one of:

a disk drive,

a solid-state memory, or

a non-volatile memory.

17. The system of claim 13, where the processor further is to:

store information associated with the particular schema in a first memory, the information including;

information associated with a plurality of mappings, each of the plurality of mappings being associated with each one of multiple instances of the first item of content stored in the resources of the storage environment.

18. The system of claim 17, where, when providing the particular mapping of the copy of the first item of content, the processor is further to:

evaluate the plurality of mappings, associated with the first item of content, based on particular criteria; and

select the particular mapping based on evaluating the plurality of mappings based on the particular criteria.

19. The system of claim 18, where the particular criteria is associated with an allocation of the resources of the storage environment.

20. The system of claim 13, where the access request includes at least one attribute associated with the first item of content.

21. The system of claim 20, where the particular mapping of the copy of the first item of content is based on the at least one attribute associated with the first item of content.

22. The system of claim 21, where the at least one attribute associated with the first item of content includes one or more of:

a file name of the first item of content,

a data length associated with the first item of content,

a data type of the first item of content, or

a universal resource identifier (URI) associated with the first item of content.

23. The system of claim 13, where the particular mapping is based on at least one of:

a measure of popularity of the first item of content,

a measure of resilience associated with the first item of content, or

a level of integrity associated with the first item of content.

24. The system of claim 13, where the particular mapping is further based on a statistical spread associated with elements of the resources of the storage environment.

25. A non-transitory computer-readable storage medium storing instructions, the instructions comprising:

one or more instructions which, when executed by a processor of a device, cause the processor to;

receive a request to upload a first item of content;

select, based on receiving the request, a particular schema, from a plurality of schemas, to use for storing the first item of content,

the particular schema being selected based on an anticipated demand for the first item of content, and

the particular schema including;

first information identifying a quantity of stored copies of the first item of content, and

second information identifying an amount of bandwidth associated with accessing the first item of content;

store, based on selecting the particular schema, the first item of content on resources of a storage environment associated with the device;

receive, from a user device, a request for access to the first item of content;

identify, based on receiving the request for the access to the first item of content, the particular schema;

analyze a quantity of bandwidth allocated to one or more existing sessions associated with providing the first item of content;

determine whether an admission condition is satisfied based on the particular schema, a usage of the resources of the storage environment, and an availability of the resources of the storage environment,

the admission condition being satisfied based on determining, based on analyzing the quantity of bandwidth allocated to the one or more existing sessions associated with providing the first item of content, that a session associated with the request will not cause oversubscription;

receive, when the admission condition is satisfied, a particular mapping of a copy of the first item of content;

provide the copy of the first item of content to the user device.