Storage of data utilizing scheduling queue locations associated with different data rates

• US 8,799,535 B2
• Filed: 01/11/2008
• Issued: 08/05/2014
• Est. Priority Date: 01/11/2008
• Status: Active Grant

• Current Assignee: Akamai Technologies, Inc.
• Original Assignee: Akamai Technologies, Inc.
• Inventors: Hluchyj, Michael G., Krishnan, Santosh, Lawler, Christopher, Pai, Ganesh, Reddy, Umamaheswar
• Primary Examiner(s): Abad, Farley
• Assistant Examiner(s): YU, HENRY W
• Application Number:
  US12/013,367
• Publication Number:
  US 20090182790A1
• Time in Patent Office: 2,398 Days
• Field of Search: 710/52, 710 5- 6, 710/2, 710 20- 21, 710/29, 710/54, 710/56, 370/395.42, 370/395.4, 348/14.12, 711/114, 711168-170, 711/201, 709/231, 360/55
• US Class Current: 710/52
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04N 21/2182 involving memory arrays, e.g. RAID disk arrays RAID arrays per se G06F3/0689; use of parity to protect data in RAID systems G06F11/1008
• CPC Class Codes: H04N 21/2326 Scheduling disk or memory reading operations
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/23439 for generating different versions

Abstract

In one example, multimedia content is requested from a plurality of storage modules. Each storage module retrieves the requested parts, which are typically stored on a plurality of storage devices at each storage module. Each storage module determines independently when to retrieve the requested parts of the data file from storage and transmits those parts from storage to a data queue. Based on a capacity of a delivery module and/or the data rate associated with the request, each storage module transmits the parts of the data file to the delivery module. The delivery module generates a sequenced data segment from the parts of the data file received from the plurality of storage modules and transmits the sequenced data segment to the requester.

Claims

1. A method associated with storage of data, the method comprising:

determining, at a storage module comprising two or more storage devices, a first queue location from a plurality of queue locations for the storage module based on a first data rate associated with at least a portion of a first data file stored in a first storage device of the storage module, some queue locations within the plurality of queue locations being associated with a different data rate, thereby enabling the plurality of queue locations to accommodate a plurality of data rates at the storage module;

determining a second queue location from the plurality of queue locations based on a second data rate associated with at least a portion of a second data file stored in a second storage device of the storage module, the second data rate being different than the first data rate, wherein (a) the second queue location associated with the second storage device and the second data file and (b) the first queue location associated with the first storage device and the first data file are scheduled by the storage module for transmission during a same content read time unit;

processing the first queue location at a first time to enable streaming of the portion of the first data file from the first storage device of the storage module at or above the first data rate; and

processing the second queue location at a second time to enable streaming of the portion of the second data file from the second storage device of the storage module at or above the second data rate.

2. The method of claim 1, wherein the first queue location is within a first scheduling queue and the second queue location is within a second scheduling queue.

3. The method of claim 1, further comprising:

determining the first time based on the first data rate, a start location of the first data file, or both; and

determining the second time based on the second data rate, a start location of the second data file, or both.

4. A method associated with storage of data, the method comprising:

receiving, at a storage module comprising two or more storage devices, a data file request from a delivery module, wherein a first storage device stores at least a portion of a first data file and a second storage device stores at least a portion of a second data file;

selecting a first scheduling queue from a plurality of scheduling queues for the storage module based on a first data rate associated with the data file request, each of the plurality of scheduling queues being associated with a different data rate and including one or more content read time units such that each of (a) the first storage device associated with the first data file and (b) the second storage device associated with the second data file can be scheduled by the storage module for reading at a same content read time unit from the one or more content read time units; and

determining a first queue location within the first scheduling queue based on the data file request.

5. The method of claim 4, further comprising:

processing the first scheduling queue at a first time; and

processing a second scheduling queue at a second time, the second scheduling queue being associated with a different data rate than the first scheduling queue.

6. The method of claim 5, wherein the first time and the second time are identical.

7. The method of claim 4, further comprising determining a time ratio for processing of the first scheduling queue and a second scheduling queue, the time ratio associated with a data rate associated with each queue.

8. The method of claim 7, further comprising:

processing the first scheduling queue at a first time; and

processing the second scheduling queue at a second time which is a function of the time ratio to the first time.

9. The method of claim 4, further comprising adding a part of a data file associated with the data file request to a data queue based on the first queue location within the first scheduling queue.

10. The method of claim 4, further comprising determining a second queue location within the first scheduling queue based on the data file request.

11. The method of claim 4, further comprising:

determining a second scheduling queue from the plurality of scheduling queues based on the data rate associated with the data file request; and

determining a second queue location within the second scheduling queue based on the data file request.

12. The method of claim 4, further comprising determining a plurality of queue locations based on the data file request, the data rate associated with the data file request, or both.

13. The method of claim 12, wherein the plurality of queue locations are within the first scheduling queue.

14. The method of claim 12, wherein the plurality of queue locations are within the first scheduling queue and a second scheduling queue.

15. The method of claim 4, further comprising removing the first queue location within the first scheduling queue based on a file request update.

16. The method of claim 4, wherein the first data rate associated with the data file request comprises a transmission rate of multimedia segments which thereby enables displaying of multimedia content associated with the multimedia segments.

17. A computer program product, tangibly embodied in a non-transitory computer readable medium, the computer program product including instructions being operable to cause a data processing apparatus to:

determine, at a storage module comprising two or more storage devices, a first queue location from a plurality of queue locations for the storage module based on a first data rate associated with at least a portion of a first data file stored in a first data storage device of the storage module, some queue locations within the plurality of queue locations being associated with a different data rate, thereby enabling the plurality of queue locations to accommodate a plurality of data rates at the storage module;

determine a second queue location from the plurality of queue locations based on a second data rate associated with at least a portion of a second data file stored in a second data storage device of the storage module, the second data rate being different than the first data rate, wherein (a) the second queue location associated with the second storage device and the second data file and (b) the first queue location associated with the first storage device and the first data file are scheduled for transmission by the storage module during a same content read time unit;

process the first queue location at a first time to enable streaming of the portion of the first data file from the first storage device of the storage module at or above the first data rate; and

process the second queue location at a second time to enable streaming of the portion of the second data file from the second storage device of the storage module at or above the second data rate.

20. The computer program product of claim 17, wherein the first queue location is within a first scheduling queue and the second queue location is within a second scheduling queue.

18. A system associated with storage of data, the system comprising:

a storage module comprising;

a plurality of storage devices, each storage device configured to store a part of a data file, wherein a first storage device stores at least a portion of a first data file and a second storage device stores at least a portion of a second data file; and

a storage controller module connected to each of the plurality of storage devices independently and configured to;

receive a data file request from a delivery module,

determine a first scheduling queue from a plurality of scheduling queues for the storage module based on a data rate associated with the data file request, each of the plurality of scheduling queues being associated with a different data rate and including one or more content read time units such that each of (a) the first storage device associated with the first data file and (b) the second storage device associated with the second data file can be scheduled by the storage module for reading at a same content read time unit from the one or more content read time units, and

determine a first queue location within the first scheduling queue based on the data file request.

19. A system associated with independent storage of data, the system comprising:

a means for storage of data comprising;

a plurality of means for storing data, each means for storing data stores a part of a data file wherein a first means for storing data stores at least a portion of a first data file and a second means for storing data stores at least a portion of a second data file; and

a means connected to each of the plurality of means for storing data independently and comprising;

a means for receiving a data file request from a delivery module,

a means for determining a first scheduling queue from a plurality of scheduling queues for the means for storage of data based on a data rate associated with the data file request, each of the plurality of scheduling queues being associated with a different data rate and including one or more content read time units such that each of (a) the first means for storing data associated with the first data file and (b) the second means for storing data associated with the second data file can be scheduled by the system for reading at a same content read time unit from the one or more content read time units, and

a means for determining a first queue location within the first scheduling queue based on the data file request.