Scheduling storage accesses for rate-guaranteed and non-rate-guaranteed requests

• US 6,721,789 B1
• Filed: 10/06/1999
• Issued: 04/13/2004
• Est. Priority Date: 10/06/1999
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: DeMoney, Michael A.
• Primary Examiner(s): Burgess, Glenton B.
• Assistant Examiner(s): EDELMAN, BRADLEY E
• Application Number:
  US09/413,043
• Time in Patent Office: 1,651 Days
• Field of Search: 725/94, 725/95, 725/96, 709/219, 709/232, 709/103, 709/227, 370/230, 370/235, 370/412
• US Class Current: 709/219
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04N 21/2326 Scheduling disk or memory reading operations
• CPC Class Codes: H04N 21/2396 characterized by admission policies admission control, resource allocation in open networks H04L12/5692; arrangements for network security using user profiles for access control H04L63/102; access security in wireless networks H04W12/08

Abstract

A system for managing storage accesses for rate guaranteed continuous multimedia data streams and non-rate-guaranteed storage requests may include a plurality of rate guaranteed requestors for multimedia streams and one or more non-rate guaranteed requesters. A disk scheduler may also be included. The disk scheduler may have a guaranteed rate queue for queuing storage requests from the rate guaranteed requestors and a non-rate-guaranteed queue for queuing requests from the non-rate-guaranteed requestors. The disk scheduler may also include a bandwidth allocator coupled to the guaranteed rate queue and the non-rate-guaranteed queue and further coupled to a storage system. The bandwidth allocator may be configured to allocate bandwidth of the storage system between the guaranteed rate queue and the non-rate-guaranteed queue according to a predetermined ratio. The rate guaranteed requestors may be limited so that an aggregate of maximum stream rates guaranteed for each rate guaranteed requestor does not exceed the portion of the bandwidth allocated to the guaranteed rate queue. Requests may be ordered in the guaranteed rate queue according to a deadline. Requests may be ordered in the non-rate guaranteed queue according to a priority. The system may also include a buffer ring for each multimedia data stream from one of the rate guaranteed requestors.

Claims

1. A system for managing storage accesses for rate guaranteed continuous multimedia data streams and non-rate-guaranteed storage requests, comprising:

a plurality of rate guaranteed requesters for multimedia data streams;

one or more non-rate-guaranteed requesters;

a disk scheduler, comprising

a guaranteed rate queue for queuing storage requests from said rate guaranteed requesters;

a non-rate-guaranteed queue for queuing requests from said non-rate-guaranteed requesters; and

a bandwidth allocator coupled to said guaranteed rate queue and said non-rate-guaranteed queue, and further coupled to a storage system, wherein said bandwidth allocator is configured to allocate bandwidth of the storage system between said guaranteed rate queue and said non-rate-guaranteed queue according to a predetermined ratio.

2. The system as recited in claim 1, wherein said plurality of rate guaranteed requesters requesting streams to the storage system is limited so that an aggregate of maximum stream rates guaranteed for each rate guaranteed requester does not exceed the portion of the bandwidth of the storage system allocated to said guaranteed rate queue.

3. The system as recited in claim 1, wherein said bandwidth allocator is configured to migrate requests from said guaranteed rate queue and said non-rate-guaranteed queue to the storage system according to the predetermined ratio, wherein bandwidth not used by said guaranteed rate queue is made available to said non-rate-guaranteed queue.

4. The system as recited in claim 1, wherein said bandwidth allocator is configured to migrate requests from said guaranteed rate queue and said non-rate-guaranteed queue to the storage system according to the predetermined ratio, wherein bandwidth not used by said non-rate-guaranteed queue is made available to said guaranteed rate queue.

5. The system as recited in claim 1, wherein said bandwidth allocator migrates requests from said guaranteed rate queue and said non-rate-guaranteed queue to the storage system according to a cycle, wherein said cycle comprises a plurality of slots, each slot indicating whether a current request should be migrated from the guaranteed rate queue or the non-rate-guaranteed queue, wherein said slots are evenly distributed throughout the cycle according to the predetermined ratio.

6. The system as recited in claim 5, wherein said bandwidth allocator is configured to repeatedly traverse the cycle to determine from which queue to migrate a request to the storage system, wherein if the current slot of the cycle indicates the guaranteed rate queue, a request is migrated from the guaranteed rate queue if it is non-empty, otherwise from the non-rate-guaranteed queue if that queue is non-empty, and wherein if the current slot of the cycle indicates the non-rate-guaranteed queue, a request is migrated from the non-rate-guaranteed queue if it is non-empty, otherwise from the guaranteed rate queue if that queue is non-empty.

7. The system as recited in claim 1, wherein requests are ordered in said guaranteed rate queue according to a deadline, wherein the deadline for each request indicates a latest time by which that request must be fulfilled to meet a guaranteed maximum stream rate for the corresponding multimedia data stream.

8. The system as recited in claim 7, wherein said bandwidth allocator is configured to migrate the request with the earliest deadline from the guaranteed rate queue.

9. The system as recited in claim 1, wherein requests are ordered in said non-rate-guaranteed queue according to a priority, wherein said bandwidth allocator is configured to migrate the request with the highest priority from the non-rate-guaranteed queue.

10. The system as recited in claim 1, said disk scheduler further comprising a seek reorder queue coupled to said bandwidth allocator and the storage system, wherein said bandwidth allocator is configured to migrate requests from said guaranteed rate and non-rate-guaranteed queues to said reorder queue according to said predetermined ratio, and wherein the requests are reordered in said seek reorder queue according to their physical location within the storage system.

11. The system as recited in claim 10, wherein said disk scheduler is configured to traverse the seek reorder queue in one direction issuing the next request to the storage system, wherein when an end of the seek reorder queue is reached, the disk scheduler reverses the direction of traversal.

12. The system as recited in claim 1, wherein the disk scheduler is repeated for each of a plurality of storage systems.

13. The system as recited in claim 12, further comprising a file system for mapping each request from said rate guaranteed requesters and said non-rate-guaranteed requesters to one of the storage systems containing a location of the request.

14. The system as recited in claim 13, wherein said file system directs requests from said rate guaranteed requesters and said non-rate-guaranteed requesters to the guaranteed rate queue or non-rate-guaranteed queue of the appropriate disk scheduler, and wherein said file system also generates file system requests to the appropriate disk scheduler.

15. The system as recited in claim 14, wherein said file system requests comprise time-critical file system requests and non-time-critical file system requests.

16. The system as recited in claim 15, wherein requests are ordered in said guaranteed rate queue according to a deadline, wherein the deadline for each request from one of the rate guaranteed requesters indicates a latest time by which that request must be fulfilled to meet a guaranteed maximum stream rate for the corresponding multimedia data stream, and wherein requests are ordered in said non-rate-guaranteed queue according to a priority, wherein said bandwidth allocator is configured to migrate the request with the highest priority from the non-rate-guaranteed queue.

17. The system as recited in claim 16, wherein time-critical file system requests are sent to the guaranteed rate queue with a corresponding deadline, and wherein said non-time-critical file system request are sent to the non-rate guaranteed queue with a corresponding priority.

18. The system as recited in claim 17, wherein non-time-critical file system requests are assigned a higher priority than requests from non-rate-guaranteed requesters.

19. The system as recited in claim 1, wherein requests from non-rate-guaranteed requesters include FTP or NFS file transfer requests.

20. The system as recited in claim 1, further comprising a buffer ring for each multimedia data stream from one of the rate guaranteed requesters, wherein said buffer ring buffers multimedia stream data between an associated rate-guaranteed requester and the disk scheduler.

21. The system as recited in claim 20, wherein said buffer ring contains a number of buffers chosen to prevent buffer underrun at a guaranteed maximum stream rate, wherein each buffer is sized to hold one block of multimedia data.

22. The system as recited in claim 21, wherein the buffers of each buffer ring are consumed by the associated rate guaranteed requester one after another in a circular order, wherein as each buffer is consumed, a request and a deadline for the just consumed buffer is issued to the guaranteed rate queue, wherein the deadline indicates a time by which the request must be fulfilled to prevent underrun.

23. The system as recited in claim 22, wherein each deadline is calculated as:

24. A method for managing storage accesses for rate guaranteed continuous multimedia data streams and non-rate-guaranteed storage requests, the method comprising:

allocating a portion of a storage system'"'"'s bandwidth to stream requests from rate guaranteed requesters and allocating the remaining portion of the storage system'"'"'s bandwidth to requests from non-rate-guaranteed requesters;

queuing storage requests from rate guaranteed requesters in a guaranteed rate queue;

queuing storage requests from non-rate-guaranteed requesters in a non-rate-guaranteed queue; and

selecting either the guaranteed rate queue or the a non-rate-guaranteed queue according to the bandwidth allocation to migrate one of the requests to the storage system.

25. The method as recited in claim 24, further comprising establishing a maximum guaranteed rate for each of a plurality of multimedia streams, wherein requests from the guaranteed rate requesters are for one of the multimedia streams.

26. The method as recited in claim 25, further comprising limiting the number of multimedia streams so that the aggregate of the maximum guaranteed rate for each stream does not exceed the bandwidth allocated to stream requests from rate guaranteed requesters.

27. The method as recited in claim 24, further comprising dynamically reallocating unused bandwidth for rate guaranteed requests to non-rate-guaranteed requests.

28. The method as recited in claim 24, further comprising dynamically reallocating unused bandwidth for non-rate-guaranteed requests to rate guaranteed requests.

29. The method as recited in claim 24, wherein said selecting comprises migrating requests from said guaranteed rate queue and said non-rate-guaranteed queue to the storage system according to a cycle, wherein said cycle comprises a plurality of slots, each slot indicating whether a current request should be migrated from the guaranteed rate queue or the non-rate-guaranteed queue, wherein said slots are evenly distributed throughout the cycle according to the ratio of bandwidth allocated between rate guaranteed requests and non-rate-guaranteed requests.

30. The method as recited in claim 29, wherein said selecting further comprises repeatedly traversing the cycle to determine from which queue to migrate a request to the storage system, wherein if the current slot of the cycle indicates the guaranteed rate queue, a request is migrated from the guaranteed rate queue if it is non-empty, otherwise from the non-rate-guaranteed queue if that queue is non-empty, and wherein if the current slot of the cycle indicates the non-rate-guaranteed queue, a request is migrated from the non-rate-guaranteed queue if it is non-empty, otherwise from the guaranteed rate queue if that non-empty.

31. The method as recited in claim 24, further comprising ordering requests in said guaranteed rate queue according to a deadline, wherein the deadline for each requests indicates a latest time by which that request must be fulfilled to meet a guaranteed maximum stream rate for a corresponding multimedia data stream.

32. The method as recited in claim 31, wherein said selecting comprises migrating the request with the earliest deadline from the guaranteed rate queue to the storage system.

33. The method as recited in claim 24, further comprising ordering requests in said non-rate-guaranteed queue according to a priority, wherein said selecting comprises migrating the request with the highest priority from the non-rate-guaranteed queue to the storage system.

34. The method as recited in claim 24, wherein said selecting comprises:

migrating requests from said guaranteed rate and non-rate-guaranteed queues to a seek reorder queue according to the bandwidth allocation; and

reordering the migrated requests in said seek reorder queue according to their physical location within the storage system.

35. The method as recited in claim 34, further comprising:

traversing the seek reorder queue in one direction;

issuing the next request in the seek reorder queue to the storage system; and

reversing the direction of traversal when an end of the seek reorder queue is reached.

36. The method as recited in claim 24, further comprising repeating said allocating, said queuing storage requests from rate guaranteed requesters, queuing storage requests from non-rate-guaranteed requesters, and said selecting for each of a plurality of storage systems.

37. The method as recited in claim 36, further comprising mapping each request from said rate guaranteed requesters and said non-rate-guaranteed requesters to one of the storage systems containing a location of the request.

38. The method as recited in claim 37, wherein said mapping comprises:

directing requests from said rate guaranteed requesters and said non-rate-guaranteed requesters to the guaranteed rate queue or non-rate-guaranteed queue of the appropriate storage system; and

generating file system requests to the appropriate storage system.

39. The method as recited in claim 38, wherein said file system requests comprise time-critical file system requests and non-time-critical file system requests.

40. The method as recited in claim 39, further comprising:

ordering requests in said guaranteed rate queue according to a deadline, wherein the deadline for each request from one of the rate guaranteed requesters indicates a latest time by which that request must be fulfilled to meet a guaranteed maximum stream rate for the corresponding multimedia data stream; and

ordering requests in said non-rate-guaranteed queue according to a priority;

wherein said selecting comprises migrating the request with the highest priority from the non-rate-guaranteed queue.

41. The method as recited in claim 40, further comprising:

sending time-critical file system requests to the guaranteed rate queue with a corresponding deadline; and

sending non-time-critical file system request to the non-rate guaranteed queue with a corresponding priority.

42. The method as recited in claim 41, further comprising assigning non-time-critical file system requests a higher priority than requests from non-rate-guaranteed requesters.

43. The method as recited in claim 24, wherein requests from non-rate-guaranteed requesters include FTP or NFS file transfer requests.

44. The method as recited in claim 24, further comprising establishing a buffer ring for each multimedia data stream from one of the rate guaranteed requesters, said buffer ring buffering multimedia stream data between an associated rate-guaranteed requester and the storage system.

45. The method as recited in claim 44, further comprising sizing said buffer ring to contain a number of buffers chosen to prevent buffer underrun at a guaranteed maximum stream rate, wherein each buffer is sized to hold one block of multimedia data.

46. The method as recited in claim 45, further comprising:

consuming the buffers of each buffer ring by the associated rate guaranteed requester one after another in a circular order; and

as each buffer is consumed, issuing a request and a deadline for the just consumed buffer to the guaranteed rate queue, wherein the deadline indicates a time by which the request must be fulfilled to prevent underrun.

47. The method as recited in claim 46, further comprising calculating each deadline as: