Dynamic priority queuing

• US 8,468,534 B2
• Filed: 04/05/2010
• Issued: 06/18/2013
• Est. Priority Date: 04/05/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Tunning, Brian R.
• Primary Examiner(s): Puente, Emerson
• Assistant Examiner(s): KIM, SISLEY NAHYUN
• Application Number:
  US12/754,442
• Publication Number:
  US 20110246996A1
• Time in Patent Office: 1,170 Days
• Field of Search: None
• US Class Current: 718/103
• CPC Class Codes: G06F 2209/486 Scheduler internals
• CPC Class Codes: G06F 2209/5013 Request control
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 2209/548 Queue
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues

Abstract

Techniques are provided for dynamically re-ordering operation requests that have previously been submitted to a queue management unit. After the queue management unit has placed multiple requests in a queue to be executed in an order that is based on priorities that were assigned to the operations, the entity that requested the operations (the “requester”) sends one or more priority-change messages. The one or more priority-change messages include requests to perform operations that have already been queued. For at least one of the operations, the priority assigned to the operation in the subsequent request is different from the priority that was assigned to the same operation when that operation was initially queued for execution. Based on the change in priority, the operation whose priority has change is placed at a different location in the queue, relative to the other operations in the queue that were requested by the same requester.

Claims

1. A method for scheduling operations, comprising:

maintaining a queue of to-be-executed operations, wherein the to-be-executed operations are executed in an order based on relative positions of the to-be-executed operations within the queue;

receiving, from an operation requester, one or more first requests for execution of a plurality of operations;

in response to the one or more first requests, placing the plurality of operations in a corresponding first plurality of positions within the queue;

after the plurality of operations have been placed in the queue and before receiving one or more priority-change messages for the plurality of operations, providing, to the operation requester, information about operations, within the queue, that have been requested by the operation requester;

wherein providing the information includes providing, to the operation requester, a current priority designation for each of the plurality of operations;

after the plurality of operations have been placed in the queue and before the plurality of operations have been executed, receiving, from the operation requester, the one or more priority-change messages for the plurality of operations;

wherein each operation of the plurality of operations has a second priority designation specified by the operation requester in the one or more priority-change messages;

wherein, for at least one operation of the plurality of operations, the second priority designation is different than an initial priority designation;

in response to the one or more priority-change messages that indicate a different priority for the at least one operation, changing the position, within the queue, of said least one operation;

wherein the method is performed by one or more computing devices.

2. The method of claim 1, wherein providing the information to the operation requester is performed in response to a request from the operation requester.

3. The method of claim 1, wherein providing the information to the operation requester is performed in response to the end of an interval of time.

4. The method of claim 1, wherein:

the one or more first requests include metadata associated with the plurality of operations; and

the step of providing the information to the operation requester includes providing the metadata to the operation requester.

5. The method of claim 4 wherein the metadata associated with each operation request includes information used by the operation requestor to determine the second priority designation for the operation request.

6. The method of claim 1 wherein:

the queue includes operations requested by one or more other requestors, and more operations of said requestor are ahead of a particular queued operation of another requestor than were ahead of the particular queued operation prior to changing the position of said at least one operation.

7. The method of claim 1 wherein the queue is maintained by an operating system of a device, and queues operations requested by applications running on the device.

8. The method of claim 1 wherein the queue is maintained by routines in a shared library, and queues operations requested by a plurality of applications that are sharing said shared library.

9. The method of claim 8 further comprising:

the operation requestor including tags with the first one or more requests;

after sending the one or more first requests, and before sending the one or more priority-change messages, the operation requestor performing the steps of;

detecting a priority-changing event;

in response to detecting the priority-changing event, sending a queue information request to the queue management unit;

receiving, as a response to the queue information request, information about operations currently queued by the queue management unit for the operation requester;

wherein the information includes tags associated with the operations that are currently queued; and

determining the second priority designations based, at least in part, on the tags.

10. A non-transitory computer-readable storage storing instructions for scheduling operations, said instructions including instructions which, when executed by one or more processors, cause:

maintaining a queue of to-be-executed operations, wherein the to-be-executed operations are executed in an order based on relative positions of the to-be-executed operations within the queue;

receiving, from an operation requester, one or more first requests for execution of a plurality of operations;

in response to the one or more first requests, placing the plurality of operations in a corresponding first plurality of positions within the queue;

after the plurality of operations have been placed in the queue and before receiving one or more priority-change messages for the plurality of operations, providing, to the operation requester, information about operations, within the queue, that have been requested by the operation requester;

wherein providing the information includes providing, to the operation requestor, a current priority designation for each of the plurality of operations;

after the plurality of operations have been placed in the queue and before the plurality of operations have been executed, receiving, from the operation requester, one or more priority-change messages for the plurality of operations;

wherein each operation of the plurality of operations has a second priority designation specified by the operation requester in the one or more priority-change messages;

wherein, for at least one operation of the plurality of operations, the second priority designation is different than an initial priority designation;

in response to the one or more priority-change messages that indicate a different priority for the at least one operation, changing the position, within the queue, of said least one operation;

wherein the method is performed by one or more computing devices.

11. The non-transitory computer-readable storage of claim 10 wherein providing the information to the operation requester is performed in response to a request from the operation requester.

12. The non-transitory computer-readable storage of claim 10 wherein providing the information to the operation requester is performed in response to the end of an interval of time.

13. The non-transitory computer-readable storage of claim 10 wherein:

the one or more first requests include metadata associated with the plurality of operations; and

the step of providing the information to the operation requester includes providing the metadata to the operation requester.

14. The non-transitory computer-readable storage of claim 13 wherein the metadata associated with each operation request includes information used by the operation requestor to determine the second priority designation for the operation request.

15. The non-transitory computer-readable storage of claim 10 wherein:

the queue includes operations requested by one or more other requestors, and more operations of said requestor are ahead of a particular queued operation of another requestor than were ahead of the particular queued operation prior to changing the position of said at least one operation.

16. A system comprising:

one or more processors; and

a non-transitory computer-readable medium storing instructions executable by the one or more processors to perform operations comprising;

maintaining a queue of to-be-executed operations, wherein the to-be-executed operations are executed in an order based on relative positions of the to-be-executed operations within the queue;

receiving, from an operation requester, one or more first requests for execution of a plurality of operations;

in response to the one or more first requests, placing the plurality of operations in a corresponding first plurality of positions within the queue;

after the plurality of operations have been placed in the queue and before receiving one or more priority-change messages for the plurality of operations, providing, to the operation requester, information about operations, within the queue, that have been requested by the operation requester;

wherein providing the information includes providing, to the operation requester, a current priority designation for each of the plurality of operations;

after the plurality of operations have been placed in the queue and before the plurality of operations have been executed, receiving, from the operation requester, the one or more priority-change messages for the plurality of operations;

wherein each operation of the plurality of operations has a second priority designation specified by the operation requester in the one or more priority-change messages;

wherein, for at least one operation of the plurality of operations, the second priority designation is different than an initial priority designation; and

in response to the one or more priority-change messages that indicate a different priority for the at least one operation, changing the position, within the queue, of said least one operation.

17. The system of claim 16, wherein providing the information to the operation requester is performed in response to a request from the operation requester.

18. The system of claim 16, wherein providing the information to the operation requester is performed in response to the end of an interval of time.

19. The system of claim 16, wherein:

the one or more first requests include metadata associated with the plurality of operations; and

the step of providing the information to the operation requester includes providing the metadata to the operation requester.

20. The system of claim 19 wherein the metadata associated with each operation request includes information used by the operation requestor to determine the second priority designation for the operation request.

21. The system of claim 16 wherein:

the queue includes operations requested by one or more other requestors, and more operations of said requestor are ahead of a particular queued operation of another requestor than were ahead of the particular queued operation prior to changing the position of said at least one operation.

22. The system of claim 16 wherein the queue is maintained by an operating system of a device, and queues operations requested by applications running on the device.

23. The system of claim 16 wherein the queue is maintained by routines in a shared library, and queues operations requested by a plurality of applications that are sharing said shared library.

24. The system of claim 23 further comprising:

the operation requestor including tags with the first one or more requests;

after sending the one or more first requests, and before sending the one or more priority-change messages, the operation requestor performing the steps of;

detecting a priority-changing event;

in response to detecting the priority-changing event, sending a queue information request to the queue management unit;

receiving, as a response to the queue information request, information about operations currently queued by the queue management unit for the operation requester;

wherein the information includes tags associated with the operations that are currently queued; and

determining the second priority designations based, at least in part, on the tags.