Coordinating Accesses of Shared Resources by Clients in a Computing Device

• US 20180115495A1
• Filed: 10/20/2016
• Published: 04/26/2018
• Est. Priority Date: 10/20/2016
• Status: Active Grant

• Current Assignee: Advanced Micro Devices, Inc.
• Original Assignee: Advanced Micro Devices, Inc.
• Inventors: Branover, Alexander J., Tsien, Benjamin
• Granted Patent: US 10,884,477 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/3234 Power saving characterised by the action undertaken
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 1/3275 Power saving in memory, e.g. RAM, cache
• CPC Class Codes: H04L 47/50 Queue scheduling
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The described embodiments include a computing device with a plurality of clients and a shared resource for processing job items. During operation, a given client of the plurality of clients stores first job items in a queue for the given client. When the queue for the given client meets one or more conditions, the given client notifies one or more other clients that the given client is to process job items using the shared resource. The given client then processes the first job items from the queue using the shared resource. Based on being notified, at least one other client that has second job items to be processed using the shared resource, processes the second job items using the shared resource. The given client can transition the shared resource between power states to enable the processing of job items.

Claims

1. A method for processing job items in a computing device that includes a plurality of clients and a resource, the method comprising:

storing, by a given client of the plurality of clients, first job items in a queue for the given client;

when the queue for the given client meets one or more conditions, notifying, by the given client, one or more other clients of the plurality of clients that the given client is to process job items using the resource;

processing, by the given client, the first job items from the queue for the given client using the resource; and

based on being notified, processing, by at least one other client that has second job items to be processed using the resource, the second job items using the resource.

2. The method of claim 1, further comprising:

transitioning the resource from a lower-power state to a higher-power state in preparation for processing job items, wherein processing the first and second job items occurs substantially contemporaneously while the resource is in the higher-power state.

3. The method of claim 2, further comprising:

returning the resource to the lower-power state from the higher-power state after processing the first and second job items.

4. The method of claim 1, wherein:

the plurality of clients is logically organized in a multi-level hierarchy, with each level of the multi-level hierarchy including a different at least one of the plurality of clients, and

the notifying comprises notifying only other clients in a specified subset of the levels of the multi-level hierarchy, so that only the other clients in the subset of the levels process corresponding job items based on being notified.

5. The method of claim 1, further comprising:

storing, by the at least one other client, job items comprising the second job items in a queue for the at least one other client;

wherein processing the second job items comprises acquiring the second job items from the queue for the at least one other client.

6. The method of claim 5, further comprising, when storing the job items in the queue for the at least one other client, by the at least one other client:

upon exceeding a corresponding threshold for job items in the queue for the at least one other client, immediately processing at least some job items from the queue for the at least one other client, without first being notified by the given client.

7. The method of claim 1, wherein at least one client of the plurality of clients is a masked client, the masked client processing job items independently of the given client.

8. The method of claim 1, wherein the queue for the given client meets the one or more conditions when at least one of the following is true:

the first job items in the queue for the given client include more than a specified number of job items;

or

the first job items in the queue for the given client include one or more specified types of job item.

9. The method of claim 1, wherein:

the first and second job items are requests to perform memory accesses and the resource is a memory subsystem in the computing device; and

processing the first and second job items using the resource comprises performing corresponding memory accesses using the memory subsystem.

10. The method of claim 1, wherein:

the first and second job items are requests to send or receive data via a network and the resource is a network subsystem in the computing device; and

processing the first and second job items using the resource comprises sending or receiving data using the network subsystem.

11. The method of claim 1, wherein:

the first and second job items are requests to process media data and the resource is a media processing subsystem in the computing device; and

processing the first and second job items using the resource comprises processing media data using the media processing subsystem.

12. A computing device that processes job items, comprising:

a plurality of clients; and

a resource;

wherein the computing device is configured to;

store, by a given client of the plurality of clients, first job items in a queue for the given client;

when the queue for the given client meets one or more conditions, notify, by the given client, one or more other clients of the plurality of clients that the given client is to process job items using the resource;

process, by the given client, the first job items from the queue for the given client using the resource; and

based on being notified, process, by at least one other client that has second job items to be processed using the resource, the second job items using the resource.

13. The computing device of claim 12, wherein the computing device is further configured to:

by the given client, transition the resource from a lower-power state to a higher-power state in preparation for processing job items, wherein processing the first and second job items occurs substantially contemporaneously while the resource is in the higher-power state.

14. The computing device of claim 13, wherein the computing device is further configured to:

return the resource to the lower-power state from the higher-power state after processing the first and second job items.

15. The computing device of claim 12, wherein:

the plurality of clients is logically organized in a multi-level hierarchy, with each level of the multi-level hierarchy including a different at least one of the plurality of clients, and

when notifying the one or more other clients, the computing device is further configured to notify only other clients in a specified subset of the levels of the multi-level hierarchy, so that only the other clients in the subset of the levels process corresponding job items based on being notified.

16. The computing device of claim 12, wherein:

the computing device is further configured to store, by the at least one other client, job items comprising the second job items in a queue for the at least one other client; and

processing the second job items comprises acquiring the second job items from the queue for the at least one other client.

17. The computing device of claim 16, wherein the computing device is further configured to, when storing the job items in the queue for the at least one other client, by the at least one other client:

upon exceeding a corresponding threshold for job items in the queue for the at least one other client, immediately process at least some job items from the queue for the at least one other client, without first being notified by the given client.

18. The computing device of claim 12, wherein at least one client of the plurality of clients is a masked client, the masked client processing job items independently of the given client.

19. The computing device of claim 12, wherein the queue for the given client meets the one or more conditions when at least one of the following is true:

the first job items in the queue for the given client include more than a specified number of job items;

or

the first job items in the queue for the given client include one or more specified types of job item.