TECHNIQUES FOR SHARING PRIORITIES BETWEEN STREAMS OF WORK AND DYNAMIC PARALLELISM
First Claim
1. A method for mapping a plurality of stream priorities associated with a software application to a plurality of device priorities supported by a parallel processing subsystem, the method comprising:
- identifying a maximum nesting depth;
receiving a first request from the software application that comprises a request to associate a first stream with a first stream priority;
mapping the first stream priority to a first device priority;
receiving a second request from the software application that comprises a request to associate a second stream with a second stream priority, wherein the second stream priority is higher in priority than the first stream priority; and
mapping the second stream priority to a second device priority, wherein the second device priority is at least the maximum nesting depth higher in priority than the first device priority.
1 Assignment
0 Petitions
Accused Products
Abstract
One embodiment sets forth a method for assigning priorities to kernels launched by a software application and executed within a stream of work on a parallel processing subsystem that supports dynamic parallelism. First, the software application assigns a maximum nesting depth for dynamic parallelism. The software application then assigns a stream priority to a stream. These assignments cause a driver to map the stream priority to a device priority and, subsequently, associate the device priority with the stream. As part of the mapping, the driver ensures that each device priority is at least the maximum nesting depth higher than the device priorities associated with any lower priority streams. Subsequently, the driver launches any kernel included in the stream with the device priority associated with the stream. Advantageously, by strategically assigning the maximum nesting depth and prioritizing streams, an application developer may increase the overall processing efficiency of the software application.
-
Citations
20 Claims
-
1. A method for mapping a plurality of stream priorities associated with a software application to a plurality of device priorities supported by a parallel processing subsystem, the method comprising:
-
identifying a maximum nesting depth; receiving a first request from the software application that comprises a request to associate a first stream with a first stream priority; mapping the first stream priority to a first device priority; receiving a second request from the software application that comprises a request to associate a second stream with a second stream priority, wherein the second stream priority is higher in priority than the first stream priority; and mapping the second stream priority to a second device priority, wherein the second device priority is at least the maximum nesting depth higher in priority than the first device priority. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer-readable storage medium including instructions that, when executed by a processing unit, cause the processing unit to map a plurality of stream priorities associated with a software application to a plurality of device priorities supported by a parallel processing subsystem by performing the steps of:
-
identifying a maximum nesting depth; receiving a first request from the software application that comprises a request to associate a first stream with a first stream priority; mapping the first stream priority to a first device priority; receiving a second request from the software application that comprises a request to associate a second stream with a second stream priority, wherein the second stream priority is higher in priority than the first stream priority; and mapping the second stream priority to a second device priority, wherein the second device priority is at least the maximum nesting depth higher in priority than the first device priority. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A system configured to map a plurality of stream priorities associated with a software application to a plurality of device priorities supported by a parallel processing subsystem, the system comprising:
a driver program configured to; identify a maximum nesting depth; receive a first request from the software application that comprises a request to associate a first stream with a first stream priority; map the first stream priority to a first device priority; receive a second request from the software application that comprises a request to associate a second stream with a second stream priority, wherein the second stream priority is higher in priority than the first stream priority; and map the second stream priority to a second device priority, wherein the second device priority is at least the maximum nesting depth higher in priority than the first device priority. - View Dependent Claims (20)
Specification