Multi-user multi-GPU render server apparatus and methods

• US 10,311,541 B2
• Filed: 06/30/2017
• Issued: 06/04/2019
• Est. Priority Date: 11/23/2007
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Ma, Tize
• Application Number:
  US15/640,294
• Publication Number:
  US 20190005605A1
• Time in Patent Office: 704 Days
• Field of Search: None
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 15/005 General purpose rendering architectures

Abstract

The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor. The graphics processing units on the server digital data processor simultaneously process image data in response to interleaved commands from (i) the render server module on behalf of the first client digital data processor, and (ii) one or more requests from (a) the render server module on behalf of any of the other client digital data processors, and (b) other functionality on the server digital data processor.

Claims

1. A system for rendering images comprising:

A. a first client digital data processor and a second client digital data processor;

B. a server digital data processor in communications coupling with the first client digital data processor and the second client digital data processor, the server digital data processor comprising a graphics processing unit;

C. a render server, executing on the server digital data processor and in communications coupling with the graphics processing unit, the render server responding to a first render request to render a first image from the first client digital data processor by issuing one or more render commands to the graphics processing unit to generate a first rendered image;

D. the render server transferring the first rendered image to the first client digital data processor, where the first rendered image is stored in memory attached to the render server;

E. the render server responding to a second render request from the second client digital data processor to render a second image by issuing one or more render commands to the graphics processing unit;

F. the render server responding to a third render request to render a third image from the first client digital data processor, where the render server breaks down the third render request into a first partial render request and a second partial render request, where the first partial render request corresponds to a portion of a third rendered image that has been rendered in the first rendered image, where a second partial render request corresponds to a portion of the third rendered image that has not been rendered in the first rendered image, where the render server uses the stored first rendered image to generate the first partial render request;

G. the render server issuing two or more interleaved render commands to the graphics processing unit so that commands corresponding to the second render request and the second partial render request are processed by the graphics processing unit in an alternating fashion to generate a second rendered image and a second partial rendered image;

H. the render server transferring the second rendered image to the second client digital data processor;

I. the render server generating a third rendered image based on the stored first rendered image and the second partial render request; and

J. the render server transferring the third rendered image to the first client digital data processor.

2. The system of claim 1, where the second rendered image is stored in memory attached to the render server.

3. The system of claim 1, where the second partial rendered image is stored in memory attached to the render server.

4. The system of claim 1, where the third rendered image is stored in memory attached to the render server.

5. The system of claim 1, the server digital data processor further comprising two or more graphics processing units.

6. A system for rendering images comprising:

A. a first client digital data processor, a second client digital data processor, and a third client digital data processor;

B. a server digital data processor in communications coupling with the first client digital data processor, the second client digital data processor, and the third client digital data processor, the server digital data processor comprising a graphics processing unit;

C. a render server, executing on the server digital data processor and in communications coupling with the graphics processing unit, the render server responding to a first render request to render a first image from the first client digital data processor at a time t, by issuing one or more render commands to the graphics processing unit to generate a first rendered image;

D. the render server responding to a second render request to render a second image from the second client digital data processor at a time t+d1, where the render server breaks down the second render request into a first partial render request and a second partial render request;

E. the render server issuing one or more render commands to the graphics processing unit to render the first partial render request to generate a first partial rendered image;

F. the render server issues the one or more render commands in step E before completing the one or more render commands in step C;

G. the render server transferring the first rendered image to the first client digital data processor;

H. the render server responding to a third render request to render a third image from the third client digital data processor at a time t+d2 by issuing one or more render commands to the graphics processing unit to generate a third rendered image, where d2>

d1;

I. the render server issues the one or more render commands generated in step H before completing the one or more render commands in step E;

J. the render server issuing one or more render commands to the graphics processing unit to generate a second partial rendered image;

K. the render server issues the one or more render commands in step J before completing the one or more render commands in step H;

L. the render server transferring the third rendered image to the third client digital data processor;

M. the render server generating a second rendered image from the first partial rendered image and the second partial rendered image; and

N. the render server transferring the second rendered image to the second client digital data processor.

7. The system of claim 6, where the first rendered image is stored in memory attached to the render server.

8. The system of claim 6, where the first partial rendered image is stored in memory attached to the render server.

9. The system of claim 6, where the third rendered image is stored in memory attached to the render server.

10. The system of claim 6, where the second rendered image is stored in memory attached to the render server.

11. The system of claim 6, the server digital data processor further comprising two or more graphics processing units.

12. The system of claim 6, further comprising the render server responding to a fourth render request from the first client digital data processor at a time t+d3 by issuing one or more render commands to generate a fourth rendered image to the graphics processing unit, where d3>

d2.

13. The system of claim 12, further comprising the render server issuing the one or more render commands to generate a fourth rendered image before completing the one or more render commands in step J.

14. The system of claim 13, further comprising the render server transferring the to the first client digital data processor.

15. The system of claim 12, further comprising the render server responding to a fifth render request from the second client digital data processor at a time t+d4 by issuing one or more render commands to generate a fifth rendered image to the graphics processing unit, where d4>

d3.

16. The system of claim 15, further comprising the render server issuing the one or more render commands to generate the fifth rendered image before completing the one or more render commands in claim 12.

17. The system of claim 16, further comprising the render server transferring the fifth rendered image to the second client digital data processor.

18. The system of claim 6, where the render server prioritizes a render request based on at least one of a rendering mode associated with that render request, a client digital data processor associated with that render request, an order of receipt of that render request, and available resources.

19. The system of claim 6, where the graphics processing unit renders an image at a rendering resolution determined by one or more parameters, including, at least one of a user interaction type, a network speed, and available processing resources.