Multi-user/multi-GPU render server apparatus and methods

• US 9,728,165 B1
• Filed: 03/06/2015
• Issued: 08/08/2017
• Est. Priority Date: 11/23/2007
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Ma, Tize
• Application Number:
  US14/641,248
• Time in Patent Office: 886 Days
• Field of Search: None
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2210/52 Parallel processing
• CPC Class Codes: G09G 2360/06 Use of more than one graphics processor to process data before displaying to one or more screens
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: H04L 51/00 User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet

Abstract

The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor. The graphics processing units on the server digital data processor simultaneously process image data in response to interleaved commands from (i) the render server module on behalf of the first client digital data processor, and (ii) one or more requests from (a) the render server module on behalf of any of the other client digital data processors, and (b) other functionality on the server digital data processor.

Claims

1. A system for rendering images comprising:

A. one or more client digital data processors;

B. a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor comprising one or more graphics processing units;

C. a render server, executing on the server digital data processor and in communications coupling with the graphics processing units, the render server responding to a render request from the client digital data processor by issuing one or more render commands to the one or graphics processing units;

D. the render server responding to render requests from a plurality of the client digital data processors by issuing one or more interleaved render commands to the one or more graphics processing units so that commands corresponding to different respective render requests are processed by the one or more graphics processing units in an alternating fashion; and

E. the render server breaking down one or more render requests received from one or more client digital data processors into multiple smaller render requests each requiring one or both less compute time and less graphics resources than the render request from which it was broken down in response to determining that graphics resources required for processing the one or more render requests exceed graphics resources associated with the graphics processing unit, where at least one of the one or more graphics processing units concurrently renders images in response to the one or more interleaved render commands requests if the render server determines that graphics resources required for processing the one or more render requests do exceed graphics resources associated with the graphics processing unit.

2. The system of claim 1, where the server digital data processor further comprises one or more central processing units, in communications coupling with the render server, the one or more central processing units processing image data in response to plural interleaved commands from the render server.

3. The system of claim 1, where the server digital data processor comprises a host memory, in communications coupling with the render server, the host memory storing one or more data sets to be rendered.

4. The system of claim 1, where the server digital data processor comprises one or more queues in communications coupling with the render server and with the one or more graphics processing units, and the render server maintaining render requests in the one or more queues.

5. The system of claim 4, where the render server prioritizes render requests in the one or more queues.

6. The system of claim 5, where the render server prioritizes the render request based on at least one of a rendering mode associated with that render request, a client digital data processor associated with that render request, an order of receipt of that render request, and available resources.

7. The system of claim 4, where the render server breaks down the render request in the queue into plural smaller render requests.

8. The system of claim 1, where the render server schedules one or more of the smaller requests to minimize an average wait time.

9. The system of claim 1, where the graphics processing unit renders an image at a rendering resolution determined by one or more parameters, including, at least one of a user interaction type, a network speed, and available processing resources.

10. The system of claim 9, where the render server monitors at least one of user interaction type, network speed, and available processing resources, and generates the one or more parameters in response thereto.

11. The system of claim 1, where the render server allocates at least a portion of one or more server digital data processor resources in response to one of the render requests.

12. The system of claim 11, where the one or more server digital data processor resources comprise a graphics memory that is coupled to any of the one or more graphics processing units.

13. The system of claim 12, where the render server allocates, as the digital data processor resource, the graphics memory having a data set specified by the request.

14. The system of claim 13, where the render server causes the graphics memory to maintain the data set.

15. The system of claim 1, where each of the one or more interleaved render commands associated with a different request use multi-processing on at least one graphics processing unit.

16. The system of claim 1, where each of the one or more interleaved render commands associated with a different request use multi-threading on at least one graphics processing unit.

17. The system of claim 1, where the render server responding to one or more render requests from the client digital data processors by determining if one or more data sets to be rendered are rotated, the one or more graphics processing units render images at a first resolution if the one or more data sets have been rotated, the one or more graphics processing units render images at a second resolution different from the first resolution if the one or more data sets have not been rotated.

18. A system for rendering images comprising:

A. one or more client digital data processors;

B. a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor comprising one or more graphics processing units;

C. a render server, executing on the server digital data processor and in communications coupling with the graphics processing units, the render server responding to a render request from the client digital data processor by issuing one or more render commands to the one or graphics processing units;

D. the render server responding to render requests from a plurality of the client digital data processors by issuing interleaved render commands to the one or more graphics processing units so that commands corresponding to different respective render requests are processed by the one or more graphics processing units in an alternating fashion; and

E. the render server responding to render requests from a plurality of the client digital data processors by determining if graphics resources required for processing the render requests exceed graphics resources associated with the graphics processing unit, the render server breaking down render requests received from the one or more client digital data processors into multiple smaller render requests if the graphics resources required for processing the render requests exceed the graphics resources associated with the graphics processing unit, each smaller render request requiring less compute time and/or less graphics resources than the render request from which it was broken down, where the graphics processing unit concurrently renders images in response to one or more interleaved render commands if the graphics resources required for processing the render requests do not exceed the graphics resources associated with the graphics processing unit, where at least one of the one or more graphics processing units concurrently renders images in response to the one or more interleaved render commands requests if the render server determines that graphics resources required for processing the one or more render requests do exceed graphics resources associated with the graphics processing unit.

19. The system of claim 18, where the render server breaks down render requests so that the amount of memory required for concurrent rendering of the smaller render requests generated as a result thereof is less than or equal to the amount of memory available on the graphics processing unit.

20. A method for rendering images comprising:

A. executing, on a server digital data processor;

a render server;

B. issuing one or more interleaved commands with the render server in response to one or more render requests from one or more client digital data processors;

C. rendering images with one or more graphics processing units in response to the interleaved commands from the render server on behalf of the one or more client digital data processors;

D. the rendering images includes the graphics processing unit concurrently rendering images in response to the interleaved render commands if the render server determines that graphics resources required for processing the one or more render requests do not exceed graphics resources associated with the graphics processing unit; and

E. the rendering images includes the render server breaking down render requests received from one or more client digital data processors into multiple smaller render requests if the render server determines that graphics resources required for processing the one or more render requests do not exceed graphics resources associated with the graphics processing unit, each smaller render request requiring less compute time and/or less graphics resources than the render request from which it was broken down, where at least one of the one or more graphics processing units concurrently renders images in response to the one or more interleaved render commands requests if the render server determines that graphics resources required for processing the one or more render requests do exceed graphics resources associated with the graphics processing unit.

21. The method of claim 20, comprising storing one or more data sets in a host memory associated with the server digital data processor.

22. The method of claim 20, comprising maintaining requests received from one or more the client digital data processors in one or more queues associated with the server digital data processor, such maintaining including any of prioritizing the requests, removing requests, and/or breaking down one or more requests into two or more smaller requests.

23. The method of claim 22, where the prioritizing step includes any of prioritizing the render request based on at least one of a rendering mode associated therewith, a client associated therewith, an order of receipt thereof, and available resources.

24. The method of claim 22, where the rendering step comprises rendering images, with the one or more graphics processing units, in response to interleaved commands that are based on the multiple smaller render requests.

25. The method of claim 24, comprising processing, with the one or more graphics processing units, multiple interleaved commands, each based on smaller requests broken down from the render request received from the one or more client digital data processors, before completing rendering of an image associated with any such received request.

26. The method of claim 20, comprising scheduling one or more of the smaller requests to minimize an average wait time.

27. The method of claim 20, comprising rendering with the graphics processing unit an image at a rendering resolution determined by one or more parameters, including, at least one of a user interaction type, a network speed, and available processing resources.

28. The method of claim 20, comprising allocating at least a portion of one or more server digital data processor resources in response to one or more requests received from the client digital data processor.

29. The method of claim 28, comprising allocating, as the server digital data processor resource, a graphics memory that is coupled to any of the one or more graphics processing units.