Multi-user multi-GPU render server apparatus and methods

• US 9,904,969 B1
• Filed: 03/15/2013
• Issued: 02/27/2018
• Est. Priority Date: 11/23/2007
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Ma, Tize
• Application Number:
  US13/831,967
• Time in Patent Office: 1,810 Days
• Field of Search: None
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2210/52 Parallel processing
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/06 Use of more than one graphics processor to process data before displaying to one or more screens
• CPC Class Codes: G09G 2380/08 Biomedical applications
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: H04L 12/413 with random access, e.g. carrier-sense multiple-access with collision detection [CSMA-CD]
• CPC Class Codes: H04L 12/4625 Single bridge functionality, e.g. connection of two networks over a single bridge
• CPC Class Codes: H04L 51/00 User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet

Abstract

The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor. The graphics processing units on the server digital data processor simultaneously process image data in response to interleaved commands from (i) the render server module on behalf of the first client digital data processor, and (ii) one or more requests from (a) the render server module on behalf of any of the other client digital data processors, and (b) other functionality on the server digital data processor.

Claims

1. A method for rendering images comprising:

A) executing a render server program on a server digital data processor;

B) responding to a first render request of a first data volume corresponding to a first digital image View from a client digital data processor in communication with the server digital data processor by breaking down the first data volume into two or more first sub-volumes;

C) executing two or more first render commands to render independently the two or more first sub-volumes;

D) sending in response to the first render request two or more first data sets corresponding to the two or more first sub-volumes to one or more graphics units on behalf of the client digital data processor, where the two or more first sub-volumes are rendered by the one or more graphics units on behalf of the client digital data processor;

E) storing in a first server side cache the rendered two or more first sub-volumes of step (D) at a first resolution;

F) sending the first digital image View to the client digital data processor;

G) responding to a second render request of a second data volume corresponding to a second digital image View from the client digital data processor in communication with the server digital data processor by breaking down the second data volume into two or more second sub-volumes;

H) sending in response to the second render request one or more second data sets corresponding to one or more second sub-volumes of the two or more second sub-volumes to one or more graphics units on behalf of the client digital data processor, where one of the two or more second sub-volumes corresponds with a first sub-volume of the first digital image View stored in the first server side cache at the first resolution, where the first sub-volume of the first digital image View is reused as the one of the two or more second sub-volumes;

I) executing one or more second render commands to render the one or more second sub-volumes; and

J) sending to the client digital data processor the rendered one or more second sub-volumes of step (I) in response to the second render request to modify the first digital image View and generate the second digital image View.

2. The method of claim 1, where the first resolution is selected from a plurality of resolution levels.

3. The method of claim 2, where the second digital image View is rendered at a second resolution selected from the plurality of resolution levels, where the first resolution is higher than the second resolution.

4. The method of claim 1, where the second digital image View is a rotation of the first digital image View.

5. The method of claim 1, where the first digital image View stored in the first server side cache is sufficient to construct a higher resolution level than shown in the first digital image View.

6. The method of claim 1, where the first digital image View stored in the first server side cache is sufficient to construct a higher resolution level than shown in the second digital image View.

7. The method of claim 1, where breaking down the first data volume into two or more sub-volumes improves efficiency of rendering images.

8. The method of claim 1, where reusing the first sub-volume of the first digital image View as the one of the two or more second sub-volumes in step (H) improves efficiency of rendering images.

9. A method for rendering images comprising:

A) executing a render server program on a server digital data processor;

B) responding to a first render request of a first data volume corresponding to a first View from a client digital data processor in communication with the server digital data processor by breaking down the first data volume into two or more first sub-volumes;

C) executing two or more first render commands to render independently the two or more first sub-volumes;

D) sending in response to the first render request two or more first data sets corresponding to the two or more first sub-volumes to one or more graphics units on behalf of the client digital data processor where the two or more first sub-volumes are rendered by the one or more graphics units on behalf of the client digital data processor;

E) storing in a first server side cache the rendered two or more first sub-volumes corresponding to the first View at a first resolution;

F) sending the first View to the client digital data processor;

G) responding to a second render request of a second data volume corresponding to a second View from the client digital data processor in communication with the server digital data processor by breaking down the second data volume into two or more second sub-volumes;

H) sending in response to the second render request one or more second data sets corresponding to one or more second sub-volumes of the two or more second sub-volumes to one or more graphics units on behalf of the client digital data processor, where one of the two or more second sub-volumes corresponds with a first sub-volume of the first View stored in the first server side cache at the first resolution, where the first sub-volume of the first View is reused as the one of the two or more second sub-volumes;

I) executing one or more second render commands to render the one or more second sub-volumes not rendered in the first View; and

J) sending to the client digital data processor the rendered one or more second sub-volumes of step (I) in response to the second render request to modify the first View and generate the second View.

10. The method of claim 9, where the first resolution is selected from a plurality of resolution levels.

11. The method of claim 10, where the second View is rendered at a second resolution selected from the plurality of resolution levels, where the first resolution is higher than the second resolution.

12. The method of claim 9, where the first View is sent to the client digital data processor at a lower resolution than the first resolution.

13. The method of claim 9, where the second View is a rotation of the first View.

14. The method of claim 9, where the second View is sent with full resolution when the mouse is released.

15. A system for rendering images comprising:

one or more client digital data processors;

a render server, executing on a server digital data processor, the render server responding to a first render request of a first data volume corresponding to a first View from the one or more client digital data processors by breaking down the first data volume into two or more first sub-volumes, executing two or more first render commands to render independently the two or more first sub-volumes, where the render server responds to the first render requests by sending to the client digital data processor two or more first data sets corresponding to the two or more first sub-volumes to one or more graphics units corresponding to the first View at a first resolution which is stored in a server side cache;

the render server responding to a second render request of a second data volume corresponding to a second View by breaking down the second data volume into two or more second sub-volumes, sending in response to the second render request one or more second data sets corresponding to one or more second sub-volumes of the two or more second sub-volumes to one or more graphics units on behalf of the one or more client digital data processor, where one of the two or more second sub-volumes corresponds with a first sub-volume of the first View stored in a first server side cache at the first resolution, where the first sub-volume of the first View is reused as the one of the two or more second sub-volumes; and

the render server executing one or more second render commands to render the one or more second sub-volumes not rendered in the first View, calculating and sending to the one or more client digital data processor the rendered one or more second sub-volumes in response to the second render request to modify the first View and generate the second View.

16. The system of claim 15, where the second View is constructed from the first sub-volume of the first View corresponding to the one of the two or more second sub-volumes stored in the server side cache.