RENDER-ASSISTED COMPRESSION FOR REMOTE GRAPHICS

• US 20140028679A1
• Filed: 12/26/2012
• Published: 01/30/2014
• Est. Priority Date: 07/30/2012
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Luebke, David, Pajak, Dawid Stanislaw, Saulters, Scott
• Application Number:
  US13/727,265
• Publication Number:
  US 20140028679A1
• Time in Patent Office: Days
• US Class Current: 345/428
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 9/004 Predictors, e.g. intraframe, interframe coding
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A technique for efficiently compressing rendered three-dimensional images in a remote rendering system adds a novel render-assisted prediction function to an existing video compression framework, such as the standard H.264/5 framework. Auxiliary rendering information is separated from rendering information used to describe a reference image by a server system. A client system may alter the auxiliary data and generate a new image based on the reference image and rendered scene information from the auxiliary data without creating additional network bandwidth or server workload.

Claims

1. A method for displaying data received from a server machine, the method comprising:

receiving compressed client data transmitted from the server machine;

decompressing the compressed client data to generate either reference image data and client auxiliary image data or reference image data and auxiliary data; and

rendering a high-quality image for display based on the reference image data, the client auxiliary image data or the reference image data, the auxiliary data, and client auxiliary data.

2. The method of claim 1, further comprising generating the client auxiliary data.

3. The method of claim 2, wherein the client auxiliary data is based on a change in camera position between two display frames.

4. The method of claim 2, wherein the client auxiliary data is configured to modify the auxiliary data received from the server machine.

5. The method of claim 4, wherein client auxiliary data includes updated values for one or more parameters included in the auxiliary data.

6. The method of claim 5, wherein the one or more parameters comprise elements associated with a transform matrix.

7. The method of claim 6, wherein the transform matrix is associated with an image warping operation.

8. The method of claim 1, wherein rendering the high-quality image comprises augmenting the reference image data with overlay image data produced from the auxiliary data.

9. The method of claim 1, wherein rendering the high-quality image comprises blending the reference image data with the client auxiliary image data.

10-20. -20. (canceled)

21. A client system, comprising:

a rendering subsystem configured to;

receive compressed client data transmitted from the server machine;

decompress the compressed client data to generate either reference image data and client auxiliary image data or reference image data and auxiliary data; and

render a high-quality image for display based on the reference image data, the client auxiliary image data or the reference image data, the auxiliary data, and client auxiliary data.

22. The client system of claim 21, wherein the rendering subsystem is further configured to generate the client auxiliary data.

23. The client system of claim 22, wherein the client auxiliary data is based on a change in camera position between two display frames.

24. The client system of claim 22, wherein the client auxiliary data is configured to modify the auxiliary data received from the server machine.

25. The client system of claim 24, wherein client auxiliary data includes updated values for one or more parameters included in the auxiliary data.

26. The client system of claim 25, wherein the one or more parameters comprise elements associated with a transform matrix.

27. The client system of claim 26, wherein the transform matrix is associated with an image warping operation.

28. The client system of claim 21, wherein the rendering subsystem is configured to render the high-quality image by augmenting the reference image data with overlay image data produced from the auxiliary data.

29. The client system of claim 21, wherein the rendering subsystem is configured to render the high-quality image by blending the reference image data with the client auxiliary image data.

30. The client subsystem of claim 21, wherein the rendering subsystem includes:

a decompression module configured to decompress the compressed client data to generate either the reference image data and the client auxiliary image data or the reference image data and the auxiliary data; and

a rendering module configured to render the high-quality image for display based on the reference image data, the client auxiliary image data or the reference image data, the auxiliary data, and the client auxiliary data.

31. A computing device, comprising:

a memory configured to store a client application; and

a rendering subsystem coupled to the memory and configured to;

receive compressed client data transmitted from the server machine;

decompress the compressed client data to generate either reference image data and client auxiliary image data or reference image data and auxiliary data; and

render a high-quality image for display based on the reference image data, the client auxiliary image data or the reference image data, the auxiliary data, and client auxiliary data.