System, method and computer program product for remote graphics processing

• US 9,665,923 B2
• Filed: 01/04/2016
• Issued: 05/30/2017
• Est. Priority Date: 07/31/2000
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Silicon Graphics International Corporation (Hewlett-Packard Enterprise Company)
• Inventors: Keslin, Phillip C.
• Primary Examiner(s): CRADDOCK, ROBERT J
• Application Number:
  US14/987,690
• Publication Number:
  US 20160239938A1
• Time in Patent Office: 512 Days
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: G09G 5/36 characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A system, method, and computer program product are provided for remote rendering of computer graphics. The system includes a graphics application program resident at a remote server. The graphics application is invoked by a user or process located at a client. The invoked graphics application proceeds to issue graphics instructions. The graphics instructions are received by a remote rendering control system. Given that the client and server differ with respect to graphics context and image processing capability, the remote rendering control system modifies the graphics instructions in order to accommodate these differences. The modified graphics instructions are sent to graphics rendering resources, which produce one or more rendered images. Data representing the rendered images is written to one or more frame buffers. The remote rendering control system then reads this image data from the frame buffers. The image data is transmitted to the client for display or processing. In an embodiment of the system, the image data is compressed before being transmitted to the client. In such an embodiment, the steps of rendering, compression, and transmission can be performed asynchronously in a pipelined manner.

Claims

1. A method for processing graphics, the method comprising:

sending information over a network interface to a server, the information identifying a graphics capability of a client;

sending a graphics command over a network interface to a server, wherein the server;

merges the graphics capability of the client with one or more graphics capabilities of the server into a list of graphics capabilities,

receives the graphics command,

updates image data at the server according to the graphics command and according to at least one capability of the one or more graphics capabilities in the list of graphics capabilities,

renders client image data for transmission to the client from the updated image data according to the identified graphics capability of the client in the list of graphics capabilities, and

transmits the rendered image for display at the client;

receiving the client image data; and

displaying the client image data on a display at the client.

2. The method of claim 1, further comprising sending over the network interface a list of one or more compression algorithms that are supported by the client.

3. The method of claim 1, further comprising:

sending over the network interface a list of one or more compression algorithms that are supported by the client;

receiving over the network interface a list of one or more compression algorithms that are supported by the server; and

sending over the network interface a selection of a preferred compression algorithm.

4. The method of claim 1, wherein the client identifies a preferred compression algorithm.

5. The method of claim 1, wherein the information is sent according to a protocol established during initial communications between the client and the server.

6. The method of claim 1, wherein the identified graphics capability corresponds to an opacity of a graphic.

7. The method of claim 1, wherein the identified graphics capability corresponds to a mapping range of bits.

8. The method of claim 7, wherein the mapping range of bits corresponds to at least one of 24 bits and 48 bits.

9. The method of claim 7, wherein the mapping range of bits corresponds to a number of bits used to represent a color.

10. A non-transitory computer readable storage medium having embodied thereon a program executable by a processor for performing a method for processing graphics, the method comprising:

sending information to a server, the information identifying a graphics capability of a client;

sending a graphics command to a server, wherein the server;

merges the graphics capability of the client with one or more graphics capabilities of the server into a list of graphics capabilities,

receives the graphics command,

updates image data at the server according to the graphics command and according to at least one capability of the one or more graphics capabilities in the list of graphics capabilities,

renders client image data for transmission to the client from the updated image data according to the identified graphics capability of the client in the list of graphics capabilities, and

transmits the rendered image for display at the client;

receiving the client image data; and

displaying the client image data on a display at the client.

11. The non-transitory computer readable storage medium of claim 10, the program further executable to send a list of one or more compression algorithms that are supported by the client.

12. The non-transitory computer readable storage medium of claim 10, the program further executable to:

send a list of one or more compression algorithms that are supported by the client;

receive a list of one or more compression algorithms that are supported by the server; and

send a selection of a preferred compression algorithm.

13. The non-transitory computer readable storage medium of claim 10, wherein the client identifies a preferred compression algorithm.

14. The non-transitory computer readable storage medium of claim 10, wherein the information is sent according to a protocol established during initial communications between the client and the server.

15. The non-transitory computer readable storage medium of claim 10, wherein the identified graphics capability corresponds to an opacity of a graphic.

16. The non-transitory computer readable storage medium of claim 10, wherein the identified graphics capability corresponds to a mapping range of bits.

17. The non-transitory computer readable storage medium of claim 16, wherein the mapping range of bits corresponds to at least one of 24 bits and 48 bits.

18. The non-transitory computer readable storage medium of claim 16, wherein the mapping range of bits corresponds to a number of bits used to represent a color.

19. An apparatus for processing graphics, the apparatus comprising:

a network interface that;

sends information over a network interface to a server, the information identifying a graphics capability of a client;

sending a graphics command over a network interface to a server, wherein the server;

merges the graphics capability of the client with one or more graphics capabilities of the server into a list of graphics capabilities,

receives the graphics command,

updates image data at the server according to the graphics command and according to at least one capability of the one or more graphics capabilities in the list of graphics capabilities,

renders client image data for transmission to the client from the updated image data according to the identified graphics capability of the client in the list of graphics capabilities, and

transmits the rendered image for display at the client;

receives the client image data;

a memory;

a processor executing instructions out of the memory; and

a display that displays the client image data.

20. The apparatus of claim 19, wherein a list of one or more compression algorithms that are supported by the client are sent over the network interface.