Applying different transport mechanisms for user interface and image portions of a remotely rendered image

• US 8,924,473 B2
• Filed: 09/14/2012
• Issued: 12/30/2014
• Est. Priority Date: 04/30/2003
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Silicon Graphics International Corporation (Hewlett-Packard Enterprise Company)
• Inventors: Chalfin, Alexander, Kaulgud, Alpana, Peercy, Mark
• Primary Examiner(s): BILGRAMI, ASGHAR H
• Application Number:
  US13/620,223
• Publication Number:
  US 20130169650A1
• Time in Patent Office: 837 Days
• Field of Search: 709/203, 345/422, 345/427, 718/104
• US Class Current: 709/203
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/165 Combined use of TCP and UDP protocols; selection criteria therefor

Abstract

A system and method for remote rendering of computer graphics wherein user transactions are reliable and the transmission of rendered graphics is relatively fast. The invention is implemented in a client server context, where a computer graphics application and rendering resources are located at a server. A user controls the graphics application through a client machine connected to the server through a computer network. The user'"'"'s commands are sent from the client to the server, while rendered computer graphics are transmitted from the server to a display at the client. Different transport protocols are used, depending on the requirements of a particular transmission. Data related to user interactions is transmitted using a relatively reliable transport protocol, such as TCP. Rendered subject graphics data is transmitted from the server to the client using a less reliable but faster transport protocol, such UDP.

Claims

1. A system for remote rendering of graphics data, the system comprising:

a server communicatively coupled to a remote client, the server including;

a plurality of rendering pipelines, wherein a first rendering pipeline of the plurality of rendering pipelines renders graphical user interface (GUI) graphics data, and a second rendering pipeline of the plurality of rendering pipelines renders subject graphics data, wherein the server receives a rendering command from the client, transmits the rendered subject graphics data using an unreliable transport protocol, and transmits the rendered graphical user interface (GUI) graphics data using a reliable transport protocol data to the client.

2. The system of claim 1, wherein the rendering command is communicated using a reliable transport protocol.

3. The system of claim 1, wherein the reliable transport protocol used to receive the rendering command is a TCP transport protocol.

4. The system of claim 1, wherein the reliable transport protocol used to transmit the graphical user interface (GUI) graphics data is TCP.

5. The system of claim 1, wherein the unreliable transport protocol is a UDP transport protocol.

16. The system of claim 1, further comprising:

a graphics processor;

a texture memory; and

a frame buffer, wherein the graphics processor obtains samples of at least one of a texture and an image stored in the texture memory when rendering the graphical user interface (GUI) graphics data and the subject graphics data, and wherein the graphics processor stores output from the graphics processor in the frame buffer.

6. A non-transitory computer-readable storage medium having embodied thereon a program executable by a processor to perform a method for rendering graphics data, the method comprising:

receiving a rendering command from a client;

rendering graphical user interface (GUI) graphics data in a first rendering pipeline;

rendering subject graphics data in a second rendering pipeline;

transmitting the rendered graphical user interface (GUI) graphics data using a reliable transport protocol; and

transmitting the rendered subject graphics data using an unreliable transport protocol.

7. The computer-readable storage medium of claim 6, wherein the rendering command is received using a reliable transport protocol.

8. The computer-readable storage medium of claim 7, wherein the reliable transport protocol used to receive the rendering command is a TCP transport protocol.

9. The computer-readable storage medium of claim 6, wherein the reliable transport protocol used to transmit the graphical user interface (GUI) graphics data is TCP.

10. The computer-readable storage medium of claim 6, wherein the unreliable transport protocol is a UDP transport protocol.

17. The non-transitory computer-readable storage medium of claim 6, the program further executable to obtain at least one of a texture and an image when rendering the graphical user interface (GUI) graphics data, and when rendering the subject graphics data.

11. A method for remote rendering of graphics data, comprising:

receiving a rendering command from a client;

rendering graphical user interface (GUI) graphics data in a first rendering pipeline;

rendering subject graphics data in a second rendering pipeline;

transmitting the rendered graphical user interface (GUI) graphics data using a reliable transport protocol; and

transmitting the rendered subject graphics data using an unreliable transport protocol.

12. The method of claim 11, wherein the rendering command is received using a reliable transport protocol.

13. The method of claim 12, wherein the reliable transport protocol used to receive the rendering command is a TCP transport protocol.

14. The method of claim 11, wherein the reliable transport protocol used to transmit the graphical user interface (GUI) graphics data is TCP.

15. The method of claim 11, wherein the unreliable transport protocol is a UDP transport protocol.

18. The method of claim 11, further comprising obtaining at least one of a texture and an image when rendering the graphical user interface (GUI) graphics data, and when rendering the subject graphics data.