Encoding for remoting graphics to decoder device

• US 7,453,465 B2
• Filed: 10/27/2004
• Issued: 11/18/2008
• Est. Priority Date: 10/14/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Parsons, John E., Schmieder, Wilhelm R., Chik, Joy, Ben-Shachar, Ido
• Primary Examiner(s): Nguyen; Van H
• Application Number:
  US10/974,092
• Publication Number:
  US 20060082582A1
• Time in Patent Office: 1,483 Days
• Field of Search: 719/310, 719/323, 719/328, 719/320, 719/321, 719/322, 719/327, 719/230, 719/231, 709/230, 345/441, 345/506, 345/519, 345/522, 345/650, 345/418, 345/501
• US Class Current: 345/501
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1438 using more than one graphics controller
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain

Abstract

A portable graphics encoder connects with one or more protocol decoder devices based on a particular communication protocol. The portable graphics encoder is not specific to any particular operating system. The portable graphics encoder receives protocol decoder device commands such as input instructions that determine higher-level graphics commands that are sent to the one or more protocol decoder devices. The higher-level graphics commands are extracted from graphics sources such as application programs. The portable graphics encoder encodes the higher-level graphics commands according to a format defined by the communication protocol, and the encoded higher-level graphics commands are sent to the one or more protocol decoder devices.

Claims

1. A method of communicating between an application program and one or more protocol decoder devices comprising the steps of:

connecting a graphic encoder with the one or more protocol decoder devices through a communication protocol;

informing the application program to begin sending higher-level graphics commands from the application program to the graphic encoder;

sending the higher-level graphics commands from the application program to the graphic encoder;

using an application program interface (API) to provide information to and access the higher-level graphics commands from the application program, wherein the high level graphic commands from the application program are used to generate and display graphic to a local display device, and the higher-level graphics commands are particularly used by a local graphics driver to generate graphics displayed on the local display device;

extracting the higher-level graphic commands using a screen scraping engine and a protocol encoder, wherein the screen scraping engine and protocol encoder encode the higher-level graphics commands into a format as defined by the communication protocol;

receiving input commands from the one or more protocol decoder devices, wherein the input commands represents an action or instruction to be performed on the application program from which higher-level graphic commands are received; and

sending the higher-level graphics commands to the protocol decoder devices, wherein the higher-level graphics commands are formatted to support the communication protocol and sent through a stream-oriented connection by protocol compliant state machine(s) supporting each of the protocol decoder devices.

2. The method of claim 1 wherein the step of connecting is performed by protocol state machines dedicated to each of the one or more protocol decoder devices.

3. The method of claim 1 wherein the step of sending higher-level graphics commands includes protocol data units (PDU).

4. The method of claim 1 further comprising the step of encoding the higher-level graphics commands based on the communication protocol prior to the step of sending.

5. The method of claim 1 further comprising the step of decoding the input commands based on the communication protocol after the step of receiving.

6. The method of claim 1 further comprising the step of translating the input commands based on a particular operating system.

7. The method of claim 1 further comprising the step of authorizing the one or more protocol decoder devices.

8. In a server computer, a computer-readable storage medium having instructions that, when executed on the server computer, performs acts comprising:

connecting a graphics encoder with the one or more protocol decoder devices through a communication protocol;

informing the application program to begin sending higher-level graphics commands from the application program to the graphics encoder;

sending the higher-level graphics commands from the application program to the graphics encoder;

using an application program interface (API) to provide information to and access the higher-level graphics commands from the application program, wherein the high level graphics commands from the application program are used to generate and display graphics to a local display device, and the higher-level graphics commands are particularly used by a local graphics driver to generate graphics displayed on the local display device;

extracting the higher-level graphics commands using a screen scraping engine and a protocol encoder, wherein the screen scraping engine and protocol encoder encode the higher-level graphics commands into a format as defined by the communication protocol

receiving input commands from the one or more protocol decoder devices, wherein the input commands represent an action or instruction to be performed on the application program from which higher-level graphics commands are received; and

sending the higher-level graphics commands to the protocol decoder devices, wherein the higher-level graphics commands are formatted to support the communication protocol and sent through a stream-oriented connection by protocol compliant state machine(s) supporting each of the protocol decoder devices.

9. The computer-readable storage medium as recited in claim 8 wherein the accessing is through an application program interface.

10. The computer-readable storage medium as recited in claim 8 wherein the communicating is performed separate and independent with each of the one or more client computers.

11. The computer-readable storage medium as recited in claim 10 further comprising negotiating with each of the one or more client computers as to compression, encryption, and encoding of the higher-level graphics commands.

12. The computer-readable storage medium as recited in claim 8 further comprising receiving input commands from the one or more client computers.