Remote user interface raster segment motion detection and encoding

• US 8,358,879 B2
• Filed: 12/13/2011
• Issued: 01/22/2013
• Est. Priority Date: 10/12/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: McDowell, Brian
• Primary Examiner(s): MARIAM, DANIEL G
• Application Number:
  US13/324,909
• Publication Number:
  US 20120105463A1
• Time in Patent Office: 406 Days
• Field of Search: 382/107, 382/181, 382/218, 382/236, 382/305, 382/307, 345/522, 375/240.16, 709/203, 715/724, 715/744, 715/748
• US Class Current: 382/305
• CPC Class Codes: G06F 15/177 Initialisation or configuration control processor initialisation G06F9/4405
• CPC Class Codes: G06T 7/254 involving subtraction of images

Abstract

Raster segment commands are generated by a delta encoder and are encoded for raster segments detected to have moved in the current frame with respect to a location of the raster segment in a previous frame. Raster segment motion commands are stored in a queue and, when written, copy a raster segment into the current frame from a previous payload or cache. When written from the queue to a payload, raster segment motion commands are applied to a copy of the current frame maintained at the server using a copy of the previous payload sent. When copying a raster segment from a raster segment cache, a raster segment cache command retrieves identified raster segment data from the raster segment cache and copies the raster segment into a particular location in the current frame at the client. The raster segment commands are sent to a client via a payload to copy a raster segment from a previous payload into the current frame at the client or from a raster segment cache to the current frame.

Claims

1. A method, comprising:

receiving a payload having one or more commands by a client from a server;

parsing the payload commands by the client;

selecting, by the client, a raster segment contained in a previous payload and identified by a first parsed payload command; and

copying the selected raster segment into a current frame at the client at a location specified in the first parsed payload command.

2. The method of claim 1, further comprising:

accessing a cached raster segment identified in a second parsed payload command from a raster segment cache at the client;

modifying a relevance value for the cached raster segment; and

copying the selected cached raster segment into the current frame at the client at a second location specified in the second parsed payload command.

3. The method of claim 1, further comprising:

removing a cached raster segment identified in a third parsed payload command from the raster segment cache at the client;

adding a cached raster segment identified in a fourth parsed payload command from the raster segment cache at the client;

setting a relevance value for the added cached raster segment; and

copying the added cached raster segment into the current frame at the client at a third location specified in the fourth parsed payload command.

4. The method of claim 1, wherein the payload includes data to update a current graphical frame data into modified graphical frame data associated with a new frame, the payload including commands for separately updating two or more types of graphical data formats.

5. The method of claim 1, wherein the payload includes motion vectors encoded in the one or more commands.

6. One or more processor readable storage devices having processor readable code embodied on said processor readable storage devices, said processor readable code for programming one or more processors to perform a method comprising:

receiving a payload having one or more commands by a client from a server;

parsing the payload commands at the client;

selecting a raster segment contained in a previous payload and identified by a first parsed payload command; and

copying the selected raster segment into a current frame at the client at a location specified in the first parsed payload command.

7. The one or more processor readable storage devices of claim 6, the method further comprising:

accessing a cached raster segment identified in a second parsed payload command from a raster segment cache at the client;

modifying a relevance value for the cached raster segment; and

copying the selected cached raster segment into the current frame at the client at a second location specified in the second parsed payload command.

8. The one or more processor readable storage devices of claim 6, the method further comprising:

removing a cached raster segment identified in a third parsed payload command from the raster segment cache at the client;

adding a cached raster segment identified in a fourth parsed payload command from the raster segment cache at the client;

setting a relevance value for the added cached raster segment; and

copying the added cached raster segment into the current frame at the client at a third location specified in the fourth parsed payload command.

9. A client device, comprising:

one or more processors; and

one or more processor readable storage devices coupled to the processor, the one or more processor readable storage devices having processor readable code embodied on said processor readable storage devices, said processor readable code for programming said one or more processors to;

receive a payload having one or more commands by the client device from a server;

parse the payload commands;

select a raster segment contained in a previous payload and identified by a first parsed payload command; and

copy the selected raster segment into a current frame at the client device at a location specified in the first parsed payload command.

10. The client device of claim 9, wherein said processor readable code is further for programming said one or more processors to:

access a cached raster segment identified in a second parsed payload command from a raster segment cache at the client device;

modify a relevance value for the cached raster segment; and

copy the selected cached raster segment into the current frame at the client device at a second location specified in the second parsed payload command.

11. The client device of claim 9, wherein said processor readable code is further for programming said one or more processors to:

remove a cached raster segment identified in a third parsed payload command from the raster segment cache at the client device;

add a cached raster segment identified in a fourth parsed payload command from the raster segment cache at the client device;

set a relevance value for the added cached raster segment; and

copy the added cached raster segment into the current frame at the client device at a third location specified in the fourth parsed payload command.