Client side detection of motion vectors for cross-platform display

• US 9,223,534 B1
• Filed: 12/30/2011
• Issued: 12/29/2015
• Est. Priority Date: 12/30/2011
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Hopto Inc.
• Inventors: Eilam, Eldad
• Primary Examiner(s): Wu, Sing-Wai
• Application Number:
  US13/341,232
• Time in Patent Office: 1,460 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally

Abstract

Data including information regarding a display of the host device may be received. A display of a client device may correspond to the display of the host device. Information regarding the display of the host device may be monitored for changes. When a change is detected, a movement of an image may be identified. Instructions may be generated regarding the changes to the display. A client device may process such instructions to incorporate the detected change while maintaining a remaining portion of the display. The instructions may include a motion vector command for the image movement and a command to fill in space vacated by the moving image. As such, the client device is not required to re-process and re-render an entire display where a change pertains to only a portion thereof.

Claims

1. A method for motion vectors for cross-platform display, the method comprising:

receiving data sent over a communication network from a host device to the client device, the data including information regarding a display of the host device, wherein a display of the client device corresponds to the display of the host device; and

executing instructions stored in memory of the client device, wherein execution of instructions by a processor of the client device;

determines that the received data from the host device indicates, with received flags or indicators of change from the host device, that a change has occurred in the display of the host device, the display of the host device including at least one image at a first location, wherein the determination is based on recorded observations or snapshots of what is currently being displayed on the display of the host device,

identifies that the received data of the display of the host device indicates that the change includes;

movement of a collection of pixels of the display of the host device making up the at least one image from the first location to a second location, and

movement, within the at least one image, of one or more pixels of the collection of pixels making up the at least one image;

generates instructions for identified locations of the display of the client device corresponding to the first and second locations of the display of the host device, the instructions comprising;

a motion vector command for;

moving the collection of pixels making up the at least one image on the display of the client device from the identified first location to the identified second location, and

moving, within the at least one image, the one or more pixels of the collection of pixels of the client device corresponding to the at least one image of the display of the host device with movement within the at least one image, and

a command for filling in space previously occupied by the at least one image at the first identified location on the display of the client device, wherein the filled-in space results in the client device display corresponding with the change in the host device display; and

incorporates the detected change to the display of the client device in accordance with the generated instructions, while maintaining a remaining portion of the display of the client device.

2. The method of claim 1, further comprising sending a request from the client device to the host device regarding execution of an application, and wherein the change in the host device display pertains to the execution of the application.

3. The method of claim 1, wherein determining that the received data indicates the change comprises determining that the collection of pixels remains in the host device display, but is no longer at the first location.

4. The method of claim 1, wherein determining that the received data indicates the change comprises identifying an image copy operation associated with an image name or image uniform resource locator (URL) associated with the at least one image.

5. The method of claim 1, wherein maintaining a remaining portion of the display comprises not rendering anew the at least one image in the client device display.

6. The method of claim 5, wherein maintaining a remaining portion of the display comprises only rendering anew the space at the first location vacated by the at least one image.

7. The method of claim 1, wherein executing instructions stored in memory further identifies that the received data indicates that the change includes adjustment of at least one pixel of the collection of pixels making up the at least one image based on the movement of the collection of pixels from the first location to the second location.

8. The method of claim 7, wherein executing instructions stored in memory further generates a command for adjusting the at least one pixel.

9. An apparatus for motion vectors for cross-platform display, the apparatus comprising:

a communication interface for receiving data sent over a communication network from a host device to the client device, the data including information regarding a display of the host device, wherein a display of the client device corresponds to the display of the host device;

a processor for executing instructions stored in memory of the client device, wherein execution of instructions by a processor of the client device;

determines that the received data from the host device indicates, with received flags or indicators of change from the host device, that a change has occurred in the display of the host device, the display of the host device including at least one image at a first location, wherein the determination is based on recorded observations or snapshots of what is currently being displayed on the display of the host device;

identifies that the received data of the display of the host device indicates that the change includes;

movement of a collection of pixels of the display of the host device making up the at least one image from the first location to a second location, and

movement, within the at least one image, of one or more pixels of the collection of pixels making up the at least one image;

generates instructions for identified locations of the display of the client device corresponding to the first and second locations of the display of the host device, the instructions comprising;

a motion vector command for;

moving the collection of pixels making up the at least one image on the display of the client device from the identified first location to the identified second location, and

moving, within the at least one image, the one or more pixels of the collection of pixels of the client device corresponding to the at least one image of the display of the host device with movement within the at least one image, and

a command for filling in space previously occupied by the at least one image at the first identified location on the display of the client device, wherein the filled-in space results in the client device display corresponding with the change in the host device display; and

incorporates the detected change to the display of the client device in accordance with the generated instructions, while maintaining a remaining portion of the display of the client device; and

a display screen for displaying the display of the client device into which the detected change has been incorporated and the remaining portion of the display is maintained.

10. The apparatus of claim 9, wherein the communication interface sends a request from the client device to the host device regarding execution of an application, and wherein the change in the host device display pertains to the execution of the application.

11. The apparatus of claim 9, wherein the processor determines that the received data indicates the change by determining that the collection of pixels remains in the host device display, but is no longer at the first location.

12. The apparatus of claim 9, wherein the processor determines that the received data indicates the change by identifying an image copy operation associated with an image name or image uniform resource locator (URL) associated with the at least one image.

13. The apparatus of claim 9, wherein the display screen maintains a remaining portion of the display by not rendering anew the at least one image.

14. The apparatus of claim 13, wherein the display screen maintains a remaining portion of the display by only rendering anew the space at the first location vacated by the at least one image.

15. A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for motion vectors for cross-platform display, the method comprising:

receiving data from a host device including information regarding a display of the host device, wherein a display of a client device corresponds to the display of the host device;

determining that the received data from the host device indicates, with received flags or indicators of change from the host device, that a change has occurred in the display of the host device, the display of the host device including at least one image at a first location, wherein the determination is based on recorded observations or snapshots of what is currently being displayed on the display of the host device;

identifying that the received data of the display of the host device indicates that the change includes;

movement of a collection of pixels of the display of the host device making up the at least one image from the first location to a second location, and

movement, within the at least one image, of one or more pixels of the collection of pixels making up the at least one image;

generating instructions for identified locations of the display of the client device corresponding to the first and second locations of the display of the host device, the instructions comprising;

a motion vector command for;

moving the collection of pixels making up the at least one image on the display of the client device from the identified first location to the identified second location, and

moving, within the at least one image, the one or more pixels of the collection of pixels of the client device corresponding to the at least one image of the display of the host device with movement within the at least one image, and

a command for filling in space previously occupied by the at least one image at the first identified location on the display of the client device, wherein the filled-in space results in the client device display corresponding with the change in the host device display; and

incorporating the detected change to the display of the client device in accordance with the generated instructions, while maintaining a remaining portion of the display of the client device.