Transform Space Difference Compression

• US 20120294541A1
• Filed: 05/18/2011
• Published: 11/22/2012
• Est. Priority Date: 05/18/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hsieh, Paul Johan, Shchepetov, Denis Sergeyevich, Sankuratri, Sridhar, Saint Macary, Damien Gerard
• Granted Patent: US 8,542,934 B2
• Time in Patent Office: Days
• US Class Current: 382/233
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/619 the transform being operated outside the prediction loop

Abstract

An invention is disclosed for performing differencing of graphical data in post-transform space for a remote presentation session. Graphical data is transformed from a first representation to a second representation (e.g. with a DWT), and then a difference is taken of the post-transform data and the post-transform data of the frame that preceded the current frame. This difference is then encoded and transmitted to a client, which decodes it, and creates a representation of the graphical data using the delta, and a previously determined representation of the previous frame. By performing differencing in post-transform space, fidelity of the remote presentation session is retained while it may decrease bandwidth. This may occur because the entropy of the delta representation is usually lower than a non-delta representation while the scheme retains the identical data of the final decoded image of the non-delta version of the same compression scheme.

Claims

1. A system for compressing a second graphical data that occurs in a sequence of graphical data after a first graphical data, comprising:

a processor; and

a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, upon execution by the processor, cause the system to at least;

transform the first graphical data from a first representation to a second representation to produce a first transformed first data, the transformed first data comprising a first set of values;

transform the second graphical data from the first representation to the second representation to produce a transformed second data, the transformed second data comprising a second set of values;

determine a difference between the first set of values and the second set of values to produce a delta set of values;

encode the delta set of values to produce an encoded delta; and

transmit the encoded delta to a computer across a communications network, such that the computer decodes the delta, combines the decoded delta with a representation of the first graphical data stored in a memory of the computer to produce a representation of the second graphical data.

2. The system of claim 1, wherein the second graphical data comprises a plurality of values, and wherein the memory further bears processor-executable instructions that, when executed upon the processor, cause the system to at least:

before transforming the first graphical data, bitwise logically right-shifting each value, and discard a least-significant bit of each value.

3. The system of claim 1, wherein the processor-executable instructions that, upon execution by the processor, cause the system to at least determine a difference between the transformed first data and transformed second data further comprise processor-executable instructions that, upon execution by the processor, cause the system to at least:

perform wrapping subtraction on the transformed first data relative to the transformed second data.

4. The system of claim 1, wherein the processor-executable instructions that, upon execution by the processor, cause the system to at least determine a difference between the transformed first data and transformed second data further comprise processor-executable instructions that, upon execution by the processor, cause the system to at least:

perform a bitwise exclusive-or on the transformed first data relative to the transformed second data.

5. The system of claim 1, the memory further bearing processor-executable instructions that, upon execution by the processor, cause the system to at least:

transform a third graphical data from the first representation to the second representation to produce transformed third data;

determine a difference between the transformed third data and the transformed second data to produce a third delta;

determine that a result of encoding the third delta is likely to be stored in more data than the third graphical data;

encode the third graphical data to produce an encoded third graphical data; and

transmit the encoded third graphical data to the computer across the communications network, such that the computer displays a representation of the graphical data on a display device based on receiving the encoded third graphical data.

6. A method for compressing a second graphical data that occurs in a sequence of graphical data after a first graphical data, comprising:

transforming the second graphical data from a first representation to a second representation to produce a transformed second data;

determining a difference between the transformed second data and a transformed first data corresponding to the first graphical data to produce a delta;

encoding the delta to produce an encoded delta; and

transmitting the encoded delta to a computer across a communications network, such that the computer displays a representation of the second graphical data on a display device.

7. The method of claim 6, wherein transforming the second graphical data from a first representation to a second representation comprises:

transforming the second graphical data with a discrete wavelet transform (DWT).

8. The method of claim 6, wherein the second graphical data comprises a plurality of values, and further comprising:

after transforming the second graphical data, bitwise logically left-shifting each value, and discarding a least-significant bit of each value.

9. The method of claim 6, wherein the first and second graphical data each comprise graphical output from an application, the first graphical data having been generated by the application at a time before the second graphical output was generated by the application, and further comprising:

transforming the first graphical data from the first representation to the second representation to produce the transformed first data.

10. The method of claim 6, wherein determining a difference between the transformed second data and transformed first data comprises:

performing wrapping subtraction or a bitwise exclusive-or on the transformed second data relative to the transformed first data.

11. The method of claim 6, wherein the delta comprises a plurality of values, and encoding the delta comprises:

run-length encoding a sequence of one or more contiguous values of the plurality of values that are equal to zero.

12. The method of claim 6, wherein the delta comprises a plurality of values, and further comprising:

bit-packing the values of the encoded delta before transmitting the encoded delta to the computer.

13. The method of claim 6, wherein transmitting the encoded delta to a computer across a communications network, such that the computer displays a representation of the graphical data on a display device comprises:

transmitting the encoded delta to the computer across the communications network, such that the computer;

decodes the delta to produce a decoded delta,

combines the decoded delta with a representation of the first graphical data to produce a representation of the transformed second data,

transforms the transformed second graphical data from the second representation to the first representation to produce a representation of the second graphical data, and

displays the representation of the second graphical data on the display device.

14. The method of claim 6, further comprising:

before encoding the delta to produce an encoded delta, determining that the encoded delta is likely to be stored in less data than the second graphical data.

15. The method of claim 6, further comprising:

transforming a third graphical data from the first representation to the second representation to produce transformed third data;

determining a difference between the transformed third data and the transformed second data to produce a third delta;

determining that a result of encoding the third delta is likely to be stored in more data than the third graphical data;

encoding the third graphical data to produce an encoded third graphical data; and

transmitting the encoded third graphical data to the computer across the communications network, such that the computer displays a representation of the graphical data on a display device based on receiving the encoded third graphical data.

16. The method of claim 6, further comprising:

determining to send the client a representation of a third graphical data to the client;

in response to receiving an indication from the client that no longer has the representation of the second graphical data, encoding the third graphical data to produce a encoded third graphical data without determining a difference between the third transformed graphical data and the second transformed graphical data to produce a third delta; and

transmitting the encoded third graphical data to the computer across the communications network, such that the computer displays a representation of the graphical data on a display device based on receiving the encoded third graphical data.

17. The method of claim 6, wherein the delta comprises a first value, a second value and a third value in a set of ordered values, the first value being contiguous to the second value in the set of ordered values, the second value being contiguous to the third value in the set of ordered values, and wherein encoding the delta to produce an encoded delta comprises:

entropy encoding the second value based on the second value and the first value; and

entropy encoding the third value based on the third value and the second value.

18. The method of claim 6, wherein the transformed second graphical data comprises a plurality of 8-bit values, and wherein determining a difference between the second transformed graphical data and transformed first graphical data comprises:

converting each 8-bit value of the plurality of 8-bit values to a 16-bit value.

19. The method of claim 6, wherein the second graphical data comprises part of an image, and wherein transmitting the encoded delta to a computer across a communications network, such that the computer displays a representation of the second graphical data on a display device comprises:

transmitting an indication of a position of the second graphical data within the image, such that the computer displays the representation of the second graphical data at the position along with displaying a representation of the image.

20. A computer-readable storage medium for compressing a second graphical data that occurs in a sequence of graphical data after a first graphical data, bearing computer-readable instructions that, when executed upon a computer, cause the computer to perform operations comprising:

transforming the first graphical data from a first representation to a second representation to produce a transformed first data, the transformed first data comprising a first set of values;

transforming the second graphical data from the first representation to the second representation to produce a transformed second data, the transformed second data comprising a second set of values;

determining a difference between the first set of values and the second set of values to produce a delta set of values;

encoding the delta set of values to produce an encoded delta; and

transmitting the encoded delta to a computer across a communications network, such that the computer decodes the delta, combines the decoded delta with a representation of the first graphical data stored in a memory of the computer to produce a representation of the second graphical data, and displays the representation of the second graphical data on a display device.