Hierarchical low latency video compression
First Claim
1. A method for reducing latency associated with transmitting a motion video sequence over a limited bandwidth channel, the video sequence having a plurality of frames derived from at least one video object, the method comprising:
- encoding the at least one video object to generate a first representation of the video object having an associated first resolution;
encoding transform parameters corresponding to a first one of the plurality of frames;
transmitting the first representation and the transform parameters corresponding to the first frame over the limited bandwidth channel;
decoding the first representation and the corresponding transform parameters to display the first frame so as to reduce latency;
transmitting a residual representation of the at least one object; and
combining the first representation with the residual representation to generate a subsequent representation having improved resolution for use in generation of subsequent ones of the plurality of frames in the motion video sequence.
2 Assignments
0 Petitions
Accused Products
Abstract
A method for displaying a video sequence depicting motion of at least one video object by sequential presentation of a plurality of frames includes storing a low resolution representation of the video object, generating and displaying a first frame of the sequence based on the low resolution representation, updating the low resolution representation, and generating and displaying a subsequent frame of the sequence based on the updated representation. The method may include calculating a quality metric to determine when updating is necessary.
-
Citations
13 Claims
-
1. A method for reducing latency associated with transmitting a motion video sequence over a limited bandwidth channel, the video sequence having a plurality of frames derived from at least one video object, the method comprising:
-
encoding the at least one video object to generate a first representation of the video object having an associated first resolution; encoding transform parameters corresponding to a first one of the plurality of frames; transmitting the first representation and the transform parameters corresponding to the first frame over the limited bandwidth channel; decoding the first representation and the corresponding transform parameters to display the first frame so as to reduce latency; transmitting a residual representation of the at least one object; and combining the first representation with the residual representation to generate a subsequent representation having improved resolution for use in generation of subsequent ones of the plurality of frames in the motion video sequence. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for reducing latency associated with transmitting a motion video sequence over a limited bandwidth channel, the video sequence having a plurality of frames derived from at least one sprite object, the method comprising:
-
encoding the at least one sprite object to generate a first representation of the at least one sprite object having an associated first resolution; evaluating a quality metric for each first representation; marking each first representation having a quality metric value below a predetermined minimum acceptable value; encoding corresponding first transform parameters for each of the at least one sprite objects corresponding to a first one of the plurality of frames; transmitting the at least one first representation and the transform parameters corresponding to the first frame over the limited bandwidth channel; decoding the first representation and the corresponding transform parameters to display the first frame so as to reduce latency; transmitting a corresponding residual representation of the at least one object for each marked first representation; encoding and transmitting corresponding second transform parameters for each of the at least one sprite objects corresponding to a subsequent one of the plurality of frames; decoding the corresponding second transform parameters; combining each marked first representation with the corresponding residual representation to generate a subsequent representation having improved resolution; and generating a subsequent one of the plurality of frames in the motion video sequence based on the subsequent representation having improved resolution and the second transform parameters. - View Dependent Claims (13)
-
Specification