Adaptive updates in motion-compensated temporal filtering
First Claim
1. In a computing device that implements a video encoder, a method comprising:
- with the computing device that implements the video encoder, performing motion-compensated temporal filtering that includes a motion-compensated prediction stage and a motion-compensated update stage, the motion-compensated update stage comprising;
adapting update information based at least in part upon a model of the human visual system and based at least in part upon sample values of an image to which the update information is to be applied, wherein the adapting includes setting one or more image-dependent thresholds from the sample values of the image to limit the update information for parts of the image in which distortion is especially perceptible and not limit the update information for other parts of the image; and
applying results of the adapting to the image during encoding.
2 Assignments
0 Petitions
Accused Products
Abstract
Techniques and tools are described for scalable video coding and decoding. For example, a video encoder and decoder perform adaptive update operations in lifting-based motion-compensated temporal filtering and inverse motion-compensated temporal filtering, respectively. The encoder, in a prediction stage, computes a motion-compensated prediction for an odd image and computes a high-pass image as the difference between the odd image and the prediction. For an update stage, the encoder performs motion compensation on the high-pass image (and potentially another high-pass image) to compute a motion-compensated update. Based upon perceptual criteria, the encoder adaptively combines the update with an even image to form a low-pass image. The decoder, for an update stage, performs motion compensation on one or more high-pass images to compute a motion-compensated update. Based upon perceptual criteria, the encoder adaptively combines the update with a low-pass image to reconstruct an even frame.
128 Citations
28 Claims
-
1. In a computing device that implements a video encoder, a method comprising:
with the computing device that implements the video encoder, performing motion-compensated temporal filtering that includes a motion-compensated prediction stage and a motion-compensated update stage, the motion-compensated update stage comprising; adapting update information based at least in part upon a model of the human visual system and based at least in part upon sample values of an image to which the update information is to be applied, wherein the adapting includes setting one or more image-dependent thresholds from the sample values of the image to limit the update information for parts of the image in which distortion is especially perceptible and not limit the update information for other parts of the image; and applying results of the adapting to the image during encoding. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 18)
-
9. A computer-readable storage medium storing computer-executable instructions for causing a computer system programmed thereby to perform a method comprising:
-
based at least in part on one or more perceptual criteria and based at least in part upon sample values of an image to which update information is to be applied in a motion-compensated update stage, computing one or more update thresholds for lifting-based motion-compensated temporal filtering or inverse motion-compensated temporal filtering, wherein the one or more update thresholds are image-dependent thresholds computed from the sample values of the image to limit the update information for parts of the image in which distortion is especially perceptible and not limit the update information for other parts of the image; and thresholding update information for the motion-compensated update stage according to the one or more update thresholds. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 19, 20)
-
-
17. A tool comprising:
-
one of more buffers for storing video picture information to which update information is to be applied; and means for adaptively performing update operations in a motion-compensated update stage of motion-compensated temporal filtering or inverse motion-compensated temporal filtering in view of update thresholds computed based upon perceptual criteria and based upon sample values of the buffered video picture information to which the update information is to be applied, the update information being selectively applied according to the update thresholds, wherein the sample values considered during the motion-compensated update stage of motion-compensated temporal filtering are original values but the sample values considered during the motion-compensated update stage of inverse motion-compensated temporal filtering are reconstructed values.
-
-
21. In a computing device that implements a video decoder, a method comprising:
with the computing device that implements the video decoder, performing inverse motion-compensated temporal filtering that includes a motion-compensated prediction stage and a motion-compensated update stage, the motion-compensated update stage comprising; adapting update information based at least in part upon a model of the human visual system and sample values of an image to which the update information is to be applied, wherein the adapting includes setting one or more image-dependent thresholds from the sample values of the image to limit the update information for parts of the image in which distortion is especially perceptible and not limit the update information for other parts of the image; and applying results of the adapting to the image during decoding. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28)
Specification