Content-adaptive multiple description motion compensation for improved efficiency and error resilience
First Claim
Patent Images
1. A multiple description video encoding method comprising the steps of:
- identifying based on content of a frame at least one region of interest (ROI) in said frame, said frame being one of a plurality of frames comprising a video sequence being encoded in parallel by two motion compensation processes to produce two respective streams to be transmitted to a decoder, each stream including a mismatch signal usable by the decoder to reconstruct a part of the video sequence motion compensated to produce the other stream;
determining, for said frame, a portion of said mismatch signal that resides outside said at least one ROI; and
precluding from the transmission said portion.
1 Assignment
0 Petitions
Accused Products
Abstract
A multiple description coding method is applied to video, and optimized to preclude transmission to the decoder of mismatch correction information that applies to portions of a frame outside a region of interest. Additional bit efficiency is realized by selectively updating, based on video content, the weighting of prediction frames motion compensated from corresponding frames used in estimating a current frame. Frequency of update is adaptively determined based on the realized increased accuracy of prediction and concomitant residual image bit savings as compared, in tradeoff, with the need to more frequently transmit the updated weights to the receiver.
-
Citations
21 Claims
-
1. A multiple description video encoding method comprising the steps of:
-
identifying based on content of a frame at least one region of interest (ROI) in said frame, said frame being one of a plurality of frames comprising a video sequence being encoded in parallel by two motion compensation processes to produce two respective streams to be transmitted to a decoder, each stream including a mismatch signal usable by the decoder to reconstruct a part of the video sequence motion compensated to produce the other stream;
determining, for said frame, a portion of said mismatch signal that resides outside said at least one ROI; and
precluding from the transmission said portion. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A multiple description video encoding method comprising the steps of:
-
forming a side prediction image by motion compensating a single frame of a video sequence; and
forming a central prediction image from a weighted average of frames motion compensated in a central motion compensation in parallel with the motion compensation that forms the side prediction image, the average being weighted by respective adaptive temporal filter tap weights that are updated based on content of at least one frame of said sequence. - View Dependent Claims (7, 8, 9)
-
-
10. A multiple description video encoder comprising:
-
an odd side encoder and an even side encoder for performing on frames of a video sequence motion compensation in parallel to produce two respective streams to be transmitted to a decoder, each stream including a mismatch signal usable by the decoder to reconstruct a part of said video sequence motion compensated to produce the other stream;
a region of interest (ROI) selection unit for identifying based on content of a frame at least one ROI in said frame; and
a mismatch error suppression unit for determining, for said frame, a portion of said mismatch signal that resides outside said at least one ROI and precluding from the transmission said portion. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A multiple description video encoder comprising:
-
an odd side encoder and an even side encoder for performing on frames of a video sequence motion compensation in parallel to produce two respective streams to be transmitted to a decoder, each stream including a mismatch signal usable by the decoder to reconstruct a part of said video sequence motion compensated to produce the other stream;
means for forming a side prediction image by motion compensating a single frame of said sequence; and
means for forming a central prediction image from a weighted average of frames motion compensated in a central motion compensation, the average being weighted by respective adaptive temporal filter tap weights that are updated based on content of at least one frame of said sequence. - View Dependent Claims (17, 18)
-
-
19. A computer software product that includes a medium readable by a processor and having stored thereon:
-
a first sequence of instructions which, when executed by said processor, causes said processor to identify based on content of a frame at least one region of interest (ROI) in said frame, said frame being one of a plurality of frames comprising a video sequence being encoded in parallel by two motion compensation processes to produce two respective streams to be transmitted to a decoder, each stream including a mismatch signal usable by the decoder to reconstruct a part of the video sequence motion compensated to produce the other stream; and
a second sequence of instructions which, when executed by said processor, causes said processor to determine, for said frame, a portion of said mismatch signal that resides outside said at least one ROI and to preclude from the transmission said portion. - View Dependent Claims (20)
-
-
21. A multiple description video decoder for motion compensation decoding two video streams in parallel, the decoder using a mismatch signal, received from a motion compensation encoder that produced one of the streams, to reconstruct a sequence of video frames motion compensated to produce the other stream, said decoder comprising means for receiving tap weights updated by the encoder based on content of the video streams and used by the decoder to make an image prediction based on both of said streams.
Specification