Coding of motion vector information

• US 8,917,768 B2
• Filed: 11/21/2008
• Issued: 12/23/2014
• Est. Priority Date: 07/18/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Srinivasan, Sridhar, Hsu, Pohsiang, Holcomb, Thomas W., Mukerjee, Kunal, Lin, Bruce Chih-Lung
• Primary Examiner(s): Anyikire, Chikaodili E
• Application Number:
  US12/275,782
• Publication Number:
  US 20090074073A1
• Time in Patent Office: 2,223 Days
• Field of Search: 375/240.12, 375/240.16
• US Class Current: 375/240.16
• CPC Class Codes: G06V 10/20 Image preprocessing
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/56 Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

Techniques and tools for encoding and decoding motion vector information for video images are described. For example, a video encoder yields an extended motion vector code by jointly coding, for a set of pixels, a switch code, motion vector information, and a terminal symbol indicating whether subsequent data is encoded for the set of pixels. In another aspect, an encoder/decoder selects motion vector predictors for macroblocks. In another aspect, a video encoder/decoder uses hybrid motion vector prediction. In another aspect, a video encoder/decoder signals a motion vector mode for a predicted image. In another aspect, a video decoder decodes a set of pixels by receiving an extended motion vector code, which reflects joint encoding of motion information together with intra/inter-coding information and a terminal symbol. The decoder determines whether subsequent data exists for the set of pixels based on e.g., the terminal symbol.

Claims

1. A computer-implemented method of video decoding using a video decoder, the method comprising:

receiving encoded data in a bit stream for video; and

with the video decoder, decoding video using at least some of the encoded data, wherein the decoding comprises computing a motion vector predictor for a current macroblock in a picture, including;

calculating an initial predictor for the current macroblock based on one or more neighbor motion vector candidates of one or more neighboring macroblocks;

comparing the initial predictor with at least one of the one or more neighbor motion vector candidates; and

based at least in part on results of the comparing, using one of the one or more neighbor motion vector candidates as the motion vector predictor for the current macroblock, comprising;

receiving a hybrid motion indicator bit signaled in the bit stream; and

using the indicator bit to select which of the one or more neighbor motion vector candidates to use as the motion vector predictor for the current macroblock;

wherein receiving the indicator bit is contingent upon the results of the comparing indicating use of one of the one or more neighbor motion vector candidates as the motion vector predictor for the current macroblock;

wherein the macroblock is skipped, wherein the skipped macroblock uses the one of the one or more neighbor motion vector candidates as the motion vector predictor for the skipped macroblock, and wherein the skipped macroblock has no residual information.

2. The method of claim 1 wherein, for each of the at least one of the one or more neighbor motion vector candidates, the comparing the initial predictor with the neighbor motion vector candidate comprises:

computing absolute values of differences between the initial predictor and the neighbor motion vector candidate; and

comparing a sum of the absolute values of the differences to a threshold.

3. The method of claim 2 further comprising:

computing absolute values of components of the initial predictor; and

comparing a sum of the absolute values of the components of the initial predictor to the threshold.

4. The method of claim 1 wherein the calculating the initial predictor comprises computing the component-wise median of the one or more neighbor motion vector candidates.

5. One or more tangible storage media, wherein the one or more tangible storage media are one or more of volatile memory, non-volatile memory, optical storage media, and magnetic storage media, having stored thereon computer software instructions for causing a computer system programmed thereby to perform a method comprising:

encoding video, wherein the encoding produces encoded data, and wherein the encoding comprises computing a motion vector predictor for a current macroblock in a picture, including;

calculating an initial predictor for the current macroblock based on one or more neighbor motion vector candidates of one or more neighboring macroblocks;

comparing the initial predictor with at least one of the one or more neighbor motion vector candidates; and

based at least in part on results of the comparing, determining whether to;

(a) use the initial predictor as the motion vector predictor for the current macroblock;

or

(b) use one of the one or more neighbor motion vector candidates as the motion vector predictor for the current macroblock; and

signaling the encoded data as part of a bit stream for the video;

wherein one of the one or more neighbor motion vector candidates is used as the motion vector predictor for the current macroblock, the method further comprising;

selecting which of the one or more neighbor motion vector candidates to use as the motion vector predictor for the current macroblock; and

signaling a hybrid motion indicator in the bit stream to indicate the selected one of the one or more neighbor motion vector candidates, wherein the hybrid motion indicator is signaled as a bit in the bit stream to indicate the selected one of the one or more neighbor motion vector candidates; and

wherein signaling the hybrid motion indicator is contingent upon the results of the comparing indicating use of one of the one or more neighbor motion vector candidates as the motion vector predictor for the current macroblock; and

wherein the current macroblock is skipped, wherein the skipped macroblock uses one of the one or more neighbor motion vector candidates as the motion vector predictor for the skipped macroblock, and wherein the skipped macroblock has no residual information.

6. The one or more storage media of claim 5 wherein, for each of the at least one of the one or more neighbor motion vector candidates, the comparing the initial predictor with the neighbor motion vector candidate comprises:

computing absolute values of differences between the initial predictor and the neighbor motion vector candidate; and

comparing a sum of the absolute values of the differences to a threshold.

7. A computing device that implements a video decoder, the computing device comprising a processing unit and memory, the computing device adapted to perform a method of video decoding, the method comprising:

receiving encoded data in a bit stream for video; and

with the video decoder, decoding video using at least some of the encoded data, wherein the decoding comprises computing a motion vector predictor for a current macroblock in a picture, including;

calculating an initial predictor for the current macroblock based on one or more neighbor motion vector candidates of one or more neighboring macroblocks;

comparing the initial predictor with at least one of the one or more neighbor motion vector candidates; and

based at least in part on results of the comparing, selecting one of the one or more neighbor motion vector candidates as the motion vector predictor for the current macroblock, comprising;

receiving a hybrid motion indicator bit signaled in the bit stream; and

using the indicator bit to select which of the one or more neighbor motion vector candidates to use as the motion vector predictor for the current macroblock;

wherein receiving the indicator bit is contingent upon the results of the comparing indicating selection of one of the one or more neighbor motion vector candidates as the motion vector predictor for the current macroblock;

wherein the current macroblock is skipped, wherein the skipped macroblock uses the selected one of the one or more neighbor motion vector candidates as the motion vector predictor for the skipped macroblock, and wherein the skipped macroblock has no residual information.

8. The computing device of claim 7 wherein the hybrid motion indicator bit is present in the bit stream for some of the macroblocks of the picture, but absent from the bit stream for other macroblocks of the picture.