Method and system for motion vector prediction in scalable video coding

• US 20060153300A1
• Filed: 01/11/2006
• Published: 07/13/2006
• Est. Priority Date: 01/12/2005
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Karczewicz, Marta, Wang, Xianglin, Bao, Yiliang, Ridge, Justin
• Application Number:
  US11/330,703
• Publication Number:
  US 20060153300A1
• Time in Patent Office: Days
• US Class Current: 375/240.160
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/56 Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search

Abstract

In scalable video coding where two predictive motion vectors are calculated: one from the current layer neighboring motion vectors and one from the co-located base layer motion vectors. One of the two predictive motion vectors is chosen as the predictive motion vector for current block. A flag bit is coded to indicate which predictive motion vector is chosen only if it is not possible to infer the layer from which the predictive motion vector for the current block comes. Such inference is possible in many situations, such as when both predictive motion vectors are substantially the same, or only one of the vectors is reliable or available.

Claims

1. A method for use in scalable video coding for motion vector prediction in an enhancement layer in a video frame, the enhancement layer having a corresponding base layer, wherein the enhancement layer comprises a plurality of first blocks including a current block and a plurality of neighboring blocks, and the base layer comprises a plurality of second blocks corresponding to the current block, said method comprising the steps of:

computing a first predictive motion vector of the current block, if available, based at least on motion vectors in the neighboring blocks;

computing a second predictive motion vector of the current block, if available, based at least on a motion vector in the corresponding second blocks; and

coding the difference between the current block motion vector and one of the available predictive motion vectors for providing at least a difference motion vector, so that the available one predictive motion vector is used to predict motion associated with the enhancement layer in a decoding process based on the difference motion vector.

2. The method of claim 1, wherein the first predictive motion vector is associated with a first reference frame index, the second predictive motion vector is associated with a second reference frame index, the current block motion vector is associated with a third reference frame index and wherein when both the first predictive motion vector and the second predictive motion vector are available, and if one and only one of the first and second reference frame indices is the same as the third reference frame index, said method further comprising the steps of:

coding the difference between the current block motion vector and one of the first and second predictive motion vector associated with the same reference frame index as the third reference frame index for providing the difference motion vector, and

using said one of the first and second predictive motion vector associated with the same reference frame index as the third reference frame index to predict the motion associated with the enhancement layer in a decoding process based on the difference motion vector.

3. The method of claim 1, wherein both the first predictive motion vector and the second predictive motion vector are available, said method further comprising the steps of:

computing a first difference vector associated with the first predictive motion vector, the first difference vector having a first amplitude;

computing a second difference vector associated with the second predictive motion, the second difference vector having a second amplitude; and

if the first amplitude is smaller than the second amplitude, coding the difference between the current block motion vector and the first predictive motion vector for providing a difference motion vector, and

if the second amplitude is smaller than the first amplitude, coding the difference between the current block motion vector and the second predictive motion vector for providing the difference motion vector.

4. The method of claim 1, wherein both the first predictive motion vector and the second predictive motion vector are available, said method further comprising the steps of:

obtaining a difference vector associated with the second predictive motion, the difference vector having an amplitude; and

if the amplitude is greater than a predetermined value, coding the difference between the current block motion vector and the first predictive motion vector to obtain a difference motion vector.

5. The method of claim 1, wherein both the first predictive motion vector and the second predictive motion vector are available, said method further comprising:

computing a difference value between the first predictive motion vector and the second predictive motion vector; and

using the first predictive motion vector to predict the motion associated with the enhancement layer in the decoding process based on the coded difference between the current block motion vector and the first predictive motion vector if the difference value is within a predetermined range.

6. The method of claim 1, wherein both the first predictive motion vector and the second predictive motion vector are available, said method further comprising:

computing a difference value between the first predictive motion vector and the second predictive motion vector; and

using the second predictive motion vector to predict the motion associated with the enhancement layer in the decoding process based on the coded difference between the current block motion vector and the second predictive motion vector if the difference value is within a predetermined range.

7. The method of claim 1, wherein both the first predictive motion vector and the second predictive motion vector are available, said method further comprising:

computing a difference value between the first predictive motion vector and the second predictive motion vector; and

computing the difference between the current block motion vector and a combination of the first and second predictive vectors to predict the motion associated with the enhancement layer in the decoding process based on the coded difference between the current block motion vector and said combination if the difference value is within a predetermined range.

8. The method of claim 6, wherein said combination is an average of the first and second predictive vectors.

9. The method of claim 1, wherein both the first predictive motion vector and the second predictive motion vector are available, said method further comprising:

selecting one of the first and second predictive motion vectors based on a rate-distortion measure associated with the first and second predictive motion vectors for predicting the motion with the enhancement layer in the decoding process; and

coding the difference between the current block motion vector and said selected one predictive motion vector as well as coding a flag bit indicating the selection between the first and second predictive motion vectors so that said selected one predictive motion vector is used to predict the motion associated with the enhancement layer in the decoding process.

17. A software application product comprising a storage medium having a software application for use in coding a video sequence having a plurality of frames, each frame having a plurality of layers, said plurality of layers including a base layer and at least one enhancement layer, said enhancement layer comprising a plurality of first blocks including a current block and a plurality of neighboring blocks, the base layer comprising a plurality of second blocks corresponding to the current block, said application product having program codes for carrying out the method steps of claim 1.

10. A scalable video coding for coding a video sequence having a plurality of frames, each frame having a plurality of layers, said plurality of layers including a base layer and at least one enhancement layer, said enhancement layer comprising a plurality of first blocks including a current block and a plurality of neighboring blocks, the base layer comprising a plurality of second blocks corresponding to the current block, said encoder comprising:

means, responsive to the motion vectors in the neighboring block, for computing a first predictive motion vector of the current block, if available, based at least on motion vectors in the neighboring blocks;

means, responsive to a motion vector in the corresponding second blocks, for computing a second predictive motion vector of the current block, if available, based at least on the motion vector in the corresponding second blocks; and

means for coding the difference between the current block motion vector and one of the available predictive motion vectors for providing at least a difference motion vector, so that the available one predictive motion vector is used to predict motion associated with the enhancement layer in a decoding process based on the difference motion vector.

11. The encoder of claim 10, wherein the first predictive motion vector is associated with a first reference frame index, the second predictive motion vector is associated with a second reference frame index, the current block motion vector is associated with a third reference frame index and wherein when both the first predictive motion vector and the second predictive motion vector are available, and if one and only one of the first and second reference frame indices is the same as the third reference frame index, said coding means further coding the difference between the current block motion vector and one of the first and second predictive motion vector associated with the same reference frame index as the third reference frame index for providing the difference motion vector, and using said one of the first and second predictive motion vector associated with the same reference frame index as the third reference frame index to predict the motion associated with the enhancement layer in a decoding process based on the difference motion vector.

12. The encoder of claim 11, wherein both the first predictive motion vector and the second predictive motion vector are available, said encoder further comprising:

means for a first difference vector associated with the first predictive motion vector and a second difference vector associated with the second predictive motion vector, the first difference vector having a first amplitude, the second difference vector having a second amplitude; and

if the first amplitude is smaller than the second amplitude, coding the difference between the current block motion vector and the first predictive motion vector for providing a difference motion vector, and

if the second amplitude is smaller than the first amplitude, coding the difference between the current block motion vector and the second predictive motion vector for providing the difference motion vector.

13. The encoder of claim 11, wherein both the first predictive motion vector and the second predictive motion vector are available, said encoder further comprising:

means for obtaining a difference vector associated with the second predictive motion, the difference vector having an amplitude; and

if the amplitude is greater than a predetermined value, coding the difference between the current block motion vector and the first predictive motion vector to obtain a difference motion vector.

14. The encoder of claim 11, wherein both the first predictive motion vector and the second predictive motion vector are available, and wherein a difference value between the first predictive motion vector and the second predictive motion vector is computed;

and, the difference between the current block motion vector and a combination of the first and second predictive vectors is computed so as to predict the motion associated with the enhancement layer in the decoding process based on the coded difference between the current block motion vector and said combination if the difference value is within a predetermined range.

15. The encoder of claim 14, wherein said combination is an average of the first and second predictive vectors.

16. The encoder of claim 11, wherein both the first predictive motion vector and the second predictive motion vector are available, said encoder further comprising:

means for selecting one of the first and second predictive motion vectors based on a rate-distortion measure associated with the first and second predictive motion vectors for predicting the motion with the enhancement layer in the decoding process; and

said coding means codes the difference between the current block motion vector and said selected one predictive motion vector as well as coding a flag bit indicating the selection between the first and second predictive motion vectors so that said selected one predictive motion vector is used to predict the motion associated with the enhancement layer in the decoding process.