Methods and devices for encoding and decoding an image sequence implementing a prediction by forward motion compensation, corresponding stream and computer program

• US 9,756,357 B2
• Filed: 03/29/2011
• Issued: 09/05/2017
• Est. Priority Date: 03/31/2010
• Status: Active Grant

• Current Assignee: Orange S.A.
• Original Assignee: Orange S.A.
• Inventors: Amonou, Isabelle, Pateux, Stphane, Cammas, Nathalie
• Primary Examiner(s): Kalapodas, Dramos I
• Application Number:
  US13/638,525
• Publication Number:
  US 20130034163A1
• Time in Patent Office: 2,352 Days
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/553 Motion estimation dealing with occlusions
• CPC Class Codes: H04N 19/57 Motion estimation characterised by a search window with variable size or shape
• CPC Class Codes: H04N 19/583 Motion compensation with overlapping blocks
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A method and apparatus for encoding a sequence of images by predicting at least one current image by forward motion compensation from at least one reference image. Prediction implements, for at least one current block of the current image: forward projection of a block of the reference image on the current image, delivering a projected block at least partially overlapping the current block; partitioning the current block delivering a sub-block at least partially overlapped by at least one projected block; and at least one iteration of the following steps for at least one overlapped sub-block: checking that the overlapped sub-block complies with a predetermined allotting criterion; with a positive check, allotting, to the overlapped sub-block, one of the projected motion vectors; and with a negative check, and so long as a predetermined minimum size is not reached for the overlapped sub-block: partitioning of the overlapped sub-block.

Claims

1. A method for encoding a sequence of images, the method comprising:

receiving by a processor of an encoding device at least one current image and at least one reference image, the current image being divided into a plurality of blocks;

generating with the processor a prediction of the at least one current image by forward motion compensation from the at least one reference image, wherein forward motion compensation uses motion vectors pointing from the reference image towards the at least one current image, and wherein generating the prediction comprises;

for at least one block of said current image, called an overlapped current block, a sub-step of forward projection of at least two blocks of the reference image on said current image, delivering at least two projected blocks at least partially overlapping said overlapped current block, and two motion vectors, each motion vector representing shift of one of the projected blocks in the current image;

partitioning said overlapped current block into a plurality of sub-blocks, wherein at least one of the sub-blocks is at least partially overlapped by at least one of said projected blocks, called an overlapped sub-block; and

at least one iteration of the following steps for at least one overlapped sub-block;

checking that the overlapped sub-block complies with a predetermined allotting criterion that is based on overlap of the at least one projected block with respect to the overlapped sub-block;

if the overlapped sub-block complies with the predetermined allotting criterion, allotting, to said overlapped sub-block, one of the projected motion vectors selected from among the projected motion vector or vectors associated with the projected block or blocks at least partially overlapping said overlapped sub-block; and

if the overlapped sub-block does not comply with the predetermined allotting criterion, and so long as a predetermined minimum size is not reached for said overlapped sub-block;

partitioning of said overlapped sub-block into a plurality of new sub-blocks, wherein at least one new sub-block, called a new overlapped sub-block, is at least partially overlapped by at least one of said projected blocks.

2. The method for encoding according to claim 1, wherein said predetermined allotting criterion pertains to the group consisting of the following criteria:

the overlapped sub-block is overlapped at least partially by only one of the projected blocks;

a predetermined number of pixels of the overlapped sub-block is overlapped by one of the projected blocks.

3. The method for encoding according to claim 1, wherein said allotting step selects the projected motion vector associated with the projected block overlapping the most pixels of said overlapped sub-block.

4. The method for encoding according to claim 1, wherein said allotting step implements the following for at least two projected blocks at least partially overlapping said overlapped sub-block with which projected motion vectors called candidate vectors are associated:

a step of backward projection, in said reference image, of said overlapped sub-block along each of said candidate vectors, delivering at least two backward projected sub-blocks;

for each sub-block projected backward along a candidate vector, determining the number of pixels of said reference image overlapped by said backward projected sub-block having a motion vector similar to said candidate vector, delivering an overlap rate per candidate vector;

allotting, to the overlapped sub-block, the candidate vector having the best overlap rate.

5. The method for encoding according to claim 1, wherein the method also comprises the following steps:

predicting said current block by shifting the block of the reference image, associated with the projected motion vector selected during said allotting step, along said selected projected motion vector, delivering a predicted block;

determining at least one residue of texture by comparison of said current block and the predicted block;

encoding said at least one residue of texture.

6. The method for encoding according to claim 1, wherein the method also comprises the following steps:

determining a motion vector associated with said current block;

determining at least one motion vector residue by comparison of said selected projected motion vector and said motion vector associated with said current block;

encoding said at least one motion vector residue.

7. The method for encoding according to claim 1, wherein the method comprises predicting at least one motion vector associated with a block neighboring said current block in said current image, from said projected motion vector selected during said allotting step.

8. The method for encoding according to claim 1, wherein the method comprises a step of insertion, into a stream representing said sequence of images, of at least one flag representing a novel mode of encoding implemented for at least one block or sub-block of the current image, signaling the use of at least one projected motion vector selected for the encoding of said block or sub-block.

10. The method of claim 1, further comprising:

generating a stream representing the sequence of images encoded, wherein the stream comprises at least one flag representing a novel encoding mode implemented for at least one block or sub-block of the current image, signaling use of at least one selected projected motion vector for the encoding of said block or sub-block.

16. The method of claim 1, further comprising:

determining a residue of texture of the overlapped sub-block or a residue of motion associated with the overlapped sub-block, using the projected motion vector allotted to the overlapped sub-block;

encoding said residue of texture or said residue of motion, to produce an encoded residue; and

outputting a stream from the encoding device representing said sequence of images and comprising the encoded residue.

9. An encoding device for encoding a sequence of images, the encoding device comprising:

an input receiving at least one current image and at least one reference image, the current image being divided into a plurality of blocks;

an output;

a non-transitory computer-readable medium comprising instructions stored thereon;

a processor, which is configured by the instructions to perform acts of;

generating with the processor a prediction of the at least one current image by forward motion compensation from the at least one reference image, wherein forward motion compensation uses motion vectors pointing from the reference image towards the at least one current image, and generating the prediction comprises, for at least one block of said current image, called an overlapped current block;

forward projection of at least two blocks of the reference image on said current image, delivering at least two projected blocks at least partially overlapping said overlapped current block, and two motion vectors, each motion vector representing shifting of one of the projected blocks in the current image,

partitioning said overlapped current block into a plurality of sub-blocks, wherein at least one of the sub-blocks is at least partially overlapped by at least one of said projected blocks, called an overlapped sub-block, and

at least iteration of the following steps for at least one overlapped sub-block;

checking that the overlapped sub-block complies with a predetermined allotting criterion that is based on overlap of the at least one projected block with respect to the overlapped sub-block;

allotting, to said overlapped sub-block, one of said projected motion vectors selected from among the projected motion vector or vectors associated with the projected block or blocks at least partially overlapping the overlapped sub-block, activated if the overlapped sub-block complies with the predetermined allotting criterion; and

partitioning said overlapped sub-block into a plurality of new sub-blocks, wherein at least one new sub-block, called a new overlapped sub-block, is at least partially overlapped by at least one of said projected blocks, the means for partitioning said overlapped sub-block being activated if the overlapped sub-block does not comply with the predetermined allotting criterion, and so long as a predetermined minimum size is not reached for said overlapped sub-block.

11. A method for decoding a stream representing a sequence of images, the method comprising:

receiving by a processor of a decoding device the stream representing the sequence of images;

generating a prediction with the processor of at least one image of the stream to be rebuilt by forward motion compensation from at least one reference image, the image to be rebuilt being divided into a plurality of blocks, wherein forward motion compensation uses motion vectors pointing from the reference image towards the at least one current image, and wherein generating a prediction comprises;

for at least one block of said image to be rebuilt, called an overlapped current block to be rebuilt, a sub-step of forward projection of at least two blocks of the reference image on said image to be rebuilt, delivering at least two projected blocks at least partially overlapping said overlapped current block to be rebuilt, and two motion vectors, each motion vector representing shift of one of the blocks projected in the image to be rebuilt,

partitioning said overlapped current block into a plurality of sub-blocks, wherein at least one of the sub-blocks is at least partially overlapped by at least one of said projected blocks, called an overlapped sub-block; and

at least one iteration of the following steps for at least one overlapped sub-block;

checking that the overlapped sub-block complies with a predetermined allotting criterion that is based on overlap of the at least one projected block with respect to the overlapped sub-block;

if the overlapped sub-block complies with the predetermined allotting criterion;

allotting, to said overlapped sub-block, one of said projected motion vectors selected from among the projected motion vector or vectors associated with said projected block or blocks at least partially overlapping said overlapped sub-block; and

if the overlapped sub-block does not comply with the predetermined allotting criterion, and so long as a predetermined minimum size is not reached for said overlapped sub-block;

partitioning said overlapped sub-block into a plurality of new sub-blocks, wherein at least one new sub-block, called a new overlapped sub-block, is at least partially overlapped by at least one of said projected blocks.

12. The method for decoding according to claim 11, wherein the method also implements the following steps:

predicting said block to be reconstructed, by shifting the block of the reference image associated with the projected motion vector selected during said allotting step along said selected projected motion vector, delivering a predicted block;

decoding at least one residue of texture extracted from said stream representing a sequence of images, obtained during the encoding of said sequence of image; and

rebuilding said block to be rebuilt from said at least one residue of texture and from the predicted block.

13. The method for decoding according to claim 11, wherein the method also implements the following steps:

determining a motion vector associated with said block to be rebuilt;

decoding at least one residue of a motion vector extracted from said stream representing a sequence of images, obtained during the encoding of said sequence of images; and

rebuilding said block to be rebuilt from said at least one residue of the motion vector and from said motion vector associated with said block to be rebuilt.

17. The method of claim 11, further comprising:

decoding with the processor a residue of texture or a residue of motion associated with said overlapped sub-block, extracted from said stream, to produce a decoded residue;

rebuilding with the processor said overlapped sub-block using the projected motion vector allotted to said overlapped sub-block and the decoded residue; and

outputting the rebuilt overlapped sub-block of the image to be rebuilt.

14. A decoding device for decoding a stream representing a sequence of images, the decoding device comprising:

an input receiving the stream representing the sequence of images;

an output;

a non-transitory computer-readable medium comprising instructions stored thereon;

a processor, which is configured by the instructions to perform acts of;

generating a prediction of at least one image of the stream to be rebuilt by forward motion compensation from at least one reference image, the image to be rebuilt being divided into a plurality of blocks, wherein forward motion compensation uses motion vectors pointing from the reference image towards the at least one current image, and wherein generating comprises, for at least one block of said image to be rebuilt, called an overlapped current block to be rebuilt;

forward projection of at least two blocks of the reference image on said image to be rebuilt, delivering at least two projected blocks at least partially overlapping said overlapped current block to be rebuilt, and two motion vectors, each motion vector representing shift of one of the blocks projected in the image to be rebuilt,

partitioning said overlapped current block into a plurality of sub-blocks, wherein at least one of the sub-blocks is at least partially overlapped by at least one of said projected blocks, called an overlapped sub-block, and

at least iteration of the following steps for at least one overlapped sub-block;

checking that said overlapped sub-block complies with a predetermined allotting criterion that is based on overlap of the at least one projected block with respect to the overlapped sub-block;

allotting, to said overlapped sub-block, one of said projected motion vectors selected from among the projected motion vector or vectors associated with the projected block or blocks at least partially overlapping said overlapped sub-block, activated if the overlapped sub-block complies with the predetermined allotting criterion; and

partitioning said overlapped sub-block into a plurality of new sub-blocks, wherein at least one new sub-block, called a new overlapped sub-block, is at least partially overlapped by at least one of said projected blocks, the means for partitioning said overlapped sub-block being activated if the overlapped sub-block does not comply with the predetermined allotting criterion, and so long as a predetermined minimum size is not reached for said overlapped sub-block.

15. A non-transitory computer-readable medium comprising a computer program comprising instructions for implementing a method for encoding a sequence of images, when this program is executed by a processor of an encoding device, wherein the instructions comprise:

instructions configured to cause the processor to receive at least one current image and at least one reference image and to generate a prediction of the at least one current image by forward motion compensation from the at least one reference image, the current image being divided into a plurality of blocks, wherein forward motion compensation uses motion vectors pointing from the reference image towards the at least one current image, and wherein the processor implements;

for at least one block of said current image, called an overlapped current block, a sub-step of forward projection of at least two blocks of the reference image on said current image, delivering at least two projected blocks at least partially overlapping said overlapped current block, and two motion vectors, each motion vector representing shift of one of the projected blocks in the current image;

partitioning said overlapped current block into a plurality of sub-blocks, wherein at least one of the sub-blocks is at least partially overlapped by at least one of said projected blocks, called an overlapped sub-block; and

at least one iteration of the following steps for at least one overlapped sub-block;

checking that the overlapped sub-block complies with a predetermined allotting criterion that is based on overlap of the at least one projected block with respect to the overlapped sub-block;

if the overlapped sub-block complies with the predetermined allotting criterion, allotting, to said overlapped sub-block, one of the projected motion vectors selected from among the projected motion vector or vectors associated with the projected block or blocks at least partially overlapping said overlapped sub-block; and

if the overlapped sub-block does not comply with the predetermined allotting criterion, and so long as a predetermined minimum size is not reached for said overlapped sub-block;

partitioning said overlapped sub-block into a plurality of new sub-blocks, wherein at least one new sub-block, called a new overlapped sub-block, is at least partially overlapped by at least one of said projected blocks.