METHOD AND DEVICE FOR VIDEO SEQUENCE DECODING WITH ERROR CONCEALMENT

• US 20100303154A1
• Filed: 08/29/2008
• Published: 12/02/2010
• Est. Priority Date: 08/31/2007
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Nassor, Eric, Le Floch, Herve
• Application Number:
  US12/675,157
• Publication Number:
  US 20100303154A1
• Time in Patent Office: Days
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/166 concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

The invention concerns a method for decoding a video sequence encoded according to a predictive format, which video sequence includes predicted images containing encoded residual data representing differences between the respective predicted image and a respective reference image in the video sequence.

The method comprises, for a current predicted image of the video sequence, the steps of:

• • determining (E51) at least one first area of the current predicted image according to meeting of a predetermined criterion;
  • for at least part of the determined at least one first area, applying an error concealment method (E514), said error concealment method using residual data of the current predicted image relative to said part.

Claims

1. A method for decoding a video sequence encoded according to a predictive format, which video sequence includes predicted images containing encoded residual data representing differences between the respective predicted image and a respective reference image in the video sequence, the method comprising, for a current predicted image of the video sequence:

determining at least one first area of the current predicted image according to meeting of a predetermined criterion;

for at least part of the determined at least one first area, applying an error concealment method, said error concealment method using residual data of the current predicted image relative to said part.

2. The method according to claim 1, further comprising:

evaluating whether the quality of reconstruction of an image signal is sufficient or not, which image signal temporally precedes the current predicted image and is used as a reference for the prediction of the at least one first area;

in case the quality of reconstruction is evaluated as not sufficient, determining that the predetermined criterion has been met.

3. The method according to claim 2, wherein the evaluation of the quality of reconstruction takes into account the type of error concealment method used for reconstruction of said image signal temporally preceding the current predicted image and used as a reference for the prediction of the at least one first area.

4. The method according to claim 3, wherein the quality of reconstruction is always evaluated as not sufficient if the type of error concealment method is spatial error concealment.

5. The method according to claim 2, wherein determining at least one first area further comprises:

reading the location of at least one second area in a reference image of the current predicted image, each second area containing at least part of the image signal temporally preceding the current predicted image and used as a reference for the prediction of the at least one first area;

applying a projection according to motion vectors of said at least one second area on the current predicted image to obtain the location of said at least one first area.

6. The method according to claim 1, further comprising:

evaluating the quality of reconstruction of the image signal obtained by error concealment applied to said at least part of the at least one first area;

in case the quality of reconstruction is evaluated as not sufficient, storing the location of said part of the current predicted image.

7. The method according to claim 6, wherein the quality of reconstruction is evaluated as not sufficient if the energy of the residual data corresponding to said at least part of the at least one first area is lower than a predetermined threshold.

8. The method according to claim 1, wherein the error concealment method is a spatial interpolation method, a value attributed to a pixel to be reconstructed of the at least one first area of the current predicted image being calculated from decoded values of pixels within a spatial neighborhood of said pixel to be reconstructed.

9. The method according to claim 8, wherein the value attributed to a pixel to be reconstructed is calculated by a weighted sum of decoded values for pixels in the neighborhood and wherein each weighting factor depends on the residual data corresponding to said at least one first area.

10. The method according to claim 9, wherein the weighting factor associated with a pixel in the neighborhood is a function of the sum of absolute values of residual data of pixels situated on a line joining said pixel to be reconstructed and said pixel in the neighborhood.

11. The method according to claim 10, wherein said weighting factor is inversely proportional to said sum.

12. The method according to claim 1, wherein the error concealment method selects, to reconstruct said at least part of the at least one first area, at least one of a plurality of candidates and the residual data corresponding to said at least one first area is used to choose between the plurality of candidates.

13. The method according to claim 12, wherein the error concealment method is a spatial block matching method, the residual data corresponding to said at least one first area being used to choose between a plurality of candidate blocks.

14. The method according to claim 12, wherein the error concealment method is a motion vector correction method, the residual data corresponding to said at least one first area being used to choose between a plurality of candidate motion vectors.

15. A device for decoding a video sequence encoded according to a predictive format, which video sequence includes predicted images containing encoded residual data representing differences between the respective predicted image and a respective reference image in the video sequence, the device comprising:

means for determining at least one first area of a current predicted image according to meeting of a predetermined criterion;

means for applying an error concealment method to at least part of the determined at least one first area, said error concealment method using residual data of the current predicted image relative to said part.

16. A non-transitory computer-readable carrier medium storing a program which, when executed by a computer or a processor in a device for decoding a video sequence, causes the device to carry out a method for decoding a video sequence encoded according to a predictive format, which video sequence includes predicted images containing encoded residual data representing differences between the respective predicted image and a respective reference image in the video sequence, the method comprising, for a current predicted image of the video sequence:

determining at least one first area of the current predicted image according to meeting of a predetermined criterion;

for at least part of the determined at least one first area, applying an error concealment method, said error concealment method using residual data of the current predicted image relative to said part.

17. (canceled)

18. A device for decoding a video sequence encoded according to a predictive format, which video sequence includes predicted images containing encoded residual data representing differences between the respective predicted image and a respective reference image in the video sequence, the device comprising:

a determiner that determines at least one first area of a current predicted image according to meeting of a predetermined criterion; and

a processor that applies an error concealment method to at least part of the determined at least one first area, said error concealment method using residual data of the current predicted image relative to said part.