Method and apparatus for re-concealing error included in decoded image

• US 20060179388A1
• Filed: 11/14/2005
• Published: 08/10/2006
• Est. Priority Date: 12/31/2004
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Byung-sun
• Application Number:
  US11/271,985
• Publication Number:
  US 20060179388A1
• Time in Patent Office: Days
• US Class Current: 714/746
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

Provided is a method and apparatus for re-concealing an error included in a decoded image. The method includes determining whether a first reference block in a first reference frame, which is used for motion compensation of a current block, includes an error concealed area, and performing error re-concealment on the error concealed area included in the current block if the first reference block includes the error concealed area.

Claims

1. A method for re-concealing an error included in a decoded image, the method comprising:

(a) determining whether a first reference block in a first reference frame, which is used for motion compensation of a current block, includes an error concealed area; and

(b) performing error re-concealment on the error concealed area included in the current block, if the first reference block includes the error concealed area.

2. The method of claim 1, wherein (b) comprises:

(b1) determining a plurality of candidate motion vectors for motion compensation of the first reference block;

(b2) extracting areas corresponding to remaining areas of the first reference block other than the error concealed area, from reference blocks indicated by the plurality of candidate motion vectors in a second reference frame;

(b3) determining areas that match the remaining areas of the first reference block other than the error concealed area, among the areas extracted from the second reference frame, and determining a second reference block that includes the matched area and is included in the second reference frame; and

(b4) substituting an area of the second reference block corresponding to the error concealed area of the first reference block for the error concealed area included in the current block, to perform error re-concealment.

3. The method of claim 2, wherein the plurality of candidate motion vectors is the motion vector of the current block and the motion vector of at least one of the blocks of the first reference frame and the blocks including the remaining areas of the first reference block other than the error concealed area.

4. The method of claim 2, wherein (b3) is performed using one of a sum of absolute difference (SAD) function, a sum of absolute transformed difference (SATD) function, a sum of squared difference (SSD) function, and a Lagrangian function.

5. The method of claim 2, wherein (b2) comprises determining the reference blocks in the second reference frame in a predetermined range around pixels indicated by the plurality of candidate motion vectors, and extracting the areas corresponding to the remaining areas of the first reference block other than the error concealed area, from the reference blocks.

6. The method of claim 4, wherein if the result of calculation using one of the SAD function, the SATD function, the SSD function, and the Lagrangian function is larger than a predetermined threshold value, error re-concealment is not performed.

7. The method of claim 2, further comprising (c) obtaining the ratio of the size of the remaining areas of the first reference block other than the error concealed area, to the error concealed area,

wherein if the obtained ratio is smaller than a predetermined threshold value, (b) is not performed.

8. An apparatus for re-concealing an error included in a decoded image, the apparatus comprising:

a memory which stores a plurality of reference frames; and

an error concealing unit which reads a first reference frame used for motion compensation of a current block from the memory, and performs error re-concealment on an error concealed area included in the current block if a first reference block in the first reference frame includes an error concealed area.

9. The apparatus of claim 8, wherein the error concealing unit determines a plurality of candidate motion vectors for motion compensation of the first reference block, extracts areas corresponding to remaining areas of the first reference block other than the error concealed area, from reference blocks indicated by the plurality of candidate motion vectors in a second reference frame, determines areas that match the remaining areas of the first reference block other than the error concealed area, from among the areas extracted from the second reference frame and a second reference block that includes the matched area and is included in the second reference frame, and substitutes an area of the second reference block corresponding to the error concealed area of the first reference block for the error concealed area included in the current block, thereby performing error re-concealment.

10. The apparatus of claim 9, wherein the plurality of candidate motion vectors is the motion vector of the current block and the motion vector of at least one of the blocks of the first reference frame and the blocks including the remaining areas of the first reference block other than the error concealed area.

11. The apparatus of claim 9, wherein the error concealing unit uses one of a sum of absolute difference (SAD) function, a sum of absolute transformed difference (SATD) function, a sum of squared difference (SSD) function, and a Lagrangian function, when determining the areas that match the remaining areas of the first reference block other than the error concealed area, from among the areas extracted from the second reference.

12. The apparatus of claim 9, wherein the error concealing unit determines the reference blocks in the second reference frame in a predetermined range around pixels indicated by the plurality of candidate motion vectors, and extracts the areas corresponding to the areas of the first reference block other than the error concealed area from the reference blocks.

13. The apparatus of claim 11, wherein the error concealing unit does not perform error re-concealment if the result of calculation using one of the SAD function, the SATD function, the SSD function, and the Lagrangian function is larger than a predetermined threshold value.

14. The apparatus of claim 9, wherein the error concealing unit obtains the ratio of the size of the remaining areas of the first reference block other than the error concealed area, to the error concealed area,

wherein if the obtained ratio is smaller than a predetermined threshold value, error re-concealment is not performed.

15. A computer-readable recording medium having recorded thereon a program for implementing a method for re-concealing an error included in a decoded image, the method comprising:

(a) determining whether a first reference block in a first reference frame, which is used for motion compensation of a current block, includes an error concealed area; and

(b) performing error re-concealment on the error concealed area included in the current block, if the first reference block includes the error concealed area.

16. The computer-readable recording medium of claim 15, wherein

(b) comprises:

(b1) determining a plurality of candidate motion vectors for motion compensation of the first reference block;

(b2) extracting areas corresponding to remaining areas of the first reference block other than the error concealed area, from reference blocks indicated by the plurality of candidate motion vectors in a second reference frame;

(b3) determining areas that match the remaining areas of the first reference block other than the error concealed area, among the areas extracted from the second reference frame, and determining a second reference block that includes the matched area and is included in the second reference frame; and

(b4) substituting an area of the second reference block corresponding to the error concealed area of the first reference block for the error concealed area included in the current block, to perform error re-concealment.

17. The computer-readable recording medium of claim 16, wherein the plurality of candidate motion vectors is the motion vector of the current block and the motion vector of at least one of the blocks of the first reference frame, and the blocks including the remaining areas of the first reference block other than the error concealed area.

18. The computer-readable recording medium of claim 16, wherein (b3) is performed using one of a sum of absolute difference (SAD) function, a sum of absolute transformed difference (SATD) function, a sum of squared difference (SSD) function, and a Lagrangian function.

19. The computer-readable recording medium of claim 16, wherein (b2) comprises determining the reference blocks in the second reference frame in a predetermined range around pixels indicated by the plurality of candidate motion vectors, and extracting the areas corresponding to the remaining areas of the first reference block other than the error concealed area, from the reference blocks.

20. The computer-readable recording medium of claim 18, wherein if the result of calculation using one of the SAD function, the SATD function, the SSD function, and the Lagrangian function is larger than a predetermined threshold value, error re-concealment is not performed.

21. The computer-readable recording medium of claim 16, further comprising (c) obtaining the ratio of the size of the remaining areas of the first reference block other than the error concealed area, to the error concealed area,

wherein if the obtained ratio is smaller than a predetermined threshold value, error re-concealment is not performed.