Method for error concealment in video sequences

• US 20040139462A1
• Filed: 07/15/2003
• Published: 07/15/2004
• Est. Priority Date: 07/15/2002
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Wang, Ye-Kui, Hannuksela, Miska
• Granted Patent: US 8,107,539 B2
• Time in Patent Office: Days
• US Class Current: 725/32
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

A method and device for error concealment in a video sequence. When there is a scene transition in the video sequence and an error occurs in a picture belonging to the scene transition, an error concealment procedure based on the type of scene transition is used to conceal the error. Information about the scene transition type is provided to a decoder in a supplemental enhancement information message. If the scene transition is a gradual scene transition, a spatio-temporal error concealment algorithm is used to conceal the picture. If the scene transition is a scene cut and only part of the picture is lost or corrupted, a spatial error concealment is used to conceal the lost or corrupted part of the picture. If a whole picture belonging to the scene cut is lost or corrupted and the picture starts a new scene, it is not concealed.

Claims

1. A method of concealing an error in a frame of a video sequence, the video sequence comprising at least a first scene and a second scene, the second scene having a scene transition from the first scene, wherein the scene transition comprises a number of frames and the scene transition is one of a number of types, said method comprising:

identifying the type of scene transition; and

applying an error concealment procedure to conceal an error in a frame belonging to the transition based on the identified type of scene transition.

2. A method according to claim 1, wherein the identified type of scene transition is a scene cut.

3. A method according to claim 2, wherein if a whole picture belonging to the scene cut is lost, the lost picture is not concealed.

4. A method according to claim 2, wherein if part of a picture belonging to the scene cut is lost or corrupted, a spatial error concealment algorithm is applied to conceal the lost or corrupted part of the picture.

5. A method according to claim 1, wherein the identified type of scene transition is a gradual scene transition.

6. A method according to claim 5, wherein the scene transition is a fade.

7. A method according to claim 5, wherein the scene transition is a dissolve.

8. A method according to claim 5, wherein the scene transition is a wipe.

9. A method according to claim 5, wherein if a whole picture belonging to the gradual transition is lost or corrupted, a spatio-temporal error concealment algorithm is applied to conceal the lost or corrupted part of the picture.

10. A method according to claim 5, wherein if part of a picture belonging to the gradual transition is lost or corrupted, a spatio-temporal error concealment algorithm is applied to conceal the lost or corrupted part of the picture.

11. A method according to claim 1, wherein information indicative of the identified scene transition is provided to a decoder in a supplemental enhancement information message so as to allow the decoder to conceal the error based on said information.

12. A method according to claim 11, wherein said information indicative of the identified scene transition includes an indication of a scene transition type.

13. A method according to claim 11, wherein said information indicative of the identified scene transition is provided for each frame belonging to the transition.

14. A video coding device for encoding a video sequence into a data stream, the video sequence comprising at least a first scene and a second scene and having a scene transition from the first scene, wherein the scene transition comprises a number of frames and the scene transition is one of a number of types, said video coding device comprising:

means for identifying frames associated with the transition;

means for providing information about the type of transition.

15. A video coding device according to claim 14, wherein said information is provided in a supplemental enhancement information message.

16. A video coding device according to claim 15, wherein said information is provided for each frame belonging to the transition.

17. A video decoding device for decoding a video sequence from a data stream, the video sequence comprising at least a first scene and a second scene and having a scene transition from the first scene, wherein the scene transition comprises a number of frames and the scene transition is one of a number of types, said video coding device comprising:

means for receiving the data stream; and

an error concealment algorithm for concealing an error in a frame belonging to the transition based on the type of scene transition.

18. A video decoding device according to claim 17, wherein the type of scene transition is indicated in a supplemental enhancement information provided to the video coding device.

19. A video decoding device according to claim 17, wherein the type of scene transition is a gradual scene transition and a whole picture belonging to the gradual scene transition is lost or corrupted, said error concealment algorithm comprising a spatio-temporal error concealment algorithm for concealing the lost or corrupted picture.

20. A video decoding device according to claim 17, wherein the type of scene transition is a gradual scene transition and a part of a picture belonging to the gradual scene transition is lost or corrupted, said error concealment algorithm comprising a spatio-temporal error concealment algorithm for concealing the lost or corrupted part of the picture.

21. A video decoding device according to claim 17, wherein the type of scene transition is a scene cut and a part of a picture belonging to the scene cut is lost or corrupted, said error concealment algorithm comprising a spatial error concealment algorithm for concealing error in the picture.

22. A video decoding device according to claim 17, wherein the type of scene transition is a scene cut and a whole picture belonging to the scene cut is lost or corrupted, said error concealment algorithm adapted to ignore the lost or corrupted picture.