Video decoder error handling

• US 9,357,233 B2
• Filed: 07/10/2008
• Issued: 05/31/2016
• Est. Priority Date: 02/26/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Lee, Yen-Chi, Dai, Min, Teng, Chia-Yuan
• Primary Examiner(s): Crutchfield, Christopher
• Assistant Examiner(s): TRAN, THINH D
• Application Number:
  US12/170,991
• Publication Number:
  US 20090213938A1
• Time in Patent Office: 2,882 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/134 characterised by the element, parameter or criterion affecting or controlling the adaptive coding
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/573 Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/68 involving the insertion of resynchronisation markers into the bitstream
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

A video decoder performs a sequential error handling process to detect and conceal errors within a corrupted data segment of video data units. The decoder sequentially decodes a current data unit. Upon detecting an error, the decoder sets an error flag and resynchronizes decoding at the start of the next unit. If the error flag is set, the video decoder identifies the end of the corrupted data segment based on the start of the later unit. The decoder conceals data between the start of the current unit and the end of the corrupted data segment. If the error flag is not set, the decoder may decode the remainder of the current unit and proceed to decode the next available unit without performing error handling and concealment for the current unit. The decoder also may address reference unit mismatches caused by lost video data units.

Claims

1. A video decoding method comprising:

determining a start of a current unit of encoded video data;

decoding at least a portion of the current unit without determining a start of a next available unit of the encoded video data;

detecting a decoding error in the current unit;

when the decoding error is detected, determining the start of the next available unit of the encoded video data;

determining an end of a corrupted data segment based on the start of the next available unit, wherein the current unit is a current slice of a first frame, and the corrupted data segment includes the current slice and at least one additional slice of encoded video data from a second frame; and

concealing the corrupted data segment based on the start of the current unit and the end of the corrupted data segment.

2. The method of claim 1, wherein each of the current unit and the next available unit includes a video data slice.

3. The method of claim 1, further comprising:

if the decoding error is detected, setting an error flag to indicate the detection of the decoding error; and

determining the end of the corrupted data segment based on the start of the next available unit when the error flag is set.

4. The method of claim 3, wherein the next available unit comprises at least one slice, the method further comprising seeking a slice header associated with the slice when the decoding error is detected.

5. The method of claim 3, further comprising, if the decoding error is detected, stopping decoding of the current unit, and proceeding to decode the next available unit.

6. The method of claim 1, further comprising, if the decoding error is not detected, decoding the entire first unit.

7. The method of claim 1, wherein the decoding error comprises at least one of a syntax error, semantic error, or entropy coding error.

8. The method of claim 1, wherein determining a start of the current unit comprises determining a first macroblock (MB) number associated with the start of the current unit, determining an end of the corrupted data segment comprises determining a second MB number prior to a start of the second unit, and concealing comprises concealing the corrupted data segment from the first MB number to the second MB number.

9. The method of claim 8, wherein determining a start of the second unit comprises determining a third MB number associated with the start of the second unit, and wherein determining the second MB number comprises subtracting one from the third MB number to produce the second MB number.

10. The method of claim 8, wherein determining a start of the first unit comprises determining a first macroblock (MB) number and a first frame number associated with the start of the first unit, determining an end of the corrupted data segment comprises determining a second MB number and a second frame number associated with the end of the corrupted data segment, and concealing comprises concealing at least a portion of the corrupted data segment based on the first and second MB numbers and the first and second frame numbers, wherein the first and second frame numbers are different.

11. The method of claim 1, further comprising:

detecting a loss of one or more frames; and

replacing the one or more lost frames to conceal a reference frame mismatch for another frame.

12. A video decoding device comprising:

means for determining a start of a current unit of encoded video data;

means for decoding at least a portion of the current unit without detecting a start of a next available unit of the encoded video data;

means for detecting a decoding error in the current unit;

means for determining, when the decoding error is detected, the start of the next available unit of the encoded video data;

means for determining, an end of a corrupted data segment based on the start of the next available unit, wherein the current unit is a current slice of a first frame, and the corrupted data segment includes the current slice and at least one additional slice of encoded video data from a second frame; and

means for concealing the corrupted data segment based on the start of the current unit and the end of the corrupted data segment.

13. The device of claim 12, wherein each of the current unit and the next available unit includes a video data slice.

14. The device of claim 12, further comprising:

means for setting, if the decoding error is detected, an error flag to indicate the detection of the decoding error; and

means for determining the end of the corrupted data segment based on the start of the next available unit when the error flag is set.

15. The device of claim 14, wherein the next available unit comprises at least one slice, the device further comprising means for seeking a slice header associated with the slice when the decoding error is detected.

16. The device of claim 14, further comprising means for, if the decoding error is detected, stopping decoding of the current unit, and proceeding to decode the next available unit.

17. The device of claim 12, further comprising means for decoding, if the decoding error is not detected, the entire first unit.

18. The device of claim 12, wherein the decoding error comprises at least one of a syntax error, semantic error, or entropy coding error.

19. The device of claim 12, wherein the means for determining a start of the current unit comprises means for determining a first macroblock (MB) number associated with the start of the current unit, the means for determining an end of the corrupted data segment comprises means for determining a second MB number prior to a start of the second unit, and the means for concealing comprises means for concealing the corrupted data segment from the first MB number to the second MB number.

20. The device of claim 19, wherein the means for determining a start of the second unit comprises means for determining a third MB number associated with the start of the second unit, and wherein the means for determining the second MB number comprises means for subtracting one from the third MB number to produce the second MB number.

21. The device of claim 19, wherein the means for determining a start of the first unit comprises means for determining a first macroblock (MB) number and a first frame number associated with the start of the first unit, the means for determining an end of the corrupted data segment comprises means for determining a second MB number and a second frame number associated with the end of the corrupted data segment, and the means for concealing comprises means for concealing at least a portion of the corrupted data segment based on the first and second MB numbers and the first and second frame numbers, wherein the first and second frame numbers are different.

22. The device of claim 12, further comprising:

means for detecting a loss of one or more frames; and

means for replacing the one or more lost frames to conceal a reference frame mismatch for another frame.

23. A video decoding device comprising:

a decoding engine that decodes at least a portion of a current unit of encoded video data before a start of a next available unit of the encoded video data is determined;

an error detection module that detects a decoding error in the current unit;

an error mapping module that determines a start of the current unit, determines, when the decoding error is detected, the start of the next available unit of the encoded video data and, determines an end of a corrupted data segment based on the start of the next available unit, wherein the current unit is a current slice of a first frame, and the corrupted data segment includes the current slice and at least one additional slice of encoded video data from a second frame; and

an error concealment module that conceals the corrupted data segment based on the start of the current unit and the end of the corrupted data segment.

24. The device of claim 23, wherein each of the current unit and the next available unit includes a video data slice.

25. The device of claim 23, wherein the error detection module sets an error flag to indicate the detection of the decoding error, and the error mapping module determines the end of the corrupted data segment based on the start of the next available unit when the error flag is set.

26. The device of claim 25, wherein the next available unit comprises at least one slice, and the decoding engine seeks a slice header associated with the slice when the decoding error is detected.

27. The device of claim 25, wherein, if the decoding error is detected, the decoding engine stops decoding of the current unit, and proceeds to decode the next available unit.

28. The device of claim 23, wherein the decoding engine decodes the entire first unit if the decoding error is not detected.

29. The device of claim 23, wherein the decoding error comprises at least one of a syntax error, semantic error, or entropy coding error.

30. The device of claim 23, wherein the error mapping module determines a first macroblock (MB) number associated with the start of the current unit, and determines a second MB number prior to a start of the second unit, and the error concealment module conceals the corrupted data segment from the first MB number to the second MB number.

31. The device of claim 30, wherein the error mapping module determines a third MB number associated with the start of the second unit, and determining the second MB number by subtracting one from the third MB number to produce the second MB number.

32. The device of claim 30, wherein the error mapping module determines a first macroblock (MB) number and a first frame number associated with the start of the first unit, and determines a second MB number and a second frame number associated with the end of the corrupted data segment, and the error concealment module conceals at least a portion of the corrupted data segment based on the first and second MB numbers and the first and second frame numbers, wherein the first and second frame numbers are different.

33. The device of claim 23, wherein the error concealment module detects a loss of one or more frames, and replaces the one or more lost frames to conceal a reference frame mismatch for another frame.

34. The device of claim 23, wherein the device comprises a wireless communication device handset.

35. The device of claim 23, wherein the device comprises an integrated circuit device.

36. A non-transitory computer-readable medium comprising instructions to cause one or more processors to:

determine a start of a current unit of encoded video data;

decode at least a portion of the current unit without determining an end of a next available unit of the encoded video data;

detect a decoding error in the current unit;

when the decoding error is detected, determine the start of the next available unit of the encoded video data;

determine an end of a corrupted data segment based on the start of the next available unit, wherein the current unit is a current slice of a first frame, and the corrupted data segment includes the current slice and at least one additional slice of encoded video data from a second frame; and

conceal the corrupted data segment based on the start of the current unit and the end of the corrupted data segment.

37. The non-transitory computer-readable medium of claim 36, wherein each of the current unit and the next available unit includes a video data slice.

38. The non-transitory computer-readable medium of claim 36, further comprising instructions to cause the one or more processors:

set an error flag to indicate the detection of the decoding error if the decoding error is detected; and

determine the end of the corrupted data segment based on the start of the next available unit when the error flag is set.

39. The non-transitory computer-readable medium of claim 38, wherein the next available unit comprises at least one slice, and the instructions cause the one or more processors to seek a slice header associated with the slice when the decoding error is detected.

40. The non-transitory computer-readable medium of claim 38, further comprising instructions to cause the one or more processors to, if the decoding error is detected, stop decoding of the current unit, and proceed to decode the next available unit.

41. The non-transitory computer-readable medium of claim 36, wherein the instructions cause the one or more processors to decode the entire first unit if the decoding error is not detected.

42. The non-transitory computer-readable medium of claim 36, wherein the decoding error comprises at least one of a syntax error, semantic error, or entropy coding error.

43. The non-transitory computer-readable medium of claim 36, wherein the instructions cause the one or more processors to determine a first macroblock (MB) number associated with the start of the current unit, determine a second MB number prior to a start of the second unit, and conceal the corrupted data segment from the first MB number to the second MB number.

45. The non-transitory computer-readable medium of claim 43, wherein the instructions cause the one or more processors to determine a first macroblock (MB) number and a first frame number associated with the start of the first unit, determine a second MB number and a second frame number associated with the end of the corrupted data segment, and conceal at least a portion of the corrupted data segment based on the first and second MB numbers and the first and second frame numbers, wherein the first and second frame numbers are different.

46. The non- transitory _computer-readable medium of claim 36, wherein the instructions cause the one or more processors to:

detect a loss of one or more frames; and

replace the one or more lost frames to conceal a reference frame mismatch for another frame.

44. The non-transitory computer-readable medium of 43, wherein the instructions cause the one or more processors to determine a third MB number associated with the start of the second unit, and subtract one from the third MB number to produce the second MB number.

47. An apparatus comprising:

a processor configured to determine a start of a current unit of encoded video data, decode at least a portion of the current unit without determining an end of a next available unit of the encoded video data, detect a decoding error in the current unit, when the decoding error is detected, determine the start of the next available unit of the encoded video data, determine an end of a corrupted data segment based on the start of the next available unit, wherein the current unit is a current slice of a first frame, and the corrupted data segment includes the current slice and at least one additional slice of encoded video data from a second frame, and conceal the corrupted data segment based on the start of the current unit and the end of the corrupted data segment.