Video signal decoding arrangement and method for improved error concealment

• US 5,910,827 A
• Filed: 02/26/1997
• Issued: 06/08/1999
• Est. Priority Date: 02/26/1997
• Status: Expired due to Term

• Current Assignee: 8X8, Inc.
• Original Assignee: 8X8, Inc.
• Inventors: Voois, Paul A., Kwan, Katherine W.
• Primary Examiner(s): BRITTON, HOWARD W
• Application Number:
  US08/806,312
• Time in Patent Office: 832 Days
• Field of Search: 348/845.1, 348/15, 348/607, 348/616, 348/624, 371/31
• US Class Current: 375/240.27
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

A video signal decoding arrangement conceals visible artifacts attributable to errors in a data stream. The arrangement includes a data processing arrangement that decodes the data stream into image data and that replaces data corrupted by the errors with replacement data generated as a function of a previous frame. The image data is optionally stored in first and second memories.

Claims

1. A video signal decoding arrangement for decoding a data stream into a series of images, the video signal decoding arrangement comprising

a data processing arrangement, configured and arranged to:

decode the data stream into a plurality of sets of image data,

identify a corrupted data segment in a current set of image data, and

replace the corrupted data segment with a replacement data segment generated as a function of a previous set of image data in response to an error detected in the data stream, wherein the data processor selectively stores the current set of image data in a first memory or a second memory based on a first pointer.

2. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 1, wherein at least one of the first and second memories comprises a frame buffer.

3. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 2, further comprising a display device, responsive to the data processing arrangement and to the first and second memories and configured and arranged to selectively display an image stored in the first memory or the image stored in the second memory, based on a second pointer.

4. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 3, wherein the first pointer points to one of the first and second memories and the second pointer points to another of the first and second memories.

5. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 4, wherein the data processing arrangement reassigns the first and second pointers upon receiving one of the plurality of sets of data, such that the first pointer points alternately to the first memory or the second memory.

6. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 5, wherein the data processing arrangement omits reassigning the first and second pointers in response to the error.

7. A video signal decoding arrangement for decoding a data stream into a series of images, comprising:

a data processing arrangement, configured and arranged to;

decode the data stream into a plurality of sets of image data,

identify a corrupted data segment in a current set of image data, and

replace the corrupted data segment with a replacement data segment generated as a function of a previous set of image data in response to an error detected in the data stream;

an error detecting arrangement, configured and arranged to detect the error in the data stream and to provide an indication of characteristics of the error to the data processing arrangement; and

a prediction arrangement, responsive to the error detecting arrangement and configured and arranged to determine a likelihood that the error detecting arrangement triggered within a delimiting code.

8. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, the video signal decoding arrangement comprising:

a video data processor, responsive to the data stream and to an error that affects the data stream such that a first set of data of the series of sets of data includes a corrupted data segment, the video data processor being configured and arranged to replace the corrupted data segment with a replacement data segment generated as a function of a second set of data of the series of sets of data;

first and second frame buffers, responsive to the data processor and configured and arranged to store alternately each of the series of sets of data as an image in response to a first pointer; and

a first-in-first-out buffer, configured and arranged to receive the data stream.

9. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 8, wherein the series of sets of data comprises at least one of the following:

a series of macroblocks, a series of groups of blocks, and a series of frames.

10. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 8, wherein the video data processor includes at least one of the following:

a programmable digital signal processor (DSP) chip, a general purpose processor, a reduced instruction set computer (RISC) processor, and an application-specific integrated circuit (ASIC).

11. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 8, wherein the data segment that is replaced includes a starting location determined as a function of the delimiting code corresponding to a previous set of data of the series of sets of data.

12. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 8, wherein the replacement data segment is copied from the second set of data.

13. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 8, further comprising an error detecting arrangement, configured and arranged to detect the error in the data stream and to provide an indication of characteristics of the error to the video data processor.

14. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 13, wherein the error detecting arrangement comprises a multiplexing arrangement.

15. A video signal decoding arrangement for decoding a data stream into a series of images, according to claim 13, further comprising a prediction arrangement, responsive to the error detecting arrangement and configured and arranged to determine a likelihood that the error detecting arrangement triggered within a delimiting code.

16. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 8, further comprising a display device, responsive to the video data processor and to the first and second frame buffers and configured and arranged to selectively display the image stored in the first frame buffer or the image stored in the second frame buffer in response to a second pointer.

17. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 16, wherein the first pointer points to one of the first and second frame buffers and the second pointer points to another of the first and second frame buffers.

18. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 17, wherein the video data processor reassigns the first and second pointers upon receiving one of the series of sets of data, such that the first pointer points alternately to the first frame buffer or the second frame buffer.

19. A video signal decoding arrangement for decoding a data stream comprising a series of sets of data containing delimiting codes into a series of images, according to claim 18, wherein the video data processor omits reassigning the first and second pointers in response to an error in the data stream.

20. An artifact concealment method for concealing artifacts in decoded video signal data, the artifact concealment method comprising:

detecting an error in a data stream including first and second sets of data representing images, the error affecting the second set of data such that the second set of data includes a corrupted data segment;

replacing the corrupted data segment with a replacement data segment generated as a function of the first set of data, thereby generating a modified second set of data;

storing the first and modified second sets of data as first and second images; and

locating a delimiting code corresponding to a third set of data representing an image in the data stream.

21. An artifact concealment method for concealing artifacts in decoded video signal data, according to claim 20, further comprising storing the first and second images in a memory.

22. An artifact concealment method for concealing artifacts in decoded video signal data, according to claim 20, wherein the delimiting code comprises a start code.

23. An artifact concealment method for concealing artifacts in decoded video segment data, according to claim 20, further comprising copying the replacement data segment from the first set of data.

24. An artifact concealment method for concealing artifacts in decoded video segment data, according to claim 20, further comprising:

using a multiplexing arrangement to detect the error in the data stream; and

providing an indication of characteristics of the error.

25. An artifact concealment method for concealing artifacts in decoded video signal data, according to claim 20, further comprising

selectively storing the first and second images in first and second memories in response to a first pointer, and

selectively displaying the image stored in the first memory or the image stored in the second memory in response to a second pointer.

26. An artifact concealment method for concealing artifacts in decoded video signal data, according to claim 25, wherein the first pointer points to one of the first and second memories and the second pointer points to another of the first and second memories.

27. An artifact concealment method for concealing artifacts in decoded video signal data, according to claim 26, further comprising reassigning the first and second pointers in response to receiving a subsequent set of data in the data stream, such that the first pointer points alternately to the first memory or the second memory.

28. An artifact concealment method for concealing artifacts in decoded video signal data, according to claim 27, further comprising omitting the step of reassigning the first and second pointers in response to an error in the data stream.

29. A video signal processing arrangement for decoding a data stream into a series of images, the video signal processing arrangement comprising:

an error detecting arrangement configured and arranged to detect an error in the data stream and to output an indication of the error;

a memory arranged to store a current image and a previous image;

a video decoder adapted to respond to the data stream and to the previous image and to generate the current image from the data stream and from a prediction based on the previous image; and

an error concealment arrangement, responsive to the indication output by the error detecting arrangement, adapted and configured to identify a corrupt segment of the current image and replace the corrupt segment with a replacement segment generated as a function of the previous image.

30. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 29, wherein the error detecting arrangement comprises a demultiplexing arrangement.

31. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 29, wherein the error concealment arrangement is adapted to copy the replacement segment from the previous image to the current image.

32. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 29, wherein the error concealment arrangement is adapted to predict the replacement segment from the previous image and from motion information.

33. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 29, wherein the video decoder is adapted to receive an error indication from the error detecting arrangement and subsequently resynchronize with the data stream by locating the next start code.

34. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 29, wherein the error detecting arrangement is implemented as part of the video decoder.

35. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 34, wherein the error detecting arrangement is adapted to detect an error by identifying illegal codewords in the data stream.

36. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 34, wherein the error detecting arrangement is adapted to detect an error by identifying a misplaced start code in the data stream.

37. A video signal processing arrangement for decoding a data stream into a series of images, according to claim 36, wherein the video decoder is adapted to maintain a running count of consecutive zeros in the data stream in order to identify a misplaced start code.

38. A video signal processing arrangement for decoding a data stream into a series of images, comprising:

error detecting means for detecting an error in the data stream and to output an indication of the error;

a memory arranged to store a current image and a previous image;

video means, responsive to the data stream and to the previous image, for generating the current image from the data stream and from a prediction based on the previous image; and

error concealment means, responsive to the indication output by the error detecting means for identifying a corrupt segment of the current image and replace the corrupt segment with a replacing segment generated as a function of the previous image.

39. A video signal processing method for decoding a data stream into a series of images, comprising:

detecting an error in the data stream and to output an indication of the error;

storing a current image;

storing a previous image;

responsive to the data stream and to the previous image, generating the current image from the data stream and from a prediction based on the previous image; and

responsive to the indication of the error, identifying a corrupt segment of the current image and replace the corrupt segment with a replacing segment generated as a function of the previous image.