ERROR CONCEALMENT OF PLURAL PROCESSED REPRESENTATIONS OF A SINGLE VIDEO SIGNAL RECEIVED IN A VIDEO PROGRAM

• US 20100118973A1
• Filed: 11/12/2009
• Published: 05/13/2010
• Est. Priority Date: 11/12/2008
• Status: Active Grant

• Current Assignee: Tech 5 SAS
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rodriguez, Arturo A., Shepherd, Gregory, Cook, Benjamin M.
• Granted Patent: US 8,320,465 B2
• Time in Patent Office: Days
• US Class Current: 375/240.250
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/88 involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

In one embodiment, a method that includes receiving a single video stream, wherein the video stream includes plural processed representations of a single video signal, wherein each of the plural processed representations of the video signal (PPROTVS) includes a respective sequence of compressed latticed pictures, wherein each compressed latticed picture of each of the PPROTVS represents a corresponding respective picture of the video signal, wherein each respective picture of the video signal is represented by at most one compressed latticed picture from each of the PPROTVS, wherein corresponding segments of the PPROTVS are ordered and time shifted relative to each other to facilitate error concealment, the time-shift imposed by interspersing of non-corresponding segments between each of the corresponding segments; and providing error concealment on the received video stream.

Claims

1. A method, comprising:

receiving a single video stream, wherein the video stream includes plural processed representations of a single video signal, wherein each of the plural processed representations of the video signal (PPROTVS) includes a respective sequence of compressed latticed pictures, wherein each compressed latticed picture of each of the PPROTVS represents a corresponding respective picture of the video signal, wherein each respective picture of the video signal is represented by at most one compressed latticed picture from each of the PPROTVS, wherein corresponding segments of the PPROTVS are ordered and time shifted relative to each other to facilitate error concealment, the time-shift imposed by interspersing of non-corresponding segments between each of the corresponding segments; and

providing error concealment on the received video stream.

2. The method of claim 1, wherein the ordering is based on a size of a predetermined data loss interval of a transmission channel, an amount of time of the predetermined data loss interval, or a combination of both.

3. The method of claim 2, wherein the data loss interval includes a time interval during which data in a video stream exhibits errors, is lost, corrupted, or unavailable.

4. The method of claim 1, wherein the receiving includes receiving within each of first successive plural, non-overlapping segments distribution intervals (SDIs) no more than one segment of a first complete set of the corresponding segments and the one or more of non-corresponding segments, the receiving of the first complete set occurring over a minimum set of successive continuous SDIs.

5. The method of claim 4, wherein responsive to an error within a first segment in the SDI, repeatedly displaying a decompressed version of a first compressed latticed picture of an oldest segment beginning approximately from a respective location within the segment where the error occurred and ending at a location corresponding to the last picture just prior to where the error occurred, and further comprising repeatedly displaying a decompressed version of the last compressed latticed picture until decoding of a next successive SDI is commenced, the oldest segment corresponding to the respective compressed latticed pictures of the segment in each SDI having the earlier picture output span.

6. The method of claim 4, wherein responsive to an error to a first compressed latticed picture of an oldest segment in the SDI, delaying decoding until a first compressed latticed picture of an oldest segment in a next successive SDI is to commence decoding, the oldest segment corresponding to the respective compressed latticed pictures of the segment in each SDI having the earlier picture output span.

7. The method of claim 4, wherein receiving comprises receiving more than one compressed intracoded latticed picture in an oldest segment of each SDI such that an impairment to the first compressed intracoded latticed picture results in decoding to commence at the next successive compressed intracoded latticed picture, the oldest segment corresponding to the respective compressed latticed pictures of the segment in each SDI having the earlier picture output span.

8. A system, comprising:

a memory having executable instructions; and

one or more processors configured to execute the instructions, the instructions causing the one or more processors to;

receive a video stream, wherein the video stream includes plural processed representations of a single video signal, wherein each of the plural processed representations of the video signal (PPROTVS) includes a respective sequence of compressed latticed pictures, wherein each compressed latticed picture of each of the PPROTVS represents a corresponding respective picture of the video signal, wherein each respective picture of the video signal is represented by at most one compressed latticed picture from each of the PPROTVS, wherein corresponding segments of the PPROTVS are ordered and time shifted relative to each other to facilitate error concealment, the time-shift imposed by interspersing of non-corresponding segments between each of the corresponding segments; and

provide error concealment on the received video stream.

9. The system of claim 8, wherein the one or more processors are further configured to order the segments based on a size of a predetermined data loss interval of a transmission channel, an amount of time of the predetermined data loss interval, or a combination of both.

10. The system of claim 9, wherein the data loss interval includes a time interval during which data in a video stream exhibits errors, is lost, corrupted, or unavailable.

11. The system of claim 8, wherein the one or more processors are further configured to receive within each of first successive plural, non-overlapping segments distribution intervals (SDIs) no more than one segment of a first complete set of the corresponding segments and the one or more of non-corresponding segments, the receiving of the first complete set occurring over a minimum set of successive continuous SDIs.

12. The system of claim 11, wherein responsive to an error within a first segment in the SDI, the one or more processors are further configured to repeatedly output for display on a display device a decompressed version of a first compressed latticed picture of an oldest segment beginning approximately from a respective location within the segment where the error occurred and ending at a location corresponding to the last picture just prior to where the error occurred, and further repeatedly output for display on the display device a decompressed version of the last compressed latticed picture until decoding of a next successive SDI is commenced, the oldest segment corresponding to the respective compressed latticed pictures of the segment in each SDI having the earlier picture output span.

13. The system of claim 11, wherein responsive to an error to a first compressed latticed picture of an oldest segment in the SDI, the one or more processors are further configured to delay decoding until a first compressed latticed picture of an oldest segment in a next successive SDI is to commence decoding, the oldest segment corresponding to the respective compressed latticed pictures of the segment in each SDI having the earlier picture output span.

14. The system of claim 11, wherein the one or more processors are further configured to receive more than one compressed intracoded latticed picture in an oldest segment of each SDI such that an impairment to the first compressed intracoded latticed picture results in decoding to commence at the next successive compressed intracoded latticed picture, the oldest segment corresponding to the respective compressed latticed pictures of the segment in each SDI having the earlier picture output span.

17. The system of claim 8, wherein responsive to a compressed latticed picture exhibiting one or more partial-picture impairments, the one or more processors are further configured to upscale one or more portions of a single decoded non-impaired latticed picture to compensate for the respective spatially-corresponding impaired portions in the impaired compressed latticed picture.

18. The system of claim 8, wherein for p corresponding segments, where p is equal to the number of PPROTVS, the one or more processors are further configured to upscale the decoded versions of (p -1) non-impaired corresponding compressed latticed pictures to compensate for one or more impairments in the corresponding p-th compressed latticed picture.

19. The system of claim 8, wherein for p corresponding segments, where p is equal to the number of PPROTVS, and wherein responsive to two corresponding compressed latticed pictures in the received video stream exhibiting impairments, the one or more processors are further configured to individually upscale one or more of the (p-2) corresponding decoded latticed pictures to compensate for the impairments.

20. The system of claim 8, wherein for p equal to the number of PPROTVS, the respective k-th compressed latticed pictures in each of p received PPROTVS are corresponding compressed latticed pictures, and wherein a relative temporal order of the p corresponding k-th compressed latticed pictures is determined by the one or more processors from received auxiliary information, wherein spatial relationships of the decoded versions of the p corresponding k-th compressed latticed pictures are also determined by the one or more processors from the same received auxiliary information.