PROCESSING OF IMPAIRED AND INCOMPLETE MULTI-LATTICED VIDEO STREAMS

• US 20100003015A1
• Filed: 06/17/2008
• Published: 01/07/2010
• Est. Priority Date: 06/17/2008
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rodriguez, Arturo A., Shepherd, Gregory
• Granted Patent: US 8,971,402 B2
• Time in Patent Office: Days
• US Class Current: 386/113
• CPC Class Codes: H04L 1/0045 Arrangements at the receiver end
• CPC Class Codes: H04N 19/65 using error resilience
• CPC Class Codes: H04N 19/66 involving data partitioning, i.e. separation of data into packets or partitions according to importance
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/26275 for distributing content or additional data in a staggered manner, e.g. repeating movies on different channels in a time-staggered manner in a near video on demand system
• CPC Class Codes: H04N 21/64322 IP

Abstract

An apparatus for facilitating reception of multiple representations of a video signal. In one embodiment, the apparatus includes a mechanism for receiving plural representations of the video signal corresponding to plural decimated versions of the video signal, associating pictures of the received plural representations of the video signal, and outputting pictures corresponding to information from associated pictures in accordance with a relative temporal order.

Claims

1. A method for receiving and outputting one or more representations of a video signal in a video stream, the method comprising:

receiving a video stream, wherein the video stream includes one or more representations of a video signal, wherein each of the one or more representations of the video signal (OOMROTVS) includes a respective sequence of compressed pictures, wherein each of the OOMROTVS represents a respectively corresponding decimated version of the video signal, wherein each compressed picture of each of the OOMROTVS represents a respectively corresponding decimated picture of the video signal, wherein each respective picture of the video signal is represented by at most one compressed picture of each of the OOMROTVS; and

outputting plural reconstructed pictures, wherein each of the plural reconstructed pictures comprises information corresponding to one or more received compressed pictures that represent the same respective picture of the video signal, wherein each of the plural reconstructed pictures is reconstructed in accordance with plural pixel sampling lattices (PPSL), wherein each of the PPSL respectively corresponds to a decimated version of the video signal, and wherein each of the plural reconstructed pictures corresponds to a respective picture of the video signal.

2. The method of claim 1, further comprising:

determining at least one impaired portion of a first received compressed picture that represents a first picture of the video signal; and

outputting a first reconstructed picture corresponding to the first picture of the video signal, wherein the first reconstructed picture excludes information corresponding to the at least one determined impaired portion of the first received compressed picture (ALODIPOTFRCP).

3. The method of claim 2, wherein the first reconstructed picture comprises information corresponding to a first plurality of received compressed pictures (FPORCP), and wherein each of the FPORCP represents the first picture of the video signal.

4. The method of claim 3, wherein each of the FPORCP respectively corresponds to one of the PPSL, and wherein the information corresponding to each of the FPORCP is included in the first reconstructed picture in accordance with its respectively corresponding pixel sampling lattice.

5. The method of claim 4, further comprising:

deriving information from a first set of one or more received compressed pictures of the FPORCP, wherein the first set excludes the first received compressed picture; and

including in one or more pixel locations of the first reconstructed picture the derived information, wherein the one or more pixel locations of the first reconstructed picture respectively correspond to one or more pixel locations of the ALODIPOTFRCP.

6. The method of claim 3, wherein the FPORCP excludes the first received compressed picture.

7. The method of claim 1, wherein the number of pixel sampling lattices in the PPSL is greater than the number of representations of the video signal in the received video stream.

8. The method of claim 7, wherein each of a first set of pixel sampling lattices in the PPSL respectively corresponds to the OOMROTVS in the received video stream, wherein a second set of pixel sampling lattices includes all of the PPSL except for the first set of pixel sampling lattices, and further comprising:

deriving information from the received compressed pictures of the OOMROTVS, and

including the derived information in plural pixel locations of the plural reconstructed pictures, wherein the plural pixel locations of the plural reconstructed pictures correspond to the second set of pixel sampling lattices. for each of the plural reconstructed pictures.

9. The method of claim 1, wherein at least one of the plural reconstructed pictures comprises information corresponding to only one compressed picture that represents a first picture of the video signal.

10. The method of claim 2, wherein the first received compressed picture corresponds to a first representation of the video signal (FROTVS), and further comprising:

outputting a second reconstructed picture corresponding to a second picture of the video signal, wherein the second reconstructed picture comprises of information corresponding to a first set of one or more received compressed pictures that represent the second picture of the video signal, and wherein the first set includes a compressed picture of the FROTVS.

11. The method of claim 1, further comprising:

outputting a first reconstructed picture, wherein the first reconstructed picture corresponds to a first picture of the video signal, wherein the first reconstructed picture comprises of information corresponding to a first set one or more received compressed pictures (FSOOOMRCP) that represent the first picture of the video signal, and wherein none of FSOOOMRCP are impaired;

outputting a second reconstructed picture, wherein the second reconstructed picture corresponds to a second picture of the video signal, wherein the second reconstructed picture comprises of information corresponding to a second set of one or more received compressed pictures (SSOOOMRCP) that represent the second picture of the video signal, wherein at least a portion of one of the compressed pictures in the SSOOOMRCP is impaired; and

deriving information from non-impaired information of the SSOOOMRCP;

wherein the second reconstructed picture includes the derived information.

12. A method for reconstructing and outputting a received multi-latticed video signal, the method comprising:

receiving a video stream, wherein the video stream includes one or more representations of a video signal, wherein each of the one or more representations of the video signal (OOMROTVS) includes a respective sequence of pictures, wherein each picture of each of the OOMROTVS represents a respectively corresponding picture of the video signal;

generating plural decompressed pictures of the OOMROTVS, wherein each of the plural decompressed pictures is a decompressed version of a respectively corresponding received picture of the OOMROTVS, wherein each decompressed picture represents the same picture of the video signal as its respectively corresponding received picture;

determining plural sets of one or more associated pictures, wherein each picture in each determined set of one or more associated pictures (DSOOOMAP) represents the same respective picture of the video signal, wherein each respective DSOOOMAP includes at most one picture of each of the OOMROTVS; and

outputting plural reconstructed pictures, wherein each of the plural reconstructed pictures respectively corresponds to a DSOOOMAP, wherein each of the plural reconstructed pictures comprises information corresponding to one or more decompressed pictures of its respectively corresponding DSOOOMAP.

13. The method of claim 12, wherein over a first time interval a first representation of the video signal (FROTVS) is received in the video stream, wherein over a second interval a second representation of the video signal (SROTVS) is received in the video stream, wherein the received FROTVS includes at least an impaired portion, wherein each successive received picture of the FROTVS and each successive received picture of the SROTVS are determined to be associated pictures, and further comprising:

outputting reconstructed pictures corresponding to the associated pictures of the FROTSVS and SROTVS without information corresponding to decompressed pictures from the at least impaired portion of the FROTSVS.

14. The method of claim 12, wherein each of the plural reconstructed pictures is reconstructed in accordance with plural pixel sampling lattices (PPSL), wherein each of the PPSL is associated with a respectively corresponding representation of a video signal, and wherein the number of pixel sampling lattices in the PPSL is greater than the number of representations of the video signal in the received video stream.

15. The method of claim 12, wherein each of the plural reconstructed pictures is reconstructed in accordance with plural pixel sampling lattices (PPSL), wherein each of the PPSL is associated with a decimated version of each respective picture of the video signal, and wherein each picture in each DSOOOMAP corresponds to a decimated version of each respective picture of the video signal.

16. The method of claim 15, wherein a first reconstructed pictures comprises information corresponding to a first plurality of decompressed pictures, and wherein the number of decompressed pictures in the first plurality of decompressed pictures equals the number of pixel sampling lattices in the PPSL.

17. The method of claim 16, wherein a second reconstructed pictures comprises information corresponding to a second plurality of decompressed pictures, and wherein the number of decompressed pictures in the second plurality of decompressed pictures is less than the number of pixel sampling lattices in the PPSL.

18. The method of claim 16, wherein each decompressed picture in the second plurality of decompressed pictures respectively corresponds one of the PPSL, wherein the second reconstructed pictures further comprises of derived information from the second plurality of decompressed pictures, and wherein the derived information is included in pixel locations of the second reconstructed picture corresponding to a subset of the PPSL not corresponding to second plurality of decompressed pictures.

19. An apparatus for receiving and outputting plural representations of a video signal in a video stream, the apparatus comprising:

a processor;

a processor-readable medium including one or more instructions for;

receiving a video stream, wherein the video stream includes plural representations of a video signal, wherein each of the plural representations of the video signal (PROTVS) includes a respective sequence of compressed pictures, wherein each of the PROTVS is associated with a respective pixel sampling lattice used to decimate each picture of the video signal, wherein each compressed picture of each of the PROTVS represents a respectively corresponding decimated picture of the video signal;

determining plural sets of one or more associated compressed pictures of the PROTVS, wherein each compressed picture in each determined set of one or more associated compressed pictures (DSOOOMACP) represents the same respective picture of the video signal, wherein each respective DSOOOMACP includes at most one received compressed picture of each of the PROTVS; and

outputting plural pictures, wherein each output picture respectively corresponds to a DSOOOMACP, wherein a first plurality of pixels of each output picture comprises of information corresponding to the respective decompressed version of the compressed pictures in the respectively corresponding DSOOOMACP, and a second plurality of the pixels of each output picture comprises of information derived from the compressed pictures in the respectively corresponding DSOOOMACP.

20. The apparatus of claim 19, wherein second plurality of the pixels of each output picture corresponds to impaired pixels in the one or more received compressed pictures that represent the same respective picture of the video signal.

21. The apparatus of claim 19, wherein the number of compressed pictures in at least one DSOOOMACP respectively corresponding to an output picture is less than a number of compressed pictures in plural transmitted representations of a video signal in the video stream.