Time-shifted transport of multi-latticed video for resiliency from burst-error effects

• US 8,705,631 B2
• Filed: 06/17/2008
• Issued: 04/22/2014
• Est. Priority Date: 06/17/2008
• Status: Expired due to Fees

• Current Assignee: Tech 5 SAS
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Shepherd, Gregory, Rodriguez, Arturo A.
• Primary Examiner(s): Elliott, IV, Benjamin H
• Application Number:
  US12/141,015
• Publication Number:
  US 20090313668A1
• Time in Patent Office: 2,135 Days
• Field of Search: 375240-241
• US Class Current: 375/240.21
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/166 concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/88 involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder

Abstract

An apparatus for facilitating robust data transport. In one embodiment, the apparatus includes a first mechanism for selecting plural lattices of an input video signal, processing plural decimated video signals, and time shifting corresponding portions of plural video streams in accordance with a second relative temporal order. A second mechanism changes an initial relative temporal order to the second relative temporal order.

Claims

1. A method for providing digital video data, the method comprising:

selecting plural representations of a video signal, wherein each of the plural representations includes a respective sequence of pictures, wherein each picture in each of the plural representations originates from a corresponding respective picture of the video signal, wherein the order of successive pictures in each of the selected plural representations of the video signal corresponds to the order of successive pictures in the video signal;

processing the selected plural representations of the video signal, wherein processing comprises selectively shifting, in time, at least a first, selected plural representation of the video signal relative to a second, selected plural representation of the video signal different from the first, selected plural representation of the video signal, wherein selectively shifting is enabled by auxiliary information identifying a plurality of lattices, wherein the auxiliary information includes information indicating how decoded versions of compressed video frame partitions are to be assembled into a larger frame, wherein the auxiliary information further includes information indicating the relative temporal order of the plurality of lattices and corresponding segments in the video signal;

processing second auxiliary information different from the previously processed auxiliary information, wherein the second auxiliary information providing spatial relationship information for the decoded versions of compressed video; and

providing in a video stream a first plurality of the processed pictures of a second representation of the video signal (SROTVS) after providing at least a portion of a first plurality of the processed pictures of a first representation of the video signal (FROTVS).

2. The method of claim 1, further comprising:

providing in the video stream a second plurality of the processed pictures of the SROTVS after providing at least a portion of a second plurality of the processed pictures of the FROTVS, wherein the first provided picture of the second plurality of the processed pictures of the SROTVS is provided after the last provided picture from the first plurality of the processed pictures of the SROTVS.

3. The method of claim 2, wherein the order of providing the processed pictures of the FROTVS and SROTVS in the video stream is in accordance with each successively provided picture from the FROTVS originating respectively from the same picture of the video signal as each successively provided picture from the SROTVS.

4. The method of claim 3, wherein each successively provided picture of the first plurality of the processed pictures of the FROTVS in the video stream corresponds to a respective picture in a first set of consecutive pictures of the video signal, and wherein each successively provided picture of the second plurality of the processed pictures of the FROTVS in the video stream corresponds to a respective picture in a second set of consecutive pictures of the video signal, and wherein the first picture of the second set immediately follows the last picture of the first set of consecutive pictures of the video signal.

5. The method of claim 4, wherein successively provided pictures of the second plurality of the processed pictures of the FROTVS are provided in the video stream while successively providing pictures of the first plurality of the processed pictures of the SROTVS.

6. The method of claim 2, wherein each of the selected plural representations of the video signal corresponds to a respective decimated version of the video signal.

7. The method of claim 6, wherein each said decimated version of the video signal corresponds to a respective pixel sampling lattice mapped to each picture of the video signal.

8. The method of claim 7, wherein the first provided picture from the first plurality of the processed pictures of the SROTVS is provided in the video stream after the last provided picture from the first plurality of the processed pictures of the FROTVS.

9. The method of claim 8, wherein the first provided picture from the first plurality of the processed pictures of the SROTVS is provided in the video stream while providing the first picture from the second plurality of the processed pictures of the FROTVS.

10. The method of claim 2, wherein the first provided picture from the first plurality of the processed pictures of the SROTVS is provided in the video stream prior to the first provided picture from the second plurality of the processed pictures of the FROTVS.

11. The method of claim 10, wherein the first provided picture from the first plurality of the processed pictures of the SROTVS is provided in the video stream while providing a picture from the first plurality of the processed pictures of the FROTVS.

12. A method for providing digital video data, the method comprising:

partitioning a video signal into plural representations of the video signal, wherein the video signal includes successive pictures, wherein each representation corresponds respectively to a decimated version of the video signal, wherein each successive picture of the video signal is partitioned into plural decimated versions of the picture, wherein each of the plural decimated versions of each successive picture of the video signal is respectively assigned as a picture to a corresponding representation of the video signal (ROTVS);

compressing the plural representations of the video signal into plural video streams, wherein each ROTVS is compressed into a respectively corresponding video stream, wherein the plural video streams include a first video stream and a second video stream;

processing the plural representations of the video signal, wherein processing comprises selectively shifting, in time, at least a first, selected plural representation of the video signal relative to a second, selected plural representation of the video signal different from the first, selected plural representation of the video signal, wherein selectively shifting is enabled by auxiliary information identifying a plurality of lattices; and

providing over a first interval plural portions of the plural video streams, wherein at least a portion of a first compressed picture from the first video stream is provided over the first time interval while providing at least a portion of a first compressed picture from the second video stream.

13. The method of claim 12, wherein the providing over the first time interval plural portions of the plural video streams comprises of providing at most one portion from each of the plural video streams over the first interval, and wherein each provided portion over the first interval is from at most one compressed picture.

14. The method of claim 13, wherein the plural portions of the plural video streams provided over the first interval correspond respectively to compressed pictures that originated from different pictures of the video signal.

15. The method of claim 13, wherein the first compressed picture from the first video stream and the first compressed picture from the second video stream originated from the same picture of the video signal.

16. The method of claim 14, further comprising:

providing over a second interval plural portions of the plural video streams, wherein at least a portion of a second compressed picture from the first video stream is provided over the second time interval while providing at least a portion of a second compressed picture from the second video stream, wherein at most one portion from each of the plural video streams is provided over the second interval, wherein each provided portion over the second interval is from at most one compressed picture, and wherein the second compressed picture from the first video stream and the second compressed picture from the second video stream originated from the same picture of the video signal.

17. A system for providing digital video data, comprising:

a processor comprising;

a video partitioning module configured to;

provide plural decimated versions of each successive picture of an input video signal;

assign each of the plural decimated versions of each successive picture of the input video signal as a picture to a respectively corresponding decimated video signal; and

provide plural decimated video signals corresponding respectively to plural decimated versions of the input video signal, wherein the plural decimated video versions correspond to different representations of the input video signal;

an encoder configured to;

compress each of the plural decimated video signals into a corresponding video stream independent of the pictures assigned to other decimated video signals;

process the plural representations of the video signal, wherein processing comprises selectively shifting, in time, at least a first, selected plural representation of the video signal relative to a second, selected plural representation of the video signal different from the first, selected plural representation of the video signal, wherein selectively shifting is enabled by auxiliary information identifying a plurality of lattices;

provide plural video streams corresponding respectively to the plural decimated video streams; and

a transmitter configured to provide in each of plural intervals a portion from each of the plural video streams, wherein the plural intervals include a first interval and a second interval, wherein in each of the plural intervals each provided portion from each of the plural video streams includes at least one compressed picture.

18. The system of claim 17, wherein the transmitter is further configured to provide in each of plural successive intervals a respective set of compressed pictures corresponding to a first plurality of consecutive pictures of the input video signal, and wherein each of the provided respective sets of compressed pictures corresponds to a different video stream.

19. The system of claim 17, wherein the transmitter is further configured to provide in each of plural successive intervals a successive portion from each of the plural video streams.

20. The system of claim 19, wherein the transmitter is further configured to:

provide in the first time interval two compressed pictures that originated from different decimated versions of the same picture of the input video signal, and

provide in the second time interval compressed pictures that originated from decimated versions of different pictures of the input video signal.