Processing of a video program having plural processed representations of a single video signal for reconstruction and output

• US 8,259,814 B2
• Filed: 11/12/2009
• Issued: 09/04/2012
• Est. Priority Date: 11/12/2008
• Status: Expired due to Fees

• Current Assignee: Tech 5 SAS
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rodriguez, Arturo A., Shepherd, Gregory, Cook, Benjamin M.
• Primary Examiner(s): Czekaj, David
• Assistant Examiner(s): Beck, Leron
• Application Number:
  US12/617,062
• Publication Number:
  US 20100118974A1
• Time in Patent Office: 1,027 Days
• Field of Search: 375/240.25, 725/145
• US Class Current: 375/240.25
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/88 involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

In one embodiment, a method that includes receiving a single video stream, wherein the video stream includes plural processed representations of a video signal, wherein each of the plural processed representations of the video signal (PPROTVS) includes a respective sequence of processed latticed pictures, wherein each processed latticed picture of each of the PPROTVS represents a corresponding respective picture of the video signal, wherein each respective picture of the video signal is represented by at most one processed latticed picture in each of the PPROTVS, wherein plural consecutive non-overlapping segments of one of the PPROTVS are received in a single video stream, each separated by one or more consecutive, non-overlapping segments of the other PPROTVS received in the single video stream; and outputting the plural segments in decompressed format in output picture order.

Claims

1. A method, comprising:

receiving a single video stream at a communications system, wherein the video stream includes plural processed representations of a video signal, wherein each of the plural processed representations of the video signal (PPROTVS) includes a respective sequence of processed latticed pictures, wherein each processed latticed picture of each of the PPROTVS represents a corresponding respective picture of the video signal, wherein each respective picture of the video signal is represented by at most one processed latticed picture in each of the PPROTVS, wherein plural consecutive non-overlapping segments of one of the PPROTVS are received in a single video stream, each separated by one or more consecutive, non-overlapping segments of the other PPROTVS received in the single video stream, wherein each of all of the plural segments representing the same segment of pictures of the video signal is received in successive non-overlapping segment-distribution intervals (SDIs), wherein all successive non-overlapping segments in each of the successive SDIs represent a different segment of pictures of the video signal, wherein a first complete set of representations of a first segment of the video signal is received over a number of successive SDIs equal to number of representations in the first complete set, and wherein the aggregate number of pixels in the decompressed version of all pictures that correspond to the same picture of the video signal in the first complete set equals the number of pixels of the corresponding picture of the video signal, wherein responsive to receiving a first segment of the plural successive SDIs, wherein the oldest segment corresponds to processed latticed pictures having the earliest picture output span;

decompressing the processed latticed pictures of the first segment;

forming pictures by de-latticing the decompressed pictures of the first segment; and

providing the de-latticed pictures of the first segment for display at a partial picture resolution of the corresponding pictures of the video signal, the partial resolution corresponding to a picture resolution of lip, where p equals the number of PPROTVS;

wherein responsive to receiving a second segment of the first complete set, wherein a first segment of a previous SDI has been previously buffered and the second segment is the oldest segment of one of the plural successive SDIs, wherein the oldest corresponds to processed latticed pictures having the earliest picture output span;

decompressing the processed latticed pictures of the second segment and the first segment;

de-latticing the decompressed pictures of the first and second segments; and

providing the de-latticed pictures of the first and second segments for display at a partial picture resolution of the corresponding pictures of the video signal, the partial picture resolution corresponding to a picture resolution of 2/p, where p equals the number of PPROTVS; and

outputting the plural segments in decompressed format in output picture order.

2. The method of claim 1, wherein the number of processed latticed pictures is the same in each of a plurality of received non-overlapping segments.

3. The method of claim 1, wherein the received segments comprise a first complete set of corresponding processed latticed pictures received over first successive plural, non-overlapping segments-distribution intervals (SDIs), wherein the aggregate number of pixels in all pictures that correspond to the same picture of the video signal in the decompressed version of the first complete set equals the number of pixels of the corresponding picture of the video signal, wherein receiving includes receiving within each of the first successive plural, non-overlapping SDIs at most one segment of the first complete set and the one or more of the segments of the other PPROTVS, the receiving of the first complete set occurring over a minimum set of successive continuous SDIs.

4. The method of claim 3, wherein responsive to receiving a last segment of the first complete set:

decompressing the processed latticed pictures of the first complete set;

forming pictures by de-latticing the decompressed pictures of the first complete set, wherein each formed picture includes pixels corresponding to all of the decompressed pictures that correspond to the same picture of the video signal; and

providing the formed pictures from the first complete set for display.

5. The method of claim 4, wherein receiving further comprises receiving auxiliary information corresponding to the video stream, the received auxiliary information providing spatial relationships in the formed pictures for the pixels from all of the decompressed pictures that correspond to the same picture of the video signal.

6. The method of claim 4, wherein receiving further comprises receiving auxiliary information corresponding to the video stream, the received auxiliary information corresponding to the identification of segments in the video stream that correspond to each respective representation of the video signal.

7. The method of claim 6, wherein the received auxiliary information provides for the identification of the temporal order of the non-overlapping segments in the video stream, wherein the relative temporal order of the segments specify one or more of the actual order of the start, end, or completion of each of the segments in successive SDIs.

8. The method of claim 4, wherein receiving further comprises receiving auxiliary information corresponding to the video stream, the received auxiliary information corresponding to a minimum set of the successive continuous SDIs that provide the first complete set, wherein the number of processed latticed pictures is the same in each of a plurality of received non-overlapping segments.

9. The method of claim 1, wherein the pixels in the decompressed version of each picture in the first complete set corresponds to a respective set of pixels in the original video, said respective set of pixels in the original video not corresponding to any other set of pixels in the decompressed version of the first complete set.

10. The method of claim 3, wherein the received segments comprises a second complete set of corresponding processed latticed pictures over second successive plural, non-overlapping SDIs, wherein the first complete set and the second complete set include at least one SDI that is common to both complete sets.

11. The method of claim 3, wherein the segments received within each of the SDIs are received according to a first temporal order, the first temporal order from oldest to youngest, wherein the oldest corresponds to the processed latticed pictures having the earliest picture output span, wherein the youngest corresponds to the processed pictures having the latest picture output span.

12. The method of claim 3, wherein the segments received among the plural SDIs are received according to a second temporal order, wherein the second temporal order corresponds to a first segment of the first complete set received in time shifted manner relative to a second segment of the first complete set.

13. A system, comprising:

a memory having executable instructions; and

one or more processors configured to execute the instructions, the instructions causing the one or more processors to;

receive plural representations of a single video signal, the video signal comprising plural sequenced pictures corresponding to at least a portion of a video program, wherein each of the plural representations of the video signal (PROTVS) includes a respective sequence of latticed pictures, wherein each latticed picture in each of the PROTVS represents a corresponding respective picture of the video signal;

process the PROTVS;

provide in a video stream plural corresponding segments of the processed PROTVS (PPROTVS) by segmenting the PPROTVS and arranging the segmented PPROTVS among plural, successive segments distributions intervals (SDIs), the plural corresponding segments separated from each other by one or more non-corresponding segments, wherein a first complete set of representations of a first segment of the video signal is provided over a number of successive SDIs equal to number of representations in the first complete set, wherein the oldest segment corresponds to processed latticed pictures having the earliest picture output span, wherein receipt of the first segment triggers;

decompressing the processed latticed pictures of the first segment;

forming pictures by de-latticing the decompressed pictures of the first segment; and

providing the de-latticed pictures of the first segment for display at a partial picture resolution of the corresponding pictures of the video signal, the partial resolution corresponding to a picture resolution of 1/p, where p equals the number of PPROTVS;

wherein receipt of a second segment of the first complete set and wherein a first segment of a previous SDI has been previously buffered and the second segment is the oldest segment of one of the plural successive SDIs, wherein the oldest corresponds to processed latticed pictures having the earliest picture output span triggers;

decompressing the processed latticed pictures of the second segment and the first segment;

de-latticing the decompressed pictures of the first and second segments; and

providing the de-latticed pictures of the first and second segments for display at a partial picture resolution of the corresponding pictures of the video signal, the partial picture resolution corresponding to a picture resolution of 2/p, where p equals the number of PPROTVS.

14. The system of claim 13, wherein each of the plural successive SDIs consists of plural non-overlapping segments, each of the plural non-overlapping segments consisting of exactly one of the plural corresponding segments and the one or more of the non-corresponding segments, wherein the processed latticed pictures of each of the respective PPROTVS each originate from a different picture of the video signal.

15. A method, comprising:

receiving plural representations of a single video signal at a communications system, the video signal comprising plural sequenced pictures corresponding to at least a portion of a video program, wherein each of the plural representations of the video signal (PROTVS) includes a respective sequence of latticed pictures, wherein each latticed picture in each of the PROTVS represents a corresponding respective picture of the video signal;

segmenting the PROTVS;

arranging the segmented PROTVS (SPROTVS) among plural, successive segments distributions intervals (SDIs), the arranged SPROTVS (ASPROTVS) comprising plural corresponding segments separated from each other by one or more non-corresponding segments;

processing the ASPROTVS, wherein a first complete set of representations of a first segment of the video signal is provided over a number of successive SDIs equal to number of representations in the first complete set, wherein the oldest segment corresponds to processed latticed pictures having the earliest picture output span; and

providing the processed ASPROTVS in a video stream, wherein receipt of the first segment triggers;

decompressing the processed latticed pictures of the first segment;

forming pictures by de-latticing the decompressed pictures of the first segment; and

providing the de-latticed pictures of the first segment for display at a partial picture resolution of the corresponding pictures of the video signal, the partial resolution corresponding to a picture resolution of 1/p, where p equals the number of ASPROTVS.

16. The method of claim 15, wherein arranging further comprises:

arranging the SPROTVS according to a first temporal order that specifies a temporal relationship between one or more of the segments included in each of the plural, successive SDIs; and

arranging the SPROTVS according to a second temporal order, the second temporal order specifying the order of each set of p corresponding segments over each set of p successive SDIs, wherein p equals the number of plural representations, wherein the relative transmission order of the successive processed latticed pictures in each of the corresponding p processed plural representations is the same.