Video processing with tiered interdependencies of pictures

• US 8,718,388 B2
• Filed: 12/11/2008
• Issued: 05/06/2014
• Est. Priority Date: 12/11/2007
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rodriguez, Arturo A., Cook, Benjamin M., Eppinett, Ken L., Bean, John R.
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US12/333,301
• Publication Number:
  US 20090148056A1
• Time in Patent Office: 1,972 Days
• Field of Search: 382/190, 382/232, 382/233, 382/235, 375/240.01, 375/240.12, 375/240.15, 375/240.25, 375/240.26, 375/E07.001, 375/E07.026, 375/E7.093, 375/E7.103, 375/E7.211, 386/347
• US Class Current: 382/233
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/4343 Extraction or processing of packetized elementary streams [PES]
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods that receive a video stream comprising a sequence of plural compressed pictures, wherein the plural compressed pictures comprises a plurality of sets of compressed pictures, wherein each set in the plurality of sets has a respective picture interdependency characteristic, wherein the compressed pictures in the first set depend for decoding only on pictures from the first set.

Claims

1. A method, comprising:

receiving a video stream comprising a sequence of plural compressed pictures, wherein the plural compressed pictures comprises a plurality of sets of compressed pictures, wherein each set in the plurality of sets has a respective picture interdependency characteristic, wherein the compressed pictures in the first set depend for decoding only on pictures from the first set;

determining an adherence of the first and second set of compressed pictures to one or more rules prior to decoding the compressed pictures, the rules comprising the picture interdependency characteristics; and

decoding the first set, the second set, or a combination of both based on an adherence of the first set and the second set to the one or more rules.

2. The method of claim 1, further comprising receiving auxiliary information in a transport layer of the video stream, the auxiliary information conveying that the first and second compressed pictures in the video stream adhere to the one or more rules corresponding to one or more picture interdependency tiers.

3. The method of claim 1, further comprising receiving auxiliary information in the video stream, the auxiliary information conveying that the first and second compressed pictures adhere to the one or more rules of a subset of the one or more picture interdependency tiers.

4. The method of claim 1, further comprising receiving auxiliary information in the video stream, the auxiliary information comprising one or more data fields that identifies a particular picture interdependency tier scheme from a plurality of picture interdependency tier schemes, each of the schemes corresponding to a defined encoding scheme.

5. The method of claim 4, wherein at least one of the data fields comprises an indication of whether a particular picture interdependency tier or subset of a particular picture interdependency tier is a valid picture interdependency tier.

6. The method of claim 1, further comprising annotating received auxiliary information using a data structure associating each compressed picture to one or more of a corresponding first or second set, sequence parameter set, picture parameter set, and location of the compressed picture.

7. The method of claim 1, wherein the one or more rules adhered to by the first or second set of compressed pictures are unique to the adhering first or second set.

8. The method of claim 1, wherein the first set of compressed pictures comprise a first level of importance and the second set of compressed pictures comprise a second level of importance different than the first level of importance.

9. The method of claim 1, wherein the first set of compressed pictures comprises a higher level of importance than the second set.

10. The method of claim 1, further comprising:

progressively extracting the first set of compressed pictures;

decoding the first set independently of the second set; and

outputting the first set independently of the second set.

11. The method of claim 10, wherein receiving further comprises receiving a third set of compressed pictures, the third set having a third relative level of importance lower than the first and second set.

12. The method of claim 11, further comprising:

progressively extracting the first and second set of compressed pictures;

decoding the first and second set independently of the third set; and

outputting the first and second set independently of the third set.

13. A method, comprising:

providing a video stream comprising a sequence of plural compressed pictures, including a first level and a second level of coded pictures, the first level exhibiting, when decoded, picture interdependencies different than those exhibited by a decoded second level; and

providing auxiliary information in the video stream, the auxiliary information conveying that the first level of pictures adheres to a first set of rules and that the second level of coded pictures adheres to a second set of rules; and

decoding the first level based on adherence of a first set of rules of the first picture interdependency level and process the second level based on the adherence of a second set of rules corresponding to the second picture interdependency level.

14. The method of claim 13, wherein the first set of rules is different that the second set of rules.

15. The method of claim 13, wherein the first set of rules corresponds to a first picture interdependency tier and the second set of rules corresponds to a second picture interdependency tier.

16. The method of claim 13, wherein providing the auxiliary information further comprises providing the auxiliary information as private data in an adaptation field of a transport layer of the video stream.

17. The method of claim 13, wherein providing the auxiliary information further comprises providing one or more data fields that identifies a particular picture interdependency tier scheme from a plurality of picture interdependency tier schemes, each of the schemes corresponding to a defined encoding scheme.

18. A system, comprising:

an encoding device configured to;

provide a video stream comprising a sequence of plural compressed pictures, including a first level and a second level of coded pictures, the first level exhibiting, when decoded, picture interdependencies different than those exhibited by a decoded second level; and

provide auxiliary information in a transport layer of the video stream, the auxiliary information conveying that the first level of pictures corresponds to a first picture interdependency tier and that the second level of pictures corresponds to a second picture interdependency tier; and

a receiving device configured to;

receive the video stream; and

process the first level based on adherence of a first set of rules of the first picture interdependency tier and process the second level based on the adherence of a second set of rules corresponding to the second picture interdependency tier.

19. The system of claim 18, wherein the first set of rules is different that the second set of rules.

20. The system of claim 18, wherein the auxiliary information is provided as private data in an adaptation field of the transport layer of the video stream.