Tracking and determining pictures in successive interdependency levels

• US 9,716,883 B2
• Filed: 09/30/2014
• Issued: 07/25/2017
• Est. Priority Date: 11/13/2006
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Cook, Benjamin M., Eppinett, Ken L., Bean, John R., Rodriguez, Arturo A.
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): HASAN, SYED Y
• Application Number:
  US14/502,651
• Publication Number:
  US 20150016549A1
• Time in Patent Office: 1,029 Days
• Field of Search: 37524028, 37524026, 386326, 386332, 725134
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/4343 Extraction or processing of packetized elementary streams [PES]
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods that receive a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level, track the compressed pictures to ascertain which of the compressed pictures correspond to the first level, and responsive to ascertaining which of the compressed pictures correspond to the first level, tracking the compressed pictures to ascertain which of the compressed pictures correspond to the second level.

Claims

1. A method, comprising:

receiving a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level;

performing a first level of tracking of pictures of the received stream to ascertain whether pictures belong to a first level;

performing a second level of tracking of pictures with an ascending presentation time stamp (PTS), wherein performing a second level of tracking of pictures comprises;

ascertaining the first level of pictures based on an indicated adherence to one or more picture independency rules received with the video stream,

determining that a predetermined number of first level of pictures have been tracked, and

performing, when the predetermined number of first level pictures have been tracked, the second level tracking of pictures with the ascending PTS; and

classifying pictures immediately subsequent to pictures tracked at the second level of tracking as candidates for a third level of tracking; and

processing the sequence of compressed pictures of the video stream based on whether pictures belong to the first level, the second level, and the third level.

2. The method of claim 1, wherein the first level of tracking comprises tracking random access points (RAPs).

3. The method of claim 1, wherein the first level of tracking commences during a previous group of pictures (GOP) from a present GOP.

4. The method of claim 1, further comprising resetting tracking when a RAP comprises an instantaneous decoder refresh (IDR).

5. The method of claim 1, further comprising commencing the second level of tracking only after a sufficient number of RAPs have been ascertained.

6. The method of claim 1, further comprising employing a confirmation during tracking based on determining an adherence of one or more tracked pictures to the one or more picture interdependency rules.

7. The method of claim 1, wherein the one or more picture interdependency rules is regarding compressed bit size.

8. The method of claim 1, wherein tracking continues until a predefined number of ascending PTS markers are detected.

9. A method comprising:

receiving a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level;

performing a first level of tracking of RAPs in the received stream;

classifying RAPs tracked by the first level of tracking as first level pictures;

performing a second level of tracking of pictures with an ascending PTS, wherein performing the second level of tracking comprises;

ascertaining the first level pictures based on an indicated adherence to picture independency rules received with the video stream,

determining that a predetermined number of the first level pictures have been tracked, and

performing, when the predetermined number of the first level pictures have been tracked, the second level of tracking of pictures with the ascending PTS;

classifying pictures tracked by the second level of tracking as second level pictures;

classifying pictures immediately subsequent to second level pictures as candidates for a third level of tracking; and

process the sequence of compressed pictures of the video stream based on whether pictures belong to the first level, the second level, and the third level.

10. The method of claim 9, further comprising making the picture interdependency rules based on whether a PTS associated with a candidate level three picture is less than a PTS associated with an immediately preceding second level picture.

11. The method of claim 9, further comprising making the picture interdependency rules based on whether a PTS associated with a candidate level three picture is greater than a predetermined threshold value.

12. The method of claim 9, further comprising making the picture interdependency rules based on whether a difference between a PTS associated with a candidate level three picture and a PTS associated with an immediately preceding second level picture is greater than a predetermined threshold value.

13. The method of claim 12, further comprising determining a time symmetry between a plurality of bounding pictures.

14. An apparatus, comprising:

a memory comprising instructions; and

one or more processors configured to execute the instructions to cause the one or more processors to;

receive a video stream comprising a sequence of compressed pictures, the compressed pictures comprising a plurality of levels of picture importance including a first picture level and a second picture level;

perform a first level of tracking of RAPs in the received stream;

classify RAPs tracked by the first level of tracking as first level pictures;

perform a second level of tracking of pictures with an ascending PTS, wherein the one or more processors being configured to perform the second level of tracking comprises the one or more processors being further configured to;

ascertain the first level pictures based on an indicated adherence to picture independency rules received with the video stream,

determine that a predetermined number of first level pictures have been tracked, and

perform, when the predetermined number of first level pictures have been tracked, the second level tracking of pictures with the ascending PTS;

classify pictures tracked by the second level of tracking as second level pictures; and

classify pictures immediately subsequent to second level pictures as candidates for a third level, of tracking; and

process the sequence of compressed pictures of the video stream based on whether pictures belong to the first level, the second level, and the third level.

15. The apparatus of claim 14, the instructions further comprising confirming the candidates for level three pictures prior to classification as level three pictures.

16. The apparatus of claim 15, wherein the confirmation is based on one or more confirmation factors.

17. The apparatus of claim 16, wherein one of the one or more confirmation factors ascertains from a PES layer from a candidate level three picture whether its corresponding PTS-DTS is greater than two.

18. The apparatus of claim 16, wherein one of the one or more confirmation factors determines the size of a candidate level three picture relative to an immediately preceding picture.

19. The apparatus of claim 14, wherein the first, second, and third levels of compressed picture correspond to first, second, and third tiers of picture interdependencies, respectively, wherein the first, second, and third tiers of picture interdependencies are different from each other.

20. The apparatus of claim 14, the instructions further comprising annotating the first, second, and third levels of pictures in a storage device.