Elementary video bitstream analysis

• US 9,369,668 B2
• Filed: 03/14/2014
• Issued: 06/14/2016
• Est. Priority Date: 03/14/2014
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Bright-Thomas, Paul G.
• Primary Examiner(s): Patel, Hemant
• Application Number:
  US14/211,700
• Publication Number:
  US 20150264313A1
• Time in Patent Office: 823 Days
• Field of Search: 348 1401- 1416, 370259-271, 370351-357, 709201-207, 709217-248
• US Class Current: 1/1
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A bitstream encoded with video information is received at a first network enabled device from a second network enabled device. The bitstream is analyzed prior to generating an image frame corresponding to the bitstream values, and visual characteristics of the video information are determined from bitstream values in the bitstream. A modified video display is determined in response to the visual characteristics.

Claims

1. A method comprising:

receiving at a first network enabled device an encoded bitstream encoded with video information from a second network enabled device;

analyzing video image data in the bitstream prior to or during the decoding of the bitstream and prior to generating an image frame corresponding to the bitstream values, and determining visual characteristics of the video information from bitstream values in the bitstream; and

determining a modified video display for display at one or more network enabled devices in response to the visual characteristics.

2. The method of claim 1, wherein determining the modified video display comprises:

generating a modified video display stream according to the determined visual characteristics; and

transmitting the modified video display stream.

3. The method of claim 1, wherein determining the modified video display comprises:

determining a method of optimizing the video information received from the second network enabled device; and

providing signaling to the second network enabled device configured to optimize video information sent from the second network enabled device in response to the determined visual characteristics.

4. The method of claim 1, wherein determining the modified video display comprises selecting a display video stream to be switched to a video conference participant.

5. The method of claim 1, wherein analyzing the bitstream comprises analyzing visual characteristics from at least one coding unit derived from the bitstream.

6. The method of claim 5, wherein analyzing visual characteristics from at least one coding unit comprises:

combining the at least one coding unit with at least one other coding unit to form a combined unit;

performing an edge analysis on the combined unit; and

determining that a video stream should be re-framed in response to the edge analysis.

7. The method of claim 1, wherein determining the visual characteristics comprises locating areas of motion within the video stream.

8. The method of claim 1, wherein determining the visual characteristics comprises analyzing a chrominance value from the bitstream, and determining a presence of a user based on the chrominance value.

9. The method of claim 1, wherein determining the visual characteristics comprises analyzing a luminance value from the bitstream, and determining a light level of a location of the first network enabled device based upon the luminance value.

10. The method of claim 1, wherein determining the visual characteristics comprises analyzing a coefficient distribution from the bitstream, and determining a focus level of the video data corresponding to the bitstream values based upon the coefficient distribution.

11. The method of claim 1, wherein determining the visual characteristics comprises analyzing spatial density of information in the bitstream and determining portions of the bitstream which exhibit relatively higher levels of detail.

12. An apparatus comprising:

at least one network interface unit configured to enable network communications; and

a processor coupled to the network interface unit, wherein the processor is configured to;

receive an encoded bitstream encoded with video information from a network enabled device;

analyze the bitstream prior to or during the decoding of the bitstream and prior to generating an image frame corresponding to the bitstream values, and determine visual characteristics of the video information from bitstream values in the bitstream; and

determine a modified video display for display at one or more network enabled devices in response to the visual characteristics.

13. The apparatus of claim 12, wherein the processor is further configured to:

generate a modified video display stream according to the analyzed visual characteristics; and

cause the modified video display stream to be transmitted.

14. The apparatus of claim 12, wherein the processor is further configured to:

determine a method of optimizing the video information received from the network enabled device; and

provide signaling to the network enabled device configured to optimize video information sent from the network enabled device in response to the analyzed visual characteristics.

15. The apparatus of claim 12, wherein the processor is further configured to select a display video stream to be switched to a video conference participant.

16. The apparatus of claim 12, wherein the processor is further configured to analyze at least one of a chrominance value, a luminance value, or spatial density of information in the bitstream.

17. A tangible, non-transitory computer readable medium comprising instructions that when executed by a processor cause the processor to:

obtain a received encoded bitstream encoded with video information from a network enabled device;

analyze the bitstream prior to or during the decoding of the bitstream and prior to generating an image frame corresponding to the bitstream values, and determine visual characteristics of the video information from bitstream values in the bitstream; and

determine a modified video display at one or more network enabled devices in response to the visual characteristics.

18. The computer readable medium of claim 17, wherein the instructions further cause the processor to:

generate a modified video display stream according to the determined visual characteristics; and

cause the modified video display stream to be transmitted.

19. The computer readable medium of claim 17, wherein the instructions further cause the processor to:

determine a method of optimizing the video information received from the second network enabled device; and

provide signaling to the network enabled device configured to optimize video information sent from the network enabled device in response to the determined visual characteristics.

20. The computer readable medium of claim 17, wherein the instructions further cause the processor to select a display video stream to be switched to a video conference participant.