Adaptive video processing using sub-frame metadata

• US 20080007649A1
• Filed: 07/20/2006
• Published: 01/10/2008
• Est. Priority Date: 06/23/2006
• Status: Abandoned Application

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Bennett, James D.
• Application Number:
  US11/491,051
• Publication Number:
  US 20080007649A1
• Time in Patent Office: Days
• US Class Current: 348/443
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/440272 for performing aspect ratio conversion
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

A video processing system applies sub-frame processing to video data to generate both a first sequence of sub-frames of video data and a second sequence of sub-frames of video data. The first sequence of sub-frames of video data and the second sequence of sub-frames of video data are defined by metadata. The processing circuitry generates a third sequence of sub-frames of video data by combining the first sequence of sub-frames of video data with the second sequence of sub-frames of video data. Adaptive video processing circuitry receives encoded source video data, raw source video data, similar display metadata, target display metadata, and/or target display information. The adaptive video processing circuitry processes its input information to produce one or more outputs that include tailored metadata, encoded target display video data, target display video data, and DRM/Billing Signaling.

Claims

1. Video circuitry that receives encoded video, the encoded video representing a sequence of full frames of video data, the video circuitry comprising:

processing circuitry that applies decoding and sub-frame processing to the encoded video to generate both a first sequence of sub-frames of video data and a second sequence of sub-frames of video data;

the first sequence of sub-frames of video data corresponding to a different region within the sequence of full frames of video data than that of the second sequence of sub-frames of video data; and

the processing circuitry generates a third sequence of sub-frames of video data by combining the first sequence of sub-frames of video data with the second sequence of sub-frames of video data.

2. The video circuitry of claim 1, wherein the processing circuitry encodes the third sequence of sub-frames of video data.

3. The video circuitry of claim 1, wherein the decoding and sub-frame processing applied by the processing circuitry occur in sequence.

4. The video circuitry of claim 1, wherein the decoding and sub-frame processing applied by the processing circuitry are integrated.

5. The video circuitry of claim 1, wherein the processing circuitry carries out the sub-frame processing pursuant to sub-frame metadata.

6. The video circuitry of claim 5, wherein the processing circuitry tailors the sub-frame metadata based on a characteristic of a target display device before carrying out the sub-frame processing.

7. The video circuitry of claim 1, wherein the processing circuitry tailors the third sequence of sub-frames of video data based on a characteristic of a target display device.

8. The video circuitry of claim 1, wherein the processing circuitry comprising digital rights management.

9. The video circuitry of claim 1, wherein the processing circuitry comprising billing management.

10. Video system that receives video representative of a sequence of full frames of video data, the video circuitry comprising:

processing circuitry that applies sub-frame processing to the video to generate both a first sequence of sub-frames of video data and a second sequence of sub-frames of video data;

the first sequence of sub-frames of video data being defined by at least a first parameter, and the second sequence of sub-frames of video data being defined by at least a second parameter, both the at least the first parameter and the at least the second parameter together comprising metadata;

the processing circuitry receives the metadata for the sub-frame processing; and

the processing circuitry generates a third sequence of sub-frames of video data by combining the first sequence of sub-frames of video data with the second sequence of sub-frames of video data.

11. The video system of claim 10, wherein the processing circuitry receives the metadata via a communication link.

12. The video system of claim 10, wherein the processing circuitry receives the metadata from a removable storage device.

13. The video system of claim 10, wherein the metadata comprising a metadata file, and the metadata file comprising at least one video adjustment parameter associated with at least a portion of the first sequence of sub-frames of video data.

14. The video system of claim 10, wherein the third sequence of sub-frames of video data is delivered for presentation on a target display.

15. The video system of claim 10, wherein the processing circuitry tailors the metadata before performing the sub-frame processing.

16. The video system of claim 15, wherein the tailoring comprising adapting the third sequence of sub-frames of video data for presentation on a target display.

17. The video system of claim 15, wherein the target display is located at a different premises than that of the video system.

18. A method for video processing comprising:

receiving video data representative of a sequence of full frames of video data;

sub-frame processing the video data to generate both a first sequence of sub-frames of video data and a second sequence of sub-frames of video data, the first sequence of sub-frames of video data defined by at least a first parameter, the second sequence of sub-frames of video data defined by at least a second parameter, and the at least the first parameter and the at least the second parameter together comprise metadata; and

generating a third sequence of sub-frames of video data by combining the first sequence of sub-frames of video data with the second sequence of sub-frames of video data.

19. The method of claim 18, wherein:

the first sequence of sub-frames of video data correspond to a first region within the sequence of full frames of video data;

the second sequence of sub-frames of video data correspond to a second region within the sequence of full frames of video data; and

the first region differs from the second region.

20. The method of claim 18, further comprising decoding the video data.

21. The method of claim 20, wherein decoding the video data occurs prior to sub-frame processing the video data.

22. The method of claim 18, further comprising encoding the third sequence of sub-frames of video data.

23. The method of claim 18, further comprising tailoring the metadata based on a characteristic of a target video display device prior to sub-frame processing the video data.

24. The method of claim 18, further comprising tailors the third sequence of sub-frames of video data based on a characteristic of a target display device.

25. The method of claim 18, further comprising applying digital rights management operations to at least one of the video data, the metadata, and the third sequence of sub-frames of video data.

26. The method of claim 18, wherein the processing circuitry comprising billing management operations to at least one of the video data, the metadata, and the third sequence of sub-frames of video data.

27. The method of claim 18, further comprising receiving the metadata via a communication link.

28. The method of claim 18, further comprising receiving the metadata via a removable storage device.

29. The method of claim 18, wherein the metadata comprises a metadata file that includes at least one video adjustment parameter associated with at least a portion of the first sequence of sub-frames of video data.

30. The method of claim 18, further comprising delivering the third sequence of sub-frames of video data for presentation on a target display.