Adaptive video processing circuitry & player using sub-frame metadata

• US 20080018785A1
• Filed: 07/20/2006
• Published: 01/24/2008
• Est. Priority Date: 05/22/2006
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Bennett, James D.
• Granted Patent: US 7,953,315 B2
• Time in Patent Office: Days
• US Class Current: 348/439.1
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/440272 for performing aspect ratio conversion
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

Video player circuitry used with encoded source video and a display. Decoder circuitry receives encoded source video and decodes the encoded source video to produce a sequence of full frames of video data. Pre-processing circuitry, pursuant to sub-frame information, generates a plurality of sequences of sub-frames of video data from the sequence of full frames of video data, a first sequence of the plurality of sequences of sub-frames of video data having a different center point within the sequence of full frames of video data than that of a second sequence of the plurality of sequences of sub-frames of video data. Post-processing circuitry, pursuant to supplemental information, modifies the plurality of sequences of sub-frames of video data to produce an output. Interface circuitry that delivers the output for subsequent presentation on the display.

Claims

1. Video player circuitry used with encoded source video and a display, the video player circuitry comprising:

decoder circuitry that receives encoded source video and decodes the encoded source video to produce a sequence of full frames of video data;

pre-processing circuitry that, pursuant to sub-frame information, generates a plurality of sequences of sub-frames of video data from the sequence of full frames of video data, a first sequence of the plurality of sequences of sub-frames of video data having a different center point within the sequence of full frames of video data than that of a second sequence of the plurality of sequences of sub-frames of video data;

post-processing circuitry that, pursuant to supplemental information, modifies the plurality of sequences of sub-frames of video data to produce an output; and

interface circuitry that delivers the output for subsequent presentation on the display.

2. The video player circuitry of claim 1, wherein the video player circuitry and the display are disposed in a single housing.

3. The video player circuitry of claim 1, wherein the video player circuitry is disposed in a first housing and the display is disposed in a second housing.

4. The video player circuitry of claim 1, wherein the decoder circuitry and the pre-processing circuitry that generates the plurality of sequences of sub-frames of video data are integrated.

5. The video player circuitry of claim 1, wherein the decoder circuitry decodes the encoded source video prior to the pre-processing circuitry generating the plurality of sequences of sub-frames of video data.

6. The video player circuitry of claim 1, wherein the sub-frame information comprises sub-frame metadata and the pre-processing circuitry comprises sub-frame metadata processing circuitry.

7. The video player circuitry of claim 1, wherein the sub-frame information and the supplemental information comprises sub-frame metadata.

8. The video player circuitry of claim 1, wherein:

the sequence of full frames of video data has a first resolution; and

the plurality of sequences of sub-frames of video data have a second resolution that is less than the first resolution.

9. The video player circuitry of claim 1, wherein:

the sequence of full frames of video data has a first aspect ratio; and

the plurality of sequences of sub-frames of video data have a second aspect ratio that differs from the first aspect ratio.

10. The video player circuitry of claim 1, wherein the display comprises a target display, and the output comprises tailored output.

11. The video player circuitry of claim 1, wherein the pre-processing circuitry and post-processing circuitry together comprise sub-frame metadata processing circuitry.

12. The video player circuitry of claim 1, wherein the pre-processing circuitry and post-processing circuitry together comprise sub-frame metadata processing circuitry and target display tailoring circuitry.

13. The video player circuitry of claim 1, wherein at least a portion of the decoder circuitry, the pre-processing circuitry, and the post-processing circuitry comprise general purpose processing circuitry that performs underlying functionality pursuant to program code.

14. A method for producing a video presentation on a display, the method comprising:

receiving a sequence of full frames of video data;

using a first sub-frame definition and a second sub-frame definition to respectively generate a first sequence of sub-frames of video data and a second sequence of sub-frames of video data from the sequence of full frames of video data; and

delivering an output video sequence for presentation on the display, the output video sequence comprising the first sequence of sub-frames of video data and the second sequence of sub-frames of video data.

15. The method of claim 14, further comprising processing the first sequence of sub-frames of video data using first supplemental information, processing the second sequence of sub-frames of video data using second supplemental information, and the first supplemental information being different than the second supplemental information.

16. The method of claim 14, wherein the display has a display parameter, and the method further comprising processing the output video sequence based on the display parameter.

17. The method of claim 14, further comprising:

receiving encoded source video; and

decoding the encoded source video to produce the sequence of full frames of video data.

18. A video player software application used with encoded source video and a display, the video player software application comprising:

a decoder that produces a sequence of full frames of video data from the encoded source video;

a sub-frame processor that generates from the sequence of full frames of video data both a first sequence of sub-frames of video data based on first location and sizing information and a second sequence of sub-frames of video data based on second location and sizing information; and

a display interface that delivers the first sequence and second sequence of sub-frames of video data for full screen presentation on the display.

19. The video player software application of claim 18, wherein the video player software application runs on video player equipment.

20. The video player software application of claim 18, wherein the video player software application runs on an end-point client device.

21. The video player software application of claim 18, wherein the first location and sizing information and the second location and sizing information together comprise sub-frame metadata that is received by the sub-frame processor.

22. The video player software application of claim 21, wherein the sub-frame metadata further comprises display information, and the video player software application further comprises supplemental processing that tailors the first sequence and second sequence of sub-frames of video data based on the display information.