System and method for optimized encoding and transmission of a plurality of substantially similar video fragments

• US 8,170,096 B1
• Filed: 11/18/2004
• Issued: 05/01/2012
• Est. Priority Date: 11/18/2003
• Status: Active Grant

• Current Assignee: TiVo Corporation (Adeia Inc.)
• Original Assignee: Visible World Incorporated (Comcast Corporation)
• Inventors: Haberman, Seth, Niemeijer, Gerrit, Booth, Richard L., Jansen, Alex
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): Pe, Geepy
• Application Number:
  US10/991,674
• Time in Patent Office: 2,721 Days
• Field of Search: 375/240.01, 375/240.02, 375/240.03, 375/240.12, 375/240.24
• US Class Current: 375/240.01
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/513 Processing of motion vectors

Abstract

A system and method for stitching separately encoded MPEG video fragments, each representing a different rectangular area of the screen together into one single full-screen MPEG encoded video fragment.

Claims

1. A computer-implemented method of encoding partial-frame video segments to allow different partial-frame video segments to be merged into a full-video frame, said method comprising:

defining by a processor a full-screen template by dividing said full-video frame area into non-overlapping, rectangular regions, wherein said rectangular regions have a length and width that are each a multiple of 16 pixels;

obtaining discrete partial-frame video segments from a digital library to be inserted into at least one of said rectangular regions;

determining by the processor a target VBV buffer size for said discrete partial-frame video segments for a selected rectangular region, said target VBV buffer size substantially proportional to a full frame VBV buffer size based on a relative size of said rectangular region to a full frame size; and

independently encoding said discrete partial-frame video segments for insertion by the processor into said selected rectangular region using said determined target VBV buffer size, creating encoded discrete partial-frame video segments capable of being spatially seamlessly stitched into the non-overlapping rectangular regions of a full frame prior to decoding.

2. The computer-implemented method of claim 1 wherein a common GOP pattern is used for encoding all video segments for all of said rectangular regions.

3. The computer-implemented method of claim 1 wherein said step of determining a target VBV buffer size includes selecting a target VBV buffer size that is smaller than a value that is substantially proportional to a full frame VBV buffer size based on relative size of said rectangular region as compared to a full frame size.

4. The computer-implemented method of claim 1 further including:

determining a VBV bit rate for encoding said video segments for said selected rectangular region;

wherein said VBV bit rate that is selected is substantially proportional to a full frame VBV bit rate based on relative size of said rectangular region as compared to a full frame size.

5. The computer-implemented method of claim 1 further including:

determining a VBV bit rate for encoding said video segments for said selected rectangular region;

wherein said VBV bit rate is selected that is smaller than a value that is substantially proportional to a full frame VBV bit rate based on relative size of said rectangular region as compared to a full frame size.

6. The computer-implemented method of claim 1 further including:

determining f-code array values for said video segments; and

after encoding said video segments, modifying said f-code array values and motion vectors for said encoded video according to said determined f-code array values.

7. The computer-implemented method of claim 6 wherein said step of determining f-code array values includes determining maximum values for said f-code array values from said plurality of video segments.

8. The computer-implemented method of claim 1 further including:

assembling a row of encoded video segment macroblocks into a slice, wherein header information for each macroblock in said slice is modified for a proper format for a complete slice.

9. The computer-implemented method of claim 1 wherein said step of obtaining video segments for at least one of said rectangular regions includes obtaining a plurality of different video segments for said rectangular region, wherein said different video segments are then merged with other video segments for other rectangular regions to create multiple different full-video frame video segments.

22. The method of claim 1 wherein the video segments represent a portion of a television program.

23. The method of claim 1 wherein the video segments represent a portion of a television commercial.

24. The method of claim 1 wherein the encoding is performed by an MPEG encoder.

10. An encoding system for encoding partial-frame video segments to allow different partial frame video segments to be merged into a full-video frame, said encoding system comprising:

a rectangular region input to obtain information regarding a full-screen template comprising a plurality of rectangular regions that divide up a full-video frame, wherein said rectangular regions will have a length and width that are each a multiple of 16 pixels;

a video segment input to obtain discrete partial-frame video segments to be inserted into at least one of said rectangular regions;

a VBV buffer size determining component, responsive to information regarding rectangular regions obtained by said rectangular region input, said VBV buffer component to determine a target VBV buffer size for encoding said discrete partial-frame video segments for a selected rectangular region;

wherein said encoding system independently encodes said discrete partial-frame video segments for insertion into said selected rectangular region using said determined target VBV buffer size, creating encoded discrete partial-frame video segments capable of being spatially seamlessly stitched into the rectangular regions of the full-screen template prior to decoding.

11. The encoding system of claim 10 wherein said encoding system uses a common GOP pattern for encoding all video segments for all of said rectangular regions.

12. The encoding system of claim 10 wherein said VBV buffer size determining component selects a target VBV buffer size that is substantially proportional to a full frame VBV buffer size based on relative size of said rectangular region as compared to a full frame size.

13. The encoding system of claim 10 wherein said VBV buffer size determining component selects a target VBV buffer size that is smaller than a value that is substantially proportional to a full frame VBV buffer size based on relative size of said rectangular region as compared to a full frame size.

14. The encoding system of claim 10 further including:

a VBV bit rate determining component, to determine a VBV bit rate for encoding said video segments for said selected rectangular region;

wherein said VBV bit rate determining component selects a VBV bit rate that is substantially proportional to a full frame VBV bit rate based on relative size of said rectangular region as compared to a full frame size.

15. The encoding system of claim 10 further including:

a VBV bit rate determining component, to determine a VBV bit rate for encoding said video segments for said selected rectangular region;

wherein said VBV bit rate determining component selects a VBV bit rate that is smaller than a value that is substantially proportional to a full frame VBV bit rate based on relative size of said rectangular region as compared to a full frame size.

16. The encoding system of claim 10 wherein said encoding system determines f-code array values for said video segments, by determining maximum values for said f-code array values from said plurality of video segments.

17. The encoding system of claim 16 wherein after said encoding system encodes said video segments, f-code array values and motion vectors for said encoded video are modified according to said determined f-code array values.

18. The encoding system of claim 10 wherein a row of encoded video segment macroblocks are assembled into a slice, and wherein header information for each macroblock in said slice is modified for a proper format for a complete slice.

19. The encoding system of claim 10 wherein the video segments represent a portion of a television program.

20. The encoding system of claim 10 wherein the video segments represent a portion of a television commercial.

21. The encoding system of claim 10 wherein:

the encoding system includes an MPEG encoder; and

the encoding system encodes the video segments on the MPEG encoder.