Method, apparatus and system for use in multimedia signal encoding

• US 8,175,167 B2
• Filed: 06/30/2006
• Issued: 05/08/2012
• Est. Priority Date: 07/01/2005
• Status: Active Grant

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: Sonic Solutions LLC (Adeia Inc.)
• Inventors: Randall, Bruce W., Palmer, Matthew, Bouton, Peter M.
• Primary Examiner(s): SENFI, BEHROOZ M
• Application Number:
  US11/428,187
• Publication Number:
  US 20070002946A1
• Time in Patent Office: 2,139 Days
• Field of Search: 348/19, 348/607, 348/391, 348/395, 348/396, 348/394, 348/404, 348/405, 348/409, 348/12, 348/13, 348/390, 348/699, 348/97, 382/232, 382/235, 382/239, 382/236, 382/275, 375/240.01, 375/240.03, 375/240.12, 375/240.02, 375/240.25, 375/240.05, 375/240.19
• US Class Current: 375/240.26
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/194 involving only two passes
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

The present embodiments provide methods, apparatuses, systems for use in encoding and/or formatting content, such as multimedia content. Some embodiments provide methods for use in encoding content. These methods receive source content, encode the source content producing encoded content, evaluate a first encoded segment of the encoded content relative to a plurality of buffer models, determine whether the first segment of encoded content is to be re-encoded relative to one or more of the plurality of buffer models based on the evaluation; and re-encode the first segment when it is determined that the first segment is to be re encoded.

Claims

1. A method for use in encoding content, the method comprising:

receiving source content;

encoding the source content producing encoded content;

evaluating a first encoded segment of the encoded content relative to one or more buffer models;

determining whether the first segment of encoded content is to be re-encoded relative to at least one of the one or more buffer models based on the evaluating;

re-encoding the first segment when it is determined that the first segment is to be re-encoded; and

the re-encoding of the first segment comprises re-encoding the first segment to utilize freed up bits freed up from the re-encoding of one or more other segments of the encoded content.

2. The method of claim 1, wherein the determining whether the first segment of the encoded content is to be re-encoded comprises determining whether the encoded content fails a first buffer model of the one or more buffer models;

and

the re-encoding comprises re-encoding the first segment when it is determined that the encoded content fails a first buffer model.

5. The method of claim 1, further comprising:

identifying a second segment of the encoded content;

re-encoding the second segment freeing up bits; and

wherein the re-encoding of the first segment to utilize the freed up bits comprises re-encoding the first segment to utilize the freed up bits freed up from the re-encoding of the second segment.

7. The method of claim 1, wherein the re-encoding the first segment comprises re-encoding the first segment creating a first re-encoded segment;

storing the first re-encoded segment separate from the encoded content; and

finalizing the encoding of the source content comprising merging the first re-encoded content with the encoded content and adjusting a buffer level and access unit information of the encoded content with buffer level and access unit information of the first re-encoded segment.

8. The method of claim 1, wherein the evaluating of the first encoded segment comprises substantially simultaneously decoding a portion of the first encoded segment according to a plurality of distinct buffer models.

9. The method of claim 1, wherein the re-encoding the first segment further comprises:

identifying a first candidate start point for a re-encoding of the first segment;

determining whether the first candidate start point is a valid start point by evaluating a first portion of the encoded content relative to the first candidate start point; and

setting the first candidate start point as a valid re-encode start point when the first candidate start point is validated.

10. The method of claim 9, wherein the determining whether the first candidate start point is valid comprises determining whether the first portion of the content prior to the first candidate start point is referenced by a second portion of the content following the first candidate start point relative to a playback timeline;

and

wherein the setting the first candidate start point as the re-encode start point comprises setting the first candidate start point as the re-encode start point when the second portion of the content following the first candidate start point does not reference the first portion of the content prior to the first candidate start point.

11. The method of claim 9, further comprising:

identifying a first candidate end point for the re-encoding of the first segment;

determining whether the first candidate end point is a valid end point by evaluating a fourth portion of the encoded content relative to the first candidate end point; and

setting the first candidate end point as a valid re-encode end point when the first candidate end point is validated.

12. The method of claim 11, wherein the determining whether the first candidate end point is valid comprises determining whether at least a portion of content within a candidate segment between the valid re-encode start point and the first candidate end point is referenced by content outside the candidate segment;

and

wherein the setting the first candidate end point as the valid re-encode end point comprises setting the first candidate end point as the valid re-encode end point when the at least the portion of the content within the candidate segment is not referenced by content outside the candidate segment.

13. The method of claim 9, wherein the determining whether the first candidate start point is valid comprises accessing an index for a frame prior to the first candidate start point relative to a playback timeline and determining whether the index contains a listing of a frame following the first candidate start point relative to the playback timeline;

and

implementing the setting of the first candidate start point as the re-encode start point when the index does not contains the listing of the frame following the first candidate start point.

14. The method of claim 9, further comprising:

upgrading the first candidate start point to an intraframe.

15. The method of claim 1, wherein the re-encoding the first segment further comprises:

identifying a first candidate end point for the re-encoding of the first segment;

determining whether the first candidate end point is a valid end point by evaluating a fourth portion of the encoded content relative to the first candidate end point comprising determining whether at least a portion of content within the first segment is referenced by content outside the first segment; and

setting the first candidate end point as a valid re-encode end point when the first candidate end point is validated and when the at least the portion of the content within the first segment is not referenced by the content outside the first segment.

32. The method of claim 1, further comprising:

generating a bit rate track graphically representing bit rates for portions of encoded content;

generating a quality track graphically representing a quality of encoding of the portions of encoded content that corresponds with the bit rate track; and

identifying in the bit rate track a selection of a portion of the encoded content to be re-encoded.

33. The method of claim 32, further comprising:

generating an entry point track graphically representing entry points, where the entry point track corresponds with the bit rate track; and

generating a picture structure track graphically representing picture structures of the encoded content, where the picture structure track corresponds with the bit rate track.

34. The method of claim 32, further comprising:

providing selectable re-encode start point and end point options; and

providing zooming capabilities to zoom in and out on at least the bit rate track.

35. The method of claim 32, further comprising:

generating a bit rate indication for a selected segment of content;

registering an input moving the bit rate indicator.

36. The method of claim 35, wherein the bit rate indicator is a bit rate bar that is selectable and moveable by a user.

37. The method of claim 35, further comprising:

a bit rate value corresponding with a positioning of the bit rate indication.

38. The method of claim 32, further comprising:

generating settings options comprising a quality threshold and a segment length parameter;

identifying segments within the encoded content that have quality levels that are below the quality threshold and meet the segment length parameter.

39. The method of claim 32, further comprising:

generating a list of selected segments and defining a status of each segment in the list.

3. A method for use in encoding content, the method comprising:

receiving source content;

encoding the source content producing encoded content;

evaluating a first encoded segment of the encoded content relative to a plurality of buffer models;

determining whether the first segment of encoded content is to be re-encoded relative to one or more of the plurality of buffer models based on the evaluating;

re-encoding the first segment when it is determined that the first segment is to be re-encoded;

wherein the determining whether the first segment of the encoded content is to be re-encoded comprises determining whether the encoded content fails a first buffer model of the plurality of buffer models; and

the re-encoding comprises re-encoding the first segment when it is determined that the encoded content fails a first buffer model;

identifying that the encoded content fails a second buffer model of the plurality of buffer models;

invalidating the second buffer model relative to the encoded content.

4. The method of claim 3, wherein the invalidating the second buffer model comprises replacing parameters of the second buffer model with parameters from a fourth buffer model that is a valid buffer model.

6. A method for use in encoding content, the method comprising:

receiving source content;

encoding the source content producing encoded content;

evaluating a first encoded segment of the encoded content relative to one or more buffer models;

determining whether the first segment of encoded content is to be re-encoded relative to at least one of the one or more of the plurality of buffer models based on the evaluating;

re-encoding the first segment when it is determined that the first segment is to be re-encoded;

identifying a third segment;

identifying that a chapter point is to be inserted into the encoded content relative to the third segment; and

re-encoding the third segment incorporating a chapter point.

16. A method for use in encoding content, comprising:

receiving source content;

encoding the source content producing encoded content;

identifying a total bit count for the encoded content;

determining whether the total bit count has a predefined relationship with a threshold bit count; and

re-encoding one or more segments of the encoded content producing one or more re-encoded segments such that an adjusted total bit count with the re-encoded segments has the predefined relationship with the threshold bit count when the total bit count does not have the predefined relationship with the threshold bit count.

17. The method of claim 16, wherein the re-encoding one or more segments comprises:

identifying a first segment of the encoded content that has a quality level that has a predefined relationship with a buffer model threshold;

re-encoding the first segment producing a first re-encoded segment such that the first re-encoded segment utilizes an amount of bits that is less than an amount of bits utilized by the first segment.

18. The method of claim 17, further comprising:

evaluating a second encoded segment of the encoded content relative to a plurality of buffer models;

determining whether the second segment of encoded content is to be re-encoded relative to one or more of the plurality of buffer models based on the evaluating; and

re-encoding the second segment when it is determined that the second segment is to be re-encoded.

19. The method of claim 17, further comprising:

identifying one or more additional segments of the encoded content that have quality levels that have predefined relationships with the buffer model threshold;

re-encoding the one or more additional segments producing additional re-encoded segments such that the adjusted bit count has a margin that exceeds the predefined relationship relative to the threshold bit count; and

implementing the re-encoding of the second segment when the adjusted bit count has the margin that exceeds the predefined relationship relative to the threshold bit count.

20. A method for use in encoding multimedia content, comprising:

identifying one or more first segments of encoded content having a quality level, that have a predefined relationship with a first threshold limit;

determining whether one or more additional segments having quality levels that have a predefined relationship with a second threshold level and are within predefined ranges from one or more of the first segments;

re-encoding one or more of the additional segments producing one or more re-encoded additional segments having quality levels such that the re-encoded additional segments utilize fewer bits than the one or more additional segments; and

re-encoding one or more of the first segments producing one or more re-encoded first segments such that the one or more re-encoded first segments have quality levels that are greater than the quality levels of the corresponding first segment.

21. The method of claim 20, further comprising:

determine whether a total bit count exceeds a maximum total bit count;

determined whether there is one or more further additional segments having a quality level that has a predefined relationship with a third threshold level and are within the predefined ranges of the one or more first segments; and

re-encoding one or more of the further additional segments producing one or more further additional re-encoded segments such that the one or more further additional re-encoded additional segments utilize fewer bits than the one or more further additional segments.

22. A method for use in formatting content, comprising:

parsing an encoded multimedia content stream identifying parameters of the content stream;

altering one of the identified parameters;

simulating at least a partial decoding of the encoded content stream based on the altered parameter;

identifying whether a buffer threshold is exceed; and

modifying the encoded content stream according to the altered parameter when the buffer threshold is not exceeded determining whether parameters of the encoded content stream match parameters of the encoded content stream with the altered parameter; and

halting the simulating of the at least the partial decoding when parameters of the encoded content stream match parameters of the encoded content stream with the altered parameter.

23. The method of claim 22, wherein the modifying further comprises rewriting a field of the encoded content stream based on the altered parameter.

24. The method of claim 22, wherein the identifying whether the buffer threshold is exceeded comprises determining whether an overflow threshold and an underflow threshold are exceeded.

25. The method of claim 22, further comprising:

identifying parameter boundaries such that the buffer threshold is not exceeded.

26. The method of claim 25, wherein the identifying of the parameter boundaries comprises identifying a maximum bit rate that does not cause an underflow and an overflow.

27. The method of claim 25, wherein the identifying of the parameter boundaries comprises implementing the simulating of the at least the partial decoding based on a model having substantially an infinite buffer size.

28. The method of claim 25, further comprising:

shifting an amount of buffer availability based on one or more of the identified parameter boundaries.

29. The method of claim 25, further comprising:

re-encoding a first segment of the encoded content stream producing a re-encoded content stream;

identifying a parameter of the re-encoded segment; and

merging the parameter of the re-encoded segment with the identified parameters of the encoded content stream.

30. A method for use in formatting content, comprising:

parsing an encoded multimedia content stream identifying parameters of the content stream;

altering one of the identified parameters;

simulating at least a partial decoding of the encoded content stream based on the altered parameter;

identifying whether a buffer threshold is exceed; and

modifying the encoded content stream according to the altered parameter when the buffer threshold is not exceeded;

identifying parameter boundaries such that the buffer threshold is not exceeded;

re-encoding a first segment of the encoded content stream producing a re-encoded content stream;

identifying a parameter of the re-encoded segment; and

merging the parameter of the re-encoded segment with the identified parameters of the encoded content stream;

re-encoding a second segment of the encoded content based at least in part on the merged parameter of the re-encoded segment and the identified parameters of the encoded content stream.

31. A method for use in formatting content, comprising

parsing an encoded multimedia content stream identifying parameters of the content stream;

altering one of the identified parameters;

simulating at least a partial decoding of the encoded content stream based on the altered parameter;

identifying whether a buffer threshold is exceed; and

modifying the encoded content stream according to the altered parameter when the buffer threshold is not exceeded;

identifying parameter boundaries such that the buffer threshold is not exceeded;

re-encoding a first segment of the encoded content stream producing a re-encoded content stream;

identifying a parameter of the re-encoded segment; and

merging the parameter of the re-encoded segment with the identified parameters of the encoded content stream;

identifying that the encoded content stream fails a buffer model;

replacing the identified parameter with a parameter for an alternate buffer model.