METHOD, APPARATUS AND SYSTEM FOR USE IN MULTIMEDIA SIGNAL ENCODING

• US 20070002946A1
• Filed: 06/30/2006
• Published: 01/04/2007
• Est. Priority Date: 07/01/2005
• Status: Active Grant

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: Sonic Solutions (Adeia Inc.)
• Inventors: Palmer, Matthew, Randall, Bruce, Bouton, Peter
• Granted Patent: US 8,175,167 B2
• Time in Patent Office: Days
• US Class Current: 375/240.10
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/194 involving only two passes
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

The present embodiments provide methods, apparatuses, systems for use in encoding and/or formatting content, such as multimedia content. Some embodiments provide methods for use in encoding content. These methods receive source content, encode the source content producing encoded content, evaluate a first encoded segment of the encoded content relative to a plurality of buffer models, determine whether the first segment of encoded content is to be re-encoded relative to one or more of the plurality of buffer models based on the evaluation; and re-encode the first segment when it is determined that the first segment is to be re encoded

Claims

1. A method for use in encoding content, the method comprising:

receiving source content;

encoding the source content producing encoded content;

evaluating a first encoded segment of the encoded content relative to a plurality of buffer models;

determining whether the first segment of encoded content is to be re-encoded relative to one or more of the plurality of buffer models based on the evaluating; and

re-encoding the first segment when it is determined that the first segment is to be re-encoded.

2. The method of claim 1, wherein the determining whether the first segment of the encoded content is to be re-encoded comprises determining whether the encoded content fails a first buffer model of the plurality of buffer models;

and

the re-encoding comprises re-encoding the first segment when it is determined that the encoded content fails a first buffer model.

3. The method of claim 2, further comprising:

identifying that the encoded content fails a second buffer model of the plurality of buffer models;

invalidating the second buffer model relative to the encoded content.

4. The method of claim 3, wherein the invalidating the second buffer model comprises replacing parameters of the second buffer model with parameters from a fourth buffer model that is a valid buffer model.

5. The method of claim 1, further comprising:

identifying a second segment of the encoded content;

re-encoding the second segment freeing up bits; and

the re-encoding of the first segment comprises re-encoding the first segment to utilize the freed up bits.

6. The method of claim 1, further comprising:

identifying a third segment;

identifying that a chapter point is to be inserted into the encoded content relative to the third segment;

re-encoding the third segment incorporating a chapter point.

7. The method of claim 1, wherein the re-encoding the first segment comprises re-encoding the first segment creating a first re-encoded segment;

storing the first re-encoded segment separate from the encoded content; and

finalizing the encoding of the source content comprising merging the first re-encoded content with the encoded content and adjusting a buffer level and access unit information of the encoded content with buffer level and access unit information of the first re-encoded segment.

8. The method of claim 1, wherein the evaluating of the first encoded segment comprises substantially simultaneously decoding a portion of the first encoded segment according to a plurality of distinct buffer models.

9. The method of claim 1, wherein the encoding the content comprises:

identifying segments of the source content;

separating the segments of the source content;

separately encoding the segments of the source content producing encoded divided segments;

splicing the encoded divided segments producing an encoded content stream.

10. The method of claim 9, further comprising:

identifying a complexity of the source content;

adjusting buffer levels according to the identified complexity for the segments of the source content.

11. The method of claim 9, further comprising:

evaluating temporal correlations of the source content;

identifying boundaries within the source content such that the identifying of the segments of the source content comprises defining the segments according to the identified boundaries.

12. A method for use in encoding multimedia content, the method comprising:

initiating an encoding of a source content producing encoded content;

identifying a segment of the encoded content to be re-encoded;

identifying a first candidate start point for a re-encoding of the segment;

determining whether the first candidate start point is a valid start point by evaluating a first portion of the encoded content relative to the first candidate start point; and

setting the first candidate start point as a valid re-encode start point when the first candidate start point is validated.

13. The method of claim 12, wherein the determining whether the first candidate start point is valid comprises determining whether the first portion of the content prior to the first candidate start point is referenced by a second portion of the content following the first candidate start point relative to a playback timeline;

and

implementing the setting of the first candidate start point as the re-encode start point when the second portion of the content following the first candidate start point does not reference the first portion of the content prior to the first candidate start point.

14. The method of claim 12, further comprising:

identifying a first candidate end point for the re-encoding of the segment;

determining whether the first candidate end point is a valid end point by evaluating a fourth portion of the encoded content relative to the first candidate end point; and

setting the first candidate end point as a valid re-encode end point when the first candidate end point is validated.

15. The method of claim 14, wherein determining whether the first candidate end point is valid comprises determining whether at least a portion of content within a candidate segment between the valid re-encode start point and the first candidate end point is referenced by content outside the candidate segment;

and

implementing the setting of the first candidate end point as the valid re-encode end point when the at least the portion of the content within the candidate segment is not referenced by content outside the candidate segment.

16. The method of claim 12, wherein the determining whether the first candidate start point is valid comprises accessing an index for a frame prior to the first candidate start point relative to a playback timeline and determining whether the index contains a listing of a frame following the first candidate start point relative to the playback timeline;

and

implementing the setting of the first candidate start point as the re-encode start point when the index does not contains the listing of the frame following the first candidate start point.

17. The method of claim 12, further comprising:

upgrading the first candidate start point to an intraframe.

18. A method for use in encoding multimedia content, the method comprising:

initiating an encoding of a source content producing encoded content;

identifying a segment of the encoded content to be re-encoded;

identifying a first candidate end point for the re-encoding of the segment;

determining whether the first candidate end point is a valid end point by evaluating a fourth portion of the encoded content relative to the first candidate end point; and

setting the first candidate end point as a valid re encode end point when the first candidate end point is validated.

19. A method for use in encoding content, comprising:

receiving source content;

encoding the source content producing encoded content;

identifying a total bit count for the encoded content;

determining whether the total bit count has a predefined relationship with a threshold bit count; and

re-encoding one or more segments of the encoded content producing one or more re-encoded segments such that an adjusted total bit count with the re-encoded segments has the predefined relationship with the threshold bit count when the total bit count does not have the predefined relationship with the threshold bit count.

20. The method of claim 19, wherein the re-encoding one or more segments comprises:

identifying a first segment of the encoded content that has a quality level that has a predefined relationship with a buffer model threshold;

re-encoding the first segment producing a first re-encoded segment such that the first re-encoded segment utilizes an amount of bits that is less than an amount of bits utilized by the first segment.

21. The method of claim 20, further comprising:

evaluating a second encoded segment of the encoded content relative to a plurality of buffer models;

determining whether the second segment of encoded content is to be re-encoded relative to one or more of the plurality of buffer models based on the evaluating; and

re-encoding the second segment when it is determined that the second segment is to be re-encoded.

22. The method of claim 20, further comprising:

identifying one or more additional segments of the encoded content that have quality levels that have predefined relationships with the buffer model threshold;

re-encoding the one or more additional segments producing additional re encoded segments such that the adjusted bit count has a margin that exceeds the predefined relationship relative to the threshold bit count; and

implementing the re-encoding of the second segment when the adjusted bit count has the margin that exceeds the predefined relationship relative to the threshold bit count.

23. A method for use in encoding multimedia content, comprising:

identifying one or more first segments of encoded content having a quality level having a predefined relationship with a first threshold limit;

determining whether one or more additional segments having quality levels that have a predefined relationship with a second threshold level and are within predefined ranges from one or more of the first segments;

re-encoding one or more of the additional segments producing one or more re-encoded additional segments having quality levels such that the re-encoded additional segments utilize fewer bits than the one or more additional segments; and

re-encoding one or more of the first segments producing one or more re-encoded first segments such that the one or more re-encoded first segments have quality levels that are greater than the quality levels of the corresponding first segment.

24. The method of claim 23, further comprising:

determine whether a total bit count exceeds a maximum total bit count;

determined whether there is one or more further additional segments having a quality level that has a predefined relationship with a third threshold level and are within the predefined ranges of the one or more first segments; and

re-encoding one or more of the further additional segments producing one or more further additional re-encoded segments such that the one or more further additional re-encoded additional segments utilize fewer bits than the one or more further additional segments.

25. A method for use in formatting content, comprising:

parsing an encoded multimedia content stream identifying parameters of the content stream;

altering one of the identified parameters;

simulating at least a partial decoding of the encoded content stream based on the altered parameter;

identifying whether a buffer threshold is exceed; and

modifying the encoded content stream according to the altered parameter when the buffer threshold is not exceeded.

26. The method of claim 25, wherein the modifying further comprises rewriting a field of the encoded content stream based on the altered parameter.

27. The method of claim 25, wherein the identifying whether the buffer threshold is exceeded comprises determining whether an overflow threshold and an underflow threshold are exceeded.

28. The method of claim 25, further comprising:

determining whether parameters of the encoded content stream match parameters of the encoded content stream with the altered parameter; and

halting the simulating of the at least the partial decoding when parameters of the encoded content stream match parameters of the encoded content stream with the altered parameter.

29. The method of claim 25, further comprising:

identifying parameter boundaries such that the buffer threshold is not exceeded.

30. The method of claim 29, wherein the identifying of the parameter boundaries comprises identifying a maximum bit rate that does not cause an underflow and an overflow.

31. The method of claim 29, wherein the identifying of the parameter boundaries comprises implementing the simulating of the at least the partial decoding based on a model having substantially an infinite buffer size.

32. The method of claim 29, further comprising:

shifting an amount of buffer availability based on one or more of the identified parameter boundaries.

33. The method of claim 29, further comprising:

re-encoding a first segment of the encoded content stream producing a re-encoded content stream;

identifying a parameter of the re-encoded segment; and

merging the parameter of the re-encoded segment with the identified parameters of the encoded content stream.

34. The method of claim 33, further comprising:

re-encoding a second segment of the encoded content based at least in part on the merged parameter of the re-encoded segment and the identified parameters of the encoded content stream.

35. The method of claim 33, further comprising:

identifying that the encoded content stream fails a buffer model;

replacing the identified parameter with a parameter for an alternate buffer model.

36. A method for use facilitating an encoding of digital content, comprising:

generating a bit rate track graphically representing bit rates for portions of encoded content;

generating a quality track graphically representing a quality of encoding of the portions of encoded content that corresponds with the bit rate track; and

identifying in the bit rate track a selection of a portion of the encoded content to be re-encoded.

37. The method of claim 36, further comprising:

generating an entry point track graphically representing entry points, where the entry point track corresponds with the bit rate track; and

generating a picture structure track graphically representing picture structures of the encoded content, where the picture structure track corresponds with the bit rate track.

38. The method of claim 36, further comprising:

providing selectable re-encode start point and end point options; and

providing zooming capabilities to zoom in and out on at least the bit rate track.

39. The method of claim 36, further comprising:

generating a bit rate indication for a selected segment of content;

registering an input moving the bit rate indicator.

40. The method of claim 39, wherein the bit rate indicator is a bit rate bar that is selectable and moveable by a user.

41. The method of claim 39, further comprising:

a bit rate value corresponding with a positioning of the bit rate indication.

42. The method of claim 36, further comprising:

generating settings options comprising a quality threshold and a segment length parameter;

identifying segments within the encoded content that have quality levels that are below the quality threshold and meet the segment length parameter.

43. The method of claim 36, further comprising:

generating a list of selected segments and defining a status of each segment in the list.