Multi-pass variable bitrate media encoding

• US 7,644,002 B2
• Filed: 12/21/2007
• Issued: 01/05/2010
• Est. Priority Date: 07/18/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Thumpudi, Naveen, Chen, Wei-Ge
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US12/004,909
• Publication Number:
  US 20080109230A1
• Time in Patent Office: 746 Days
• Field of Search: 704/500
• US Class Current: 704/500
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Abstract

An encoder uses multi-pass VBR control strategies to provide constant or relatively constant quality for VBR output while guaranteeing (within tolerance) either compressed file size or, equivalently, overall average bitrate. The control strategies include various techniques and tools, which can be used in combination or independently. For example, in a first pass, an audio encoder encodes a sequence of audio data partitioned into variable-size chunks. In a second pass, the encoder encodes the sequence according to control parameters to produce output of relatively constant quality. The encoder sets checkpoints in the second pass to adjust the control parameters and/or subsequent checkpoints. The encoder selectively considers a peak bitrate constraint to limit peak bitrate. The encoder stores auxiliary information from the first pass for use in the second pass, which increases the speed of the second pass. Finally, the encoder compares signatures for the input data to check consistency between passes.

Claims

1. In a computer system, a computer-implemented method of media encoding according to a multi-pass variable bitrate control strategy, the method comprising:

in a first pass, encoding multi-channel media data partitioned into plural variable-size chunks for the encoding, wherein the plural variable-size chunks are plural tiles of the media data;

processing results of the encoding in the first pass to determine one or more control parameters for the media data; and

in a second pass, encoding the media data according to the one or more control parameters in view of a goal of uniform quality at variable bitrate.

2. The method of claim 1 wherein the media data are audio data.

3. The method of claim 1 wherein the processing includes computing a checkpoint, and wherein the encoding in the second pass includes checking results of the encoding in the second pass at the checkpoint.

4. The method of claim 3 further comprising, at the checkpoint in the second pass, adjusting the one or more control parameters and computing a subsequent checkpoint.

5. The method of claim 1 wherein a peak bitrate constraint affects quality and bitrate in the second pass.

6. The method of claim 1 wherein a target total bit count constrains the one or more control parameters in view of complexity of the media data.

7. The method of claim 1 further comprising using auxiliary information from the encoding in the first pass in the encoding in the second pass to increase speed of the encoding in the second pass.

8. The method of claim 1 wherein the encoding in the first pass includes encoding at least part of the media data at plural different quality settings.

9. The method of claim 1 wherein the encoding in the first pass includes computing triplets for the plural variable-size chunks, wherein each of the triplets includes a value for each of quantization step size, bits, and quality setting.

10. The method of claim 1 wherein the one or more control parameters include a target quality setting.

11. The method of claim 1 further comprising repeating the processing during the encoding in the second pass such that the one or more control parameters influence and are influenced by the encoding in the second pass.

12. The method of claim 1 further comprising comparing signatures for the first and second passes, wherein the signatures for the first and second passes comprise a first value and a second value, respectively, derived from input for a portion of the media data, wherein the comparing checks that the input is consistent between the first pass and the second pass, and wherein the encoding in the second pass ends if the signatures indicate a discrepancy in the media data between the first and second passes.

13. The method of claim 1 wherein plural windows from different channels of frames of the media data are grouped into the plural tiles, and wherein each tile of the plural tiles groups one or more co-located windows of the same size among the plural windows from the different channels of the frames of the media data.

14. In a computer system, a computer-implemented method of audio encoding according to a multi-pass variable bitrate control strategy, the method comprising:

in a first pass, encoding audio data, including computing triplets for plural chunks of the audio data, wherein each of the triplets includes a value for each of quantization step size, bits, and quality setting; and

in a second pass, encoding audio data to produce variable bitrate output at a target quality level.

15. The method of claim 14 wherein the encoding in the first pass includes computing three or more triplets for at least one of the plural chunks.

16. The method of claim 14 wherein the encoding in the first pass includes computing triplets for a given one of the plural chunks until the computed triplets describe a useful range of a step-rate-distortion pattern for the given chunk.

17. In an audio encoder, a computer-implemented method of audio encoding according to a multi-pass variable bitrate control strategy, the method comprising:

in a first pass, encoding a sequence of multi-channel audio data, wherein the sequence includes plural chunks, and wherein the plural chunks are tiles of the audio data; and

in a second pass, encoding the sequence of audio data in view of a goal of uniform quality at variable bitrate, wherein the encoding in the second pass includes checking results at each of plural checkpoints, and wherein each of the plural checkpoints is separated from other checkpoints by at least two chunks.

18. The method of claim 17 wherein the checkpoints are set at defined points of progression towards a target total bit count for the sequence.

19. The method of claim 17 further comprising adjusting the checkpoints during the second pass.

20. The method of claim 17 further comprising adjusting a target quality at one or more of the plural checkpoints to improve uniformity of quality in the sequence.