Multi-pass variable bitrate media encoding

• US 7,343,291 B2
• Filed: 07/18/2003
• Issued: 03/11/2008
• Est. Priority Date: 07/18/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Thumpudi, Naveen, Chen, Wei-Ge
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US10/623,338
• Publication Number:
  US 20050015246A1
• Time in Patent Office: 1,698 Days
• Field of Search: 704/500
• US Class Current: 704/500
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Abstract

An encoder uses multi-pass VBR control strategies to provide constant or relatively constant quality for VBR output while guaranteeing (within tolerance) either compressed file size or, equivalently, overall average bitrate. The control strategies include various techniques and tools, which can be used in combination or independently. For example, in a first pass, an audio encoder encodes a sequence of audio data partitioned into variable-size chunks. In a second pass, the encoder encodes the sequence according to control parameters to produce output of relatively constant quality. The encoder sets checkpoints in the second pass to adjust the control parameters and/or subsequent checkpoints. The encoder selectively considers a peak bitrate constraint to limit peak bitrate. The encoder stores auxiliary information from the first pass for use in the second pass, which increases the speed of the second pass. Finally, the encoder compares signatures for the input data to check consistency between passes.

Claims

1. In a computer system, a computer-implemented method of media encoding according to a multi-pass control strategy, the method comprising:

in a first pass, encoding media data;

storing auxiliary information from the encoding in the first pass, wherein the stored auxiliary information is side information to be output in a bitstream and used in decoding; and

in a second pass, encoding the media data, including using the stored auxiliary information to increase speed of the encoding in the second pass.

2. The method of claim 1 wherein the media data are audio data.

3. The method of claim 1 wherein the auxiliary information comprises mask values.

4. The method of claim 1 wherein the auxiliary information comprises tile configurations.

5. The method of claim 1 wherein the auxiliary information comprises multi-channel transforms.

6. The method of claim 1 wherein the encoding in the second pass produces variable bitrate output around a target quality.

7. In a computer system, a computer-implemented method comprising:

in a first pass, computing a first pass signature for each of one or more portions of media data and encoding the one or more portions, wherein the first pass signature for each of the one or more portions comprises a value derived from input of the portion; and

in a second pass,

computing a second pass signature for a given portion of the one or more portions, wherein the second pass signature for the given portion comprises a value derived from input of the given portion;

comparing the second pass signature with the first pass signature for the given portion so as to check that the input for the given portion is consistent between the first pass and the second pass;

if the first pass signature matches the second pass signature, encoding the given portion;

otherwise, performing one or more alternative actions.

8. The method of claim 7 wherein the media data are audio data.

9. The method of claim 7 wherein the portions are chunks.

10. The method of claim 7 wherein the first pass and second pass signatures are based at least in part upon an XOR of input bytes of media data.

11. The method of claim 7 wherein the first and second passes are part of a multi-pass variable bitrate control strategy.

12. The method of claim 7 wherein the one or more alternative actions include stopping the second pass.

13. The method of claim 7 wherein the one or more alternative actions include notifying the user.

14. The method of claim 7 wherein the one or more alternative actions include encoding the given portion using alternative encoding techniques.

15. In an audio encoder, a computer-implemented method of audio encoding according to a multi-pass variable bitrate control strategy, the method comprising:

in a first pass, encoding a sequence of audio data;

storing auxiliary information from the encoding in the first pass, wherein the stored auxiliary information is side information to be output in a bitstream and used in decoding; and

in a second pass, encoding the sequence of audio data in view of a goal of uniform quality at variable bitrate, wherein a peak bitrate constraint affects quality and bitrate in the second pass, and wherein the stored auxiliary information is used to increase speed of the encoding in the second pass.

16. The method of claim 15 wherein the audio encoder models a decoder buffer to test the peak bitrate constraint.

17. The method of claim 16 wherein the audio encoder reduces a target quality to avoid underflow in the decoder buffer.

18. In a media encoder, a computer-implemented method of media encoding, the method comprising:

selectively enabling or disabling a peak bitrate constraint for a sequence of media data;

in a first pass, encoding the sequence of media data;

storing auxiliary information from the encoding in the first pass, wherein the stored auxiliary information is side information to be output in a bitstream and used in decoding; and

in a second pass, encoding the sequence of media data, wherein the peak bitrate constraint affects quality and bitrate in the second pass if the peak bitrate constraint is enabled for the sequence, and wherein the stored auxiliary information is used to increase speed of the encoding in the second pass.

19. The method of claim 18 wherein the media data are audio data.

20. The method of claim 18 wherein the media encoder models a decoder buffer to test the peak bitrate constraint.

21. The method of claim 20 wherein the media encoder adjusts one or more control parameters to avoid underflow in the decoder buffer.

22. In a media encoder, a computer-implemented method of media encoding, the method comprising:

in a first pass, encoding media data;

processing results of the encoding in the first pass, wherein the processing includes setting a checkpoint at a defined percentage of a target total bit count for the media data, wherein the checkpoint is defined in terms of cumulative bit count in encoding of the media data; and

in a second pass, encoding media data, wherein the encoding in the second pass includes checking results of the encoding in the second pass as of the checkpoint.

23. The method of claim 22 wherein the media data are audio data.

24. The method of claim 22 wherein the encoding in the second pass further includes adjusting a target quality level based at least in part upon the results of the encoding in the second pass as of the checkpoint.

25. The method of claim 22 further comprising, at the checkpoint, computing a subsequent checkpoint at a multiple of the defined percentage of the target total bit count, wherein the encoding in the second pass further includes checking results of the encoding in the second pass as of the subsequent checkpoint.

31. The method of claim 22 wherein the checkpoint is further defined in terms of cumulative input encoded, and wherein the encoder reaches the checkpoint when the encoder reaches the cumulative time elapsed or the cumulative input encoded during the second pass.

32. The method of claim 31 wherein the cumulative input encoded is measured by elapsed time or number of chunks of input.

26. In a media encoder, a computer-implemented method of media encoding, the method comprising:

in a first pass, encoding a sequence of media data;

setting a checkpoint for encoding in a second pass, wherein the checkpoint is defined in terms of cumulative bit count in encoding of the media data; and

in the second pass, iteratively;

encoding media data up to the checkpoint,

checking results of encoding in the second pass up to the checkpoint, and

updating the checkpoint for the encoding in the second pass, wherein the second pass continues until the sequence of media data is encoded.

27. The method of claim 26 wherein the media data are audio data.

28. The method of claim 26 further comprising:

in the second pass, after the checking, adjusting one or more control parameters if necessary based upon the results of encoding in the second pass up to the checkpoint, thereby improving uniformity of quality for the sequence.

29. The method of claim 28 wherein a first control parameter of the one or more control parameters is a target quality level.

33. The method of claim 26 wherein the checkpoint is further defined in terms of cumulative input encoded, and wherein the encoder reaches the checkpoint when the encoder reaches the cumulative time elapsed or the cumulative input encoded during the second pass.

34. The method of claim 33 wherein the cumulative input encoded is measured by elapsed time or number of chunks of input.

30. In a media encoder, a computer-implemented method of media encoding, the method comprising:

in a first pass, encoding a sequence of media data;

setting a checkpoint for encoding in a second pass; and

in the second pass, iteratively;

encoding media data up to the checkpoint,

checking results of encoding in the second pass up to the checkpoint, and

updating the checkpoint for the encoding in the second pass, wherein the second pass continues until the sequence of media data is encoded, wherein the checkpoint is set and updated at multiples of a percentage of a target total bit count for the sequence.