Automatic equalization of coloration in speech recordings

• US 8,965,756 B2
• Filed: 03/14/2011
• Issued: 02/24/2015
• Est. Priority Date: 03/14/2011
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Duwenhorst, Sven, Schmitz, Martin
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US13/047,422
• Publication Number:
  US 20120239391A1
• Time in Patent Office: 1,443 Days
• Field of Search: 130/200, 130/200.1, 130/205, 130/225, 130226-228, 130/231, 130/233, 704/200, 704/200.1, 704/205, 704/225, 704226-228, 704/231, 704/233
• US Class Current: 704/225
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04S 2400/15 Aspects of sound capture and related signal processing for recording or reproduction

Abstract

Systems and methods to automatically equalize coloration in speech recordings is provided. In example embodiments, a reference spectral shape based on a reference signal is determined. An estimated spectral shape for an input signal is derived. Using the estimated spectral shape and the reference spectral shape a comparison is performed to determine gain settings. The gain settings comprise a gain value for each filter of a filter system. Using gain values associated with the gain setting, automatic equalization is performed on the input signal.

Claims

1. A method comprising:

defining a reference spectral shape based on a reference signal;

deriving an estimated spectral shape for an input signal that comprises an audio signal, wherein the deriving comprises using a plurality of averagers to measure the input signal, wherein at least two averagers of the plurality of averagers comprise a short time constant averager, a mid time constant averager, or a long time constant averager, wherein the at least two averagers have different time constants;

comparing, using one or more processors, the estimated spectral shape to the reference spectral shape to determine gain settings, the gain settings comprising a gain value for each filter of a filter system;

automatically performing equalization on the input signal using gain values associated with the gain settings to provide an equalized signal; and

outputting the equalized signal to a signal output device.

2. The method of claim 1, further comprising normalizing the input signal based on a normalization threshold prior to deriving the estimated spectral shape.

3. The method of claim 1, wherein each of the plurality of averagers has a different time constant.

4. The method of claim 3, further comprising comparing values of each individual band of each of the plurality of averagers to determine a measured value used to derive the estimated spectral shape.

5. The method of claim 4, wherein the comparing values of each individual band of each of the plurality of averagers comprises setting a long time constant value equal to a short time constant value or mid time constant value based on the short time constant value or the mid time constant value, respectively, exceeding the long time constant value.

6. The method of claim 3, wherein the deriving of the estimated spectral shape comprises averaging values from the plurality of averagers to obtain an average value across the plurality of averagers.

7. The method of claim 3, further comprising:

using the short time constant averager of the plurality of averagers to determine a short time constant value;

using the mid time constant averager of the plurality of averagers to determine a mid time constant value; and

using the long time constant averager of the plurality of averagers to determine a long time constant value.

8. The method of claim 1, further comprising:

determining whether each gain value of the gain settings exceeds a gain threshold; and

based on at least one gain value of the gain settings exceeding the gain threshold, setting the at least one gain value to the gain threshold to generate a modified gain value.

9. The method of claim 8, wherein automatically performing equalization comprises using a plurality of filters to automatically apply the gain values and the modified gain value to the input signal.

10. A system comprising:

one or more processors; and

one or more computer storage media storing a plurality of computer software components executable by the one or more processors, the plurality of computer software components comprising;

a reference model module configured to define a reference spectral shape based on a reference signal,

a plurality of averagers configured to measure an input signal comprising an audio signal, wherein at least two averagers of the plurality of averagers comprise a short time constant averager, a mid time constant averager, or a long time constant averager, wherein the at least two averagers have different time constants,

an input model module configured to derive, based on outputs of the plurality of averagers, an estimated spectral shape for the input signal,

a comparison module configured to compare the estimated spectral shape to the reference spectral shape to determine gain settings, the gain settings comprising a gain value for each filter of a filter system,

the filter system, wherein the filter system is configured to provide an equalized signal by automatically performing equalization on the input signal using gain values associated with the gain settings, and

an output module configured to output the equalized signal to a signal output device.

11. The system of claim 10, further comprising a normalizer configured to normalize the input signal based on a normalization threshold prior to deriving the estimated spectral shape.

12. The system of claim 10, wherein each of the plurality of averagers has a different time constant.

13. The system of claim 12, wherein the input model module is further configured to compare values of each individual band of each of the plurality of averagers to determine a measured value used to derive the estimated spectral shape.

14. The system of claim 10, further comprising a gain controller configured to determine whether each gain value of the gain settings exceeds a gain threshold, and based on at least one gain value exceeding the gain threshold, setting the at least one gain value to the gain threshold to generate a modified gain value.

15. The system of claim 10, wherein the plurality of averagers comprises the short time constant averager, the mid time constant averager, and the long time constant averager.

16. A non-transitory machine-readable storage medium in communication with at least one processor, the machine-readable storage medium storing instructions which, when executed by the at least one processor, performs a method comprising:

defining a reference spectral shape based on a reference signal;

deriving an estimated spectral shape for an input signal that comprises an audio signal, wherein the deriving comprises using a plurality of averagers to measure the input signal, wherein at least two averagers of the plurality of averagers comprise a short time constant averager, a mid time constant averager, or a long time constant averager, wherein the at least two averagers have different time constants;

comparing, using one or more processors, the estimated spectral shape to the reference spectral shape to determine gain settings, the gain settings comprising a gain value for each filter of a filter system;

automatically performing equalization on the input signal using gain values associated with the gain settings to provide an equalized signal; and

outputting the equalized signal to a signal output device.

17. The non-transitory machine-readable storage medium of claim 16, wherein the method further comprises normalizing the input signal based on a normalization threshold prior to deriving the estimated spectral shape.

18. The non-transitory machine-readable storage medium of claim 16, wherein each of the plurality of averagers has a different time constant.

19. The non-transitory machine-readable storage medium of claim 18, wherein the method further comprises comparing values of each individual band of each of the plurality of averagers to determine a measured value used to derive the estimated spectral shape.

20. The non-transitory machine-readable storage medium of claim 19, wherein the method further comprises:

determining whether each gain value of the gain settings exceeds a gain threshold; and

based on at least one gain value exceeding the gain threshold, setting the at least one gain value to the gain threshold to generate a modified gain value.