Method and apparatus for estimating subjective audio signal quality from objective distortion measures

• US 6,609,092 B1
• Filed: 12/16/1999
• Issued: 08/19/2003
• Est. Priority Date: 12/16/1999
• Status: Expired due to Fees

• Current Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Kim, Doh-Suk, Ghitza, Oded, Kroon, Peter
• Primary Examiner(s): Abebe, Daniel
• Application Number:
  US09/464,901
• Time in Patent Office: 1,342 Days
• Field of Search: 704/226, 704/228, 704/200, 704/501, 704/201, 455/423, 455/424, 455/425
• US Class Current: 704/226
• CPC Class Codes: G10L 25/69 for evaluating synthetic or decoded voice signals

Abstract

A mapping function is generated between subjective measures of audio signal quality, e.g., mean opinion score (MOS) or degradation MOS (DMOS) measures, and corresponding objective distortion measures, e.g., auditory speech quality measures (ASQMs) or perceptual speech quality measures (PSQMs), for known audio signals. The subjective measures and corresponding objective distortion measures are determined in accordance with modulated noise reference unit (MNRU) conditions or other suitable distortion conditions placed on the source speech, and a regression analysis is applied to the results to generate the mapping function. The mapping function may then be utilized, e.g., to evaluate speech quality of additional source speech from a particular speech coding system. In this case, the objective distortion measure is generated using the additional source speech, and the resulting objective measure is applied as an input to the mapping function to generate an estimate of the value of the subjective measure. Advantageously, the mapping function is database-independent, and can thus be used, e.g., to generate accurate estimates of subjective measures of speech quality for speech databases unrelated to those used in generating the mapping function.

Claims

1. A method of estimating audio signal quality, the method comprising the steps of:

generating a mapping function between a plurality of actual subjective measures determined for a given set of audio signals and corresponding objective distortion measures determined for the given set of audio signals; and

utilizing the mapping function to generate an estimated subjective measure from an objective distortion measure determined for another audio signal;

wherein a portion of at least one of the objective distortion measures associated with an mth frame of a given source speech sequence is given by $D<br><br>\left(m\right)=\underset{i=1}{\overset{N_b}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>C<br><br>\left(m,i\right)<br><br><br><br>X<br><br>\left(m,i\right)-Y<br><br>\left(m,i\right)<br><br>$

where X(m, i) and Y(m, i) are auditory representations of source and processed speech, respectively, for the sequence, 1≦

i≦

N_b denotes a frequency bin index, N_b is the dimension of a frame vector, and C(m, i) is an asymmetric weighting factor;

wherein an overall auditory-based objective distortion measure between the source and processed speech sequences X and Y is determined by

2. The method of claim 1 wherein the mapping function is generated by performing a regression analysis on the plurality of subjective measures and corresponding auditory-based objective distortion measures generated for each of N different source databases;

and

wherein the other audio signal for which the subjective measure is estimated is associated with a database that is independent of the N different source databases used in generating the mapping function.

3. The method of claim 1 wherein at least a subset of the audio signals comprise speech signals.

4. The method of claim 1 wherein at least a subset of the plurality of subjective measures and the estimated subjective measure comprise at least one of a mean opinion score (MOS) and a degradation MOS (DMOS).

5. The method of claim 1 wherein a given one of the objective distortion measures is generated by measuring a difference between an unprocessed audio signal and a corresponding processed audio signal.

6. The method of claim 1 wherein at least a subset of the objective distortion measures comprise auditory-based distortion measures based on one or more peripheral properties of an auditory system.

7. The method of claim 6 wherein at least a subset of the auditory-based objective distortion measures comprise an auditory speech quality measure (ASQM).

8. The method of claim 1 wherein at least a subset of the objective distortion measures comprise perceptual distortion measures based on one or more cognitive properties of an auditory system.

9. The method of claim 8 wherein at least a subset of the perceptual distortion measures comprise a perceptual speech quality measure (PSQM).

10. The method of claim 1 wherein the plurality of subjective measures and the corresponding objective distortion measures are determined in accordance with designated distortion conditions applied to the given set of audio signals.

11. The method of claim 10 wherein the designated distortion conditions comprise modulated noise reference unit (MNRU) conditions.

12. An apparatus comprising a processing system operative to generate a mapping function between a plurality of actual subjective measures determined for a given set of audio signals and corresponding objective distortion measures determined for the given set of audio signals, and to utilize the mapping function to generate an estimated subjective measure from an objective distortion measure determined for another audio signal;

wherein a portion of at least one of the objective distortion measures associated with an mth frame of a given source speech sequence is given by $D<br><br>\left(m\right)=\underset{i=1}{\overset{N_b}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>C<br><br>\left(m,i\right)<br><br><br><br>X<br><br>\left(m,i\right)-Y<br><br>\left(m,i\right)<br><br>$

where X(m, i) and Y(m, i) are auditory representations of source and processed speech, respectively, for the sequence, 1≦

i≦

N_b denotes a frequency bin index, N_b is the dimension of a frame vector, and C(m, i) is an asymmetric weighting factor;

wherein an overall auditory-based objective distortion measure between the source and processed speech sequences X and Y is determined by

13. The apparatus of claim 12 wherein the processing system comprises a processor and an associated memory;

wherein the mapping function is generated by performing a regression analysis on the plurality of subjective measures and corresponding auditory-based objective distortion measures generated for each of N different source databases; and

wherein the other audio signal for which the subjective measure is estimated is associated with a database that is independent of the N different source databases used in generating the mapping function.

14. The apparatus of claim 12 wherein at least a subset of the audio signals comprise speech signals.

15. The apparatus of claim 12 wherein at least a subset of the plurality of subjective measures and the estimated subjective measure comprise at least one of a mean opinion score (MOS) and a degradation MOS (DMOS).

16. The apparatus of claim 12 wherein a given one of the objective distortion measures is generated by measuring a difference between an unprocessed audio signal and a corresponding processed audio signal.

17. The apparatus of claim 12 wherein at least a subset of the objective distortion measures comprise auditory-based distortion measures based on one or more peripheral properties of an auditory system.

18. The apparatus of claim 17 wherein at least a subset of the auditory-based objective distortion measures comprise an auditory speech quality measure (ASQM).

19. The apparatus of claim 12 wherein at least a subset of the objective distortion measures comprise perceptual distortion measures based on one or more cognitive properties of an auditory system.

20. The apparatus of claim 19 wherein at least a subset of the perceptual distortion measures comprise a perceptual speech quality measure (PSQM).

21. The apparatus of claim 12 wherein the plurality of subjective measures and the corresponding objective distortion measures are determined in accordance with designated distortion conditions applied to the given set of audio signals.

22. The apparatus of claim 21 wherein the designated distortion conditions comprise modulated noise reference unit (MNRU) conditions.

23. An article of manufacture comprising a machine-readable medium for storing one or more software programs which when executed in a data processor implement the steps of:

generating a mapping function between a plurality of actual subjective measures determined for a given set of audio signals and corresponding objective distortion measures determined for the given set of audio signals; and

utilizing the mapping function to generate an estimated subjective measure from an objective distortion measure determined for another audio signal;

wherein a portion of at least one of the objective distortion measures associated with an mth frame of a given source speech sequence is given by $D<br><br>\left(m\right)=\underset{i=1}{\overset{N_b}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>C<br><br>\left(m,i\right)<br><br><br><br>X<br><br>\left(m,i\right)-Y<br><br>\left(m,i\right)<br><br>$

where X(m, i) and Y(m, i) are auditory representations of source and processed speech, respectively, for the sequence, 1≦

i≦

N_b denotes a frequency bin index, N_b is the dimension of a frame vector, and C(m, i) is an asymmetric weighting factor;

wherein an overall auditory-based objective distortion measure between the source and processed speech sequences X and Y is determined by