Apparatus and method for speech utterance verification

• US 20100004931A1
• Filed: 09/15/2006
• Published: 01/07/2010
• Est. Priority Date: 09/15/2006
• Status: Abandoned Application

• Current Assignee: Agency For Science Technology and Research
• Original Assignee: Agency For Science Technology and Research
• Inventors: Dong, Minghui, Li, Haizhou, Ma, Bin
• Application Number:
  US12/311,008
• Publication Number:
  US 20100004931A1
• Time in Patent Office: Days
• US Class Current: 704/244
• CPC Class Codes: G10L 15/08 Speech classification or search

Abstract

An apparatus is provided for speech utterance verification. The apparatus is configured to compare a first prosody component from a recorded speech with a second prosody component for a reference speech. The apparatus determines a prosodic verification evaluation for the recorded speech utterance in dependence of the comparison.

Claims

1. An apparatus for speech utterance verification, the apparatus being configured to compare a first prosody component derived from a recorded speech utterance with a corresponding second prosody component for a reference speech utterance and to determine a prosodic verification evaluation for the recorded speech utterance unit in dependence of the comparison.

2. The apparatus according to claim 1, wherein the apparatus is configured to determine the prosodic verification evaluation from a comparison of first and second prosody components which are corresponding components for at least one of:

speech utterance unit duration;

speech utterance unit pitch contour;

speech utterance rhythm; and

speech utterance intonation;

of the recorded and reference speech utterances respectively.

3. The apparatus according to claim 2, the apparatus being configured to determine the prosodic verification evaluation from a comparison of first and second prosody components for speech utterance unit duration from a transform of a normalised duration deviation of the recorded speech utterance unit duration to provide a transformed normalised duration deviation.

4. The apparatus according to claim 2, the apparatus being configured to determine the prosodic verification evaluation from a comparison of first and second groups of prosody components for speech utterance unit pitch contour from:

a transform of a prosody component of the recorded speech utterance unit to provide a transformed prosody component;

a comparison of the transformed prosody component with a corresponding predicted prosody component derived from the reference speech utterance unit to provide a normalised transformed prosody component;

a vectorisation of a plurality of normalised transformed prosody components to form a normalised parameter vector; and

a transform of the normalised parameter vector to provide a transformed normalised parameter vector.

5. The apparatus according to claim 2, the apparatus being configured to determine the prosodic verification evaluation from a comparison of first and second prosody components for speech utterance rhythm from:

a determination of recorded time intervals between pairs of recorded speech utterance units;

a determination of reference time intervals between pairs of reference speech utterance units;

a normalisation of the recorded time intervals with respect to the reference time intervals to provide a normalised time interval deviation for each pair of recorded speech utterance units; and

a transform of a sum of a plurality of normalised time interval deviations to provide a transformed normalised time interval deviation.

6. The Apparatus according to claim 2, the apparatus being configured to determine the prosodic verification evaluation from a comparison of first and second prosody components for speech utterance intonation from:

a determination of the recorded pitch mean of a plurality of recorded speech utterance units;

a determination of the reference pitch mean of a plurality of reference speech utterance units;

a normalisation of the recorded pitch mean and the reference pitch mean to provide a normalised pitch deviation; and

a transform of a sum of a plurality of normalised pitch deviations to provide a transformed normalised pitch deviation.

7. The apparatus according to claim 2, wherein the apparatus is configured to determine a composite prosodic verification evaluation from one or more of:

the transformed normalised duration deviation;

the transformed normalised parameter vector;

the transformed normalised time interval deviation; and

the transformed normalised pitch deviation.

8. The apparatus according to claim 7, wherein the apparatus is configured to determine a composite prosodic verification evaluation from a weighted sum of at least two of:

the transformed normalised duration deviation;

the transformed normalised parameter vector;

the transformed normalised time interval deviation; and

the transformed normalised pitch deviation.

9. The apparatus according to claim 1, the apparatus being configured to:

generate a recorded speech utterance prosody vector for the recorded speech utterance;

generate a reference prosody vector for the reference speech utterance; and

transform the recorded speech utterance prosody vector to generate a transformed recorded speech utterance vector;

wherein the first prosody component comprises the transformed recorded speech utterance prosody vector and the second prosody component comprises the recorded speech utterance prosody vector.

10. The apparatus according to claim 9, the apparatus being configured to normalise a result of the comparison to generate a normalised deviation prosody vector and to convert the normalised deviation prosody vector using a probability function and a score model to determine the prosodic verification evaluation.

11. The apparatus according to claim 9, wherein the apparatus is configured to determine the prosodic verification evaluation for at least one of recorded speech utterance unit prosody and recorded speech utterance across-unit prosody.

12. The apparatus according to claim 11, wherein the apparatus is configured to determine a composite prosodic verification evaluation from a weighted sum of a prosodic verification evaluation for recorded speech utterance unit prosody and a prosodic verification evaluation for recorded speech utterance across-unit prosody.

14. The apparatus according to claim 1, wherein the apparatus further comprises a text-to-speech module, the apparatus being configured to generate the reference speech utterance using the text-to-speech module.

15. The apparatus according to claim 14, wherein the apparatus is configured to generate an acoustic model, to determine an acoustic verification evaluation from the acoustic model, and to determine an overall verification evaluation from the acoustic verification evaluation and the prosodic verification evaluation.

16. The apparatus according to claim 15, the apparatus being configured to generate the acoustic model from a speaker adaptive training module.

17. The apparatus according to claim 15, wherein the apparatus is configured to determine the acoustic verification evaluation from:

a normalisation of a first acoustic parameter derived from the recorded speech utterance unit;

a normalisation of a corresponding second acoustic parameter for the reference speech utterance unit;

a determination of a first likelihood value that the first acoustic parameter corresponds to a particular utterance;

a determination of a second likelihood value that the second acoustic parameter corresponds to a particular utterance; and

a comparison of the first likelihood value and the second likelihood value.

13. (canceled)

18. An apparatus for speech pronunciation verification, the apparatus being configured to determine an acoustic verification evaluation from:

a determination of a first likelihood value that a first acoustic parameter derived from a recorded speech utterance unit corresponds to a particular utterance;

a determination of a second likelihood value that a second acoustic parameter derived from a reference speech utterance unit corresponds to a particular utterance; and

a comparison of the first likelihood value and the second likelihood value;

wherein the first acoustic parameter and the second acoustic parameter are normalised prior to determination of the first and second likelihood values.

19. The apparatus according to claim 18, wherein the determination of the first likelihood value and the second likelihood value is made with reference to a phonetic model.

20-42. -42. (canceled)