SYSTEM AND METHOD FOR SPEECH PERSONALIZATION BY NEED

• US 20150213794A1
• Filed: 04/06/2015
• Published: 07/30/2015
• Est. Priority Date: 06/09/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: LJOLJE, Andrej, CONKIE, Alistair D., SYRDAL, Ann K.
• Granted Patent: US 9,837,071 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

Disclosed herein are systems, computer-implemented methods, and tangible computer-readable storage media for speaker recognition personalization. The method recognizes speech received from a speaker interacting with a speech interface using a set of allocated resources, the set of allocated resources including bandwidth, processor time, memory, and storage. The method records metrics associated with the recognized speech, and after recording the metrics, modifies at least one of the allocated resources in the set of allocated resources commensurate with the recorded metrics. The method recognizes additional speech from the speaker using the modified set of allocated resources. Metrics can include a speech recognition confidence score, processing speed, dialog behavior, requests for repeats, negative responses to confirmations, and task completions. The method can further store a speaker personalization profile having information for the modified set of allocated resources and recognize speech associated with the speaker based on the speaker personalization profile.

Claims

1. A method comprising:

recognizing speech of each speaker in a plurality of speakers on a conference call, to yield recognized speech for each of the plurality of speakers, wherein the speech of each speaker from the plurality of speakers is received via a speech interface;

recording metrics associated with the recognized speech for each of the plurality of speakers, wherein the metrics comprise a request for repetition, a negative response to confirmation, and a task completion;

after recording the metrics, while recording further speech from the each speaker from the plurality of speakers, modifying an attribute of the speech interface based on the metrics, to yield a modified speech interface; and

recognizing additional speech during the conference call from an identified speaker in the plurality of speakers using the modified speech interface.

2. The method of claim 1, wherein the speech interface utilizes at least one of bandwidth and processor time to allocate resources for the recognizing of the speech.

3. The method of claim 1, wherein the metrics further comprise a speech recognition confidence score, a processing speed, and a dialog behavior.

4. The method of claim 1, wherein the identified speaker was determined to be frustrated and have great difficulty in a prior session.

5. The method of claim 1, further comprising storing a speaker personalization profile having information for the modified set of allocated resources.

6. The method of claim 5, further comprising recognizing speech associated with the identified speaker based on the speaker personalization profile.

7. The method of claim 5, further comprising storing the speaker personalization profile on a personalization server storing multiple speaker personalization profiles.

8. The method of claim 5, wherein multiple speakers are associated with the speaker personalization profile.

9. The method of claim 1, wherein the modified set of allocated resources is associated with a class of similar speakers.

10. The method of claim 1, wherein modifying at least one of the first resource and second resource is based on a difficulty threshold associated with how well the speaker interacts with the speech interface.

11. The method of claim 1, further comprising progressively applying the modified set of allocated resources.

12. The method of claim 1, wherein the first resource and the second resource each comprise at least one of memory and storage.

13. The method of claim 1, wherein an allocation in the modified set of allocated resources is greater than its corresponding allocation in the set of allocated resources.

14. The method of claim 1, wherein an allocation in the modified set of allocated resources is less than its corresponding allocation in the set of allocated resources.

15. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising;

recognizing speech of each speaker in a plurality of speakers on a conference call, to yield recognized speech for each of the plurality of speakers, wherein the speech of each speaker from the plurality of speakers is received via a speech interface;

recording metrics associated with the recognized speech for each of the plurality of speakers, wherein the metrics comprise a request for repetition, a negative response to confirmation, and a task completion;

after recording the metrics, while recording further speech from the each speaker from the plurality of speakers, modifying an attribute of the speech interface based on the metrics, to yield a modified speech interface; and

recognizing additional speech during the conference call from an identified speaker in the plurality of speakers using the modified speech interface.

16. The system of claim 15, wherein the speech interface utilizes at least one of bandwidth and processor time to allocate resources for the recognizing of the speech.

17. The system of claim 15, wherein the metrics further comprise a speech recognition confidence score, a processing speed, and a dialog behavior.

18. The system of claim 15, wherein the identified speaker was determined to be frustrated and have great difficulty in a prior session.

19. The system of claim 15, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising storing a speaker personalization profile having information for the modified set of allocated resources.

20. A computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising:

recognizing speech of each speaker in a plurality of speakers on a conference call, to yield recognized speech for each of the plurality of speakers, wherein the speech of each speaker from the plurality of speakers is received via a speech interface;

recording metrics associated with the recognized speech for each of the plurality of speakers, wherein the metrics comprise a request for repetition, a negative response to confirmation, and a task completion;

after recording the metrics, while recording further speech from the each speaker from the plurality of speakers, modifying an attribute of the speech interface based on the metrics, to yield a modified speech interface; and

recognizing additional speech during the conference call from an identified speaker in the plurality of speakers using the modified speech interface.