SYSTEM AND METHOD FOR SPEECH PERSONALIZATION BY NEED

• US 20180090129A1
• Filed: 12/04/2017
• Published: 03/29/2018
• Est. Priority Date: 06/09/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: LJOLJE, Andrej, CONKIE, Alistair D., SYRDAL, Ann K.
• Granted Patent: US 10,504,505 B2
• Time in Patent Office: Days
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

Disclosed herein are systems, computer-implemented methods, and tangible computer-readable storage media for speaker recognition personalization. The method recognizes speech received from a speaker interacting with a speech interface using a set of allocated resources, the set of allocated resources including bandwidth, processor time, memory, and storage. The method records metrics associated with the recognized speech, and after recording the metrics, modifies at least one of the allocated resources in the set of allocated resources commensurate with the recorded metrics. The method recognizes additional speech from the speaker using the modified set of allocated resources. Metrics can include a speech recognition confidence score, processing speed, dialog behavior, requests for repeats, negative responses to confirmations, and task completions. The method can further store a speaker personalization profile having information for the modified set of allocated resources and recognize speech associated with the speaker based on the speaker personalization profile.

Claims

1. A method comprising:

recording, via a processor, metrics associated with recognized speech for each of a plurality of speakers, wherein the metrics are associated with at least one of a request for repetition, a negative response to confirmation, and a task completion;

after recording the metrics, while recording further speech from the each speaker of the plurality of speakers, modifying, via a processor, an allocation of resources of a speech interface based on the metrics, to yield a modified speech interface; and

recognizing, via the modified speech interface, additional speech.

2. The method of claim 1, wherein the speech interface utilizes at least one of bandwidth and processor time to allocate resources for the recognizing speech.

3. The method of claim 1, wherein the metrics further comprise a speech recognition confidence score, a processing speed, and a dialog behavior.

4. The method of claim 1, wherein the identified speaker was determined to be frustrated and have great difficulty in a prior session.

5. The method of claim 1, further comprising storing a speaker personalization profile having information for the modified speech interface.

6. The method of claim 5, further comprising recognizing speech associated with the identified speaker based on the speaker personalization profile.

7. The method of claim 5, further comprising storing the speaker personalization profile on a personalization server storing multiple speaker personalization profiles.

8. The method of claim 5, wherein multiple speakers are associated with the speaker personalization profile.

9. The method of claim 1, wherein the modified speech interface is associated with a class of similar speakers.

10. The method of claim 1, wherein modifying the allocation of resources is based on a difficulty threshold associated with how well the speaker interacts with the speech interface.

11. The method of claim 1, further comprising progressively applying the modified speech interface.

12. The method of claim 1, wherein the resources each comprise at least one of memory and storage.

13. The method of claim 1, wherein an allocation of resources in the modified speech interface is greater than its corresponding allocation in a set of allocated resources prior to the modifying.

14. The method of claim 1, wherein an allocation of resources in the modified speech interface is less than its corresponding allocation in a set of allocated resources prior to the modifying.

15. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising;

recording metrics associated with recognized speech for each of a plurality of speakers, wherein the metrics are associated with at least one of a request for repetition, a negative response to confirmation, and a task completion;

after recording the metrics, while recording further speech from the each speaker of the plurality of speakers, modifying, via a processor, an allocation of resources of a speech interface based on the metrics, to yield a modified speech interface; and

recognizing, via the modified speech interface, additional speech.

16. The system of claim 15, wherein the speech interface utilizes at least one of bandwidth and processor time to allocate resources for the recognizing speech.

17. The system of claim 15, wherein the metrics further comprise a speech recognition confidence score, a processing speed, and a dialog behavior.

18. The system of claim 15, wherein the identified speaker was determined to be frustrated and have great difficulty in a prior session.

19. The system of claim 15, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising storing a speaker personalization profile having information for the modified speech interface.

20. A computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising:

recording metrics associated with recognized speech for each of a plurality of speakers, wherein the metrics are associated with at least one of a request for repetition, a negative response to confirmation, and a task completion;

after recording the metrics, while recording further speech from the each speaker of the plurality of speakers, modifying, via a processor, an allocation of resources of a speech interface based on the metrics, to yield a modified speech interface; and

recognizing, via the modified speech interface, additional speech.