Speech controls for use with a speech system

• US 7,188,066 B2
• Filed: 02/04/2002
• Issued: 03/06/2007
• Est. Priority Date: 02/04/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Yip, Clement Chun Pong, Falcon, Stephen Russell, Miller, David Michael, Banay, Dan
• Primary Examiner(s): ARMSTRONG, ANGELA A
• Application Number:
  US10/067,518
• Publication Number:
  US 20030177013A1
• Time in Patent Office: 1,856 Days
• Field of Search: 704/270, 704/275, 704/270.1, 704/231, 704/251
• US Class Current: 704/275
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks

Abstract

Systems and methods are described for a speech system that includes one or more speech controls incorporated into one or more speech-enabled applications that run on the speech system. The controls allow applications to be developed with minimal programming effort to incorporate common speech-enabled application functions. A question control provides a customizable template for requesting information from a user. An announcer control allows a speech-enabled application to provide a user with information without having to re-create an entire announcer process each time it is used. A command control provides a simple way to attach command and control functions to speech-enabled applications. A word trainer control provides a way to associate user-selected voice tags with certain information. Providing the controls for use with speech-enabled applications ensures standardized user interfaces across multiple speech-enabled applications.

Claims

1. A speech-enabled application, comprising one or more of the following:

a question control configured to provide a question function in the speech-enabled application;

an announcer control configured to provide an announcer function in the speech-enabled application;

a command control configured to provide a command and control function in the speech-enabled application;

a word trainer control configured to provide a word trainer function in the speech-enabled application;

wherein each of the one or more controls utilizes a grammar to communicate with a speech system and each of the one or more controls may be utilized in more than one speech-enabled application to provide a standardized speech user interface to the speech-enabled applications;

wherein the question control is further configured to receive a custom prompt and to play the prompt in a question from the speech system to a user; and

wherein the question control is further configured to receive a custom verbose prompt and, in the event that an interaction using the custom prompt is interrupted, to play the verbose prompt in a question from the speech system to the user when the interaction resumes processing.

2. The speech system as recited in claim 1, wherein the grammar utilized by a control further comprises a global grammar, terms for which the speech system always listens for unless the global grammar is de-activated by the control.

3. The speech system as recited in claim 1, wherein the grammar utilized by a control further comprises a yielding grammar that may be de-activated by the speech system to allow another grammar to be active over the yielding grammar.

4. The speech system as recited in claim 1, wherein the grammar utilized by a control further comprises a persistent grammar that enables a speech-enabled application utilizing the persistent grammar to be launched by the speech system when the speech system recognizes a term that is included in the persistent grammar.

5. The speech system as recited in claim 1, wherein the question control is further configured to repeat the custom prompt in place of the verbose prompt if the verbose prompt has a null value.

6. The speech system as recited in claim 1, wherein the question control comprises an earcon property that, when utilized by a speech-enabled application, causes a sound file to be played before the custom prompt is played.

7. The speech system as recited in claim 1, wherein the question control comprises an interrupting property that, when utilized by a speech-enabled application, causes an interaction created by the question control to be processed immediately upon being submitted to the speech system.

8. The speech system as recited in claim 1, wherein the question control is further configured to provide a list of possible answers to the question after the custom prompt is played.

9. The speech system as recited in claim 8, wherein:

the list of possible answers is programmed into the question control, and at least one of the possible answers is specified to play a pre-recorded string.

10. The speech system as recited in claim 8, wherein:

the list of possible answers is programmed into the question control, and at least one of the possible answers is specified to play a distinct TTS string.

11. The speech system as recited in claim 8, wherein the list of possible answers is programmed into the question control.

12. The speech system as recited in claim 8, wherein the list of possible answers is provided by the speech-enabled application tat incorporates the question control.

13. The speech system as recited in claim 1, wherein the question control is further configured to provide audible feedback after receiving a user response to a question to indicate that a valid response to the question was received.

14. The speech system as recited in claim 13, wherein the audible feedback is a tone.

15. The speech system as recited in claim 13, wherein the audible feedback is an announcement that repeats the valid response.

16. The speech system as recited in claim 1, wherein the announcer control is further configured to translate an electronic mail message to speech.

17. The speech system as recited in claim 1, wherein the announcer control is further configured to play an announcement regarding an occurrence of an event upon occurrence of the event.

18. The speech system as recited in claim 1, wherein the announcer control is further configured to repeat an announcement in response to a repeat command from a user.

19. The speech system as recited in claim 1, wherein the announcer control is further configured to interrupt a currently processing interaction when an interaction created by the announcer control is submitted to the speech system.

20. The speech system as recited in claim 1, wherein the announcer control is further configured to abort an announcement interaction created by the announcer control when the announcement interaction is interrupted by another interaction.

21. The speech system as recited in claim 1, wherein the announcer control is further configured to restart an announcement interaction created by the announcer control after the announcement interaction is interrupted by another interaction.

22. The speech system as recited in claim 1, wherein the announcer control is further configured to play a sound file before playing an announcement.

23. The speech system as recited in claim 1, wherein the announcer control is further configured to provide a delay after playing an announcement.

24. The speech system as recited in claim 1, wherein the command control is further configured to provide a way for a speech-enabled application to specify a speech grammar for the speech-enabled application to use.

25. The speech system as recited in claim 1, wherein the command control is further configured to provide a method for supporting a dynamic grammar.

26. The speech system as recited in claim 1, wherein the command control is further configured to provide a method for supporting a global grammar.

27. The speech system as recited in claim 1, wherein the command control is further configured to provide a method for supporting a yielding grammar.

28. The speech system as recited in claim 1, wherein the command control is further configured to provide a method for supporting a persistent grammar.

29. The speech system as recited in claim 1, wherein the word trainer control is further configured to cause the speech system to:

play a custom prompt to a user;

wait for a response from the user; and

record the response from the user.

30. The speech system as recited in claim 29, wherein the word trainer control is further configured to cause the speech system to play a sound file after playing the custom prompt.

31. The speech system as recited in claim 29, wherein the word trainer control is further configured to cause the speech system to provide user feedback after recording the response from the user.

32. The speech system as recited in claim 29, wherein the word trainer control is further configured to cause the speech system to associate the recorded response from the user with a string stored in memory of the speech system.