Incorporation of speech engine training into interactive user tutorial

• US 20070055520A1
• Filed: 11/02/2005
• Published: 03/08/2007
• Est. Priority Date: 08/31/2005
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mowatt, David, Scholz, Oliver, Kennedy, Paul, Jacoby, James, Andrew, Felix
• Application Number:
  US11/265,726
• Publication Number:
  US 20070055520A1
• Time in Patent Office: Days
• US Class Current: 704/251
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/0631 Creating reference templates; Clustering
• CPC Class Codes: G10L 2015/228 of application context

Abstract

The present invention combines speech recognition tutorial training with speech recognizer voice training. The system prompts the user for speech data and simulates, with predefined screenshots, what happens when speech commands are received. At each step in the tutorial process, when the user is prompted for an input, the system is configured such that only a predefined set (which may be one) of user inputs will be recognized by the speech recognizer. When a successful recognition is being made, the speech data is used to train the speech recognition system.

Claims

1. A method of training a speech recognition system, comprising:

displaying one of a plurality of tutorial displays, the tutorial displays including a prompt, prompting a user to say commands used to control the speech recognition system;

providing received speech data, received in response to the prompt, to the speech recognition system for recognition, to obtain a recognition result;

if the speech recognition result corresponds to one of a predefined subset of possible commands, then training the speech recognition system based on the speech recognition result and the received speech data; and

displaying another of the tutorial displays based on the recognition result.

2. The method of claim 1 wherein displaying another of the plurality of tutorial displays comprises:

displaying a simulation indicative of an actual display generated when the speech recognition system receives the command corresponding to the speech recognition result.

3. The method of claim 2 wherein displaying one of the tutorial displays comprises:

displaying tutorial text describing a feature of the speech recognition system.

4. The method of claim 2 wherein displaying one of the tutorial displays, including a prompt, comprises:

displaying a plurality of steps, each step prompting the user to say a command, the plurality of steps being performed to complete one or more tasks with the speech recognition system.

5. The method of claim 4 wherein displaying one of the tutorial displays comprises:

referring to tutorial content for a selected application.

6. The method of claim 5 wherein the tutorial content comprises navigational flow content and corresponding displays, and wherein displaying one of the tutorial displays comprises:

accessing the navigational flow content, wherein the navigational flow content conforms to a predefined schema and refers to the corresponding displays at different points;

following a navigational flow defined by the navigational flow content; and

displaying the displays referred to at different points in the navigational flow.

7. The method of claim 6 and further comprising:

configuring the speech recognition system to recognize only the predefined subset of the possible commands corresponding to the steps for which the user is prompted by a display that is currently displayed.

8. A speech recognition training and tutorial system, comprising:

tutorial content comprising navigational flow content, indicative of a navigational flow of a tutorial application, and corresponding display elements referred to at different points in navigational flow defined by the navigational flow content, the display elements prompting a user to speak a command, and the display elements further comprising a simulation of a display generated in response to a speech recognition system receiving the command; and

a tutorial framework configured to access the tutorial content and display the display elements according to the navigational flow, the tutorial framework being configured to provide speech information, provided in response to the prompt, to a speech recognition system for recognition, to obtain a recognition result, and to train the speech recognition system based on the recognition result.

9. The speech recognition training and tutorial system of claim 8 wherein the tutorial framework configured the speech recognition system to recognize only a set of expected commands given the display element being displayed.

10. The speech recognition training and tutorial system of claim 8 wherein the tutorial framework is configured to access one of a plurality of different sets of tutorial content based on a selected tutorial application, selected by the user.

11. The speech recognition training and tutorial system of claim 10 wherein the plurality of different sets of tutorial content are pluggable into the tutorial framework.

12. The speech recognition training and tutorial system of claim 8 wherein the navigational flow content comprises a navigation arrangement indicative of how tutorial information is arranged and how navigation through the tutorial information is permitted.

13. The speech recognition training and tutorial system of claim 12 wherein the flow content comprises a navigational hierarchy.

14. The speech recognition training and tutorial system of claim 13 wherein the navigational hierarchy includes hierarchically arranged topics, chapters, pages and steps.

15. A computer readable, tangible medium storing a data structure having computer readable data, the data structure comprising:

a flow portion including computer readable flow data, the flow data defining a navigational flow for a tutorial application for a speech recognition system and conforming to a predefined flow schema; and

a display portion including computer readable display data, the display data defining a plurality of displays referenced by the flow data at different points in the navigational flow defined by the flow data, the display data prompting a user for speech data indicative of commands used in the speech recognition system, the displays showing what is displayed when the speech recognition system receives the speech data input by the user.