Method and system for voice-enabled autofill

• US 7,953,597 B2
• Filed: 08/09/2005
• Issued: 05/31/2011
• Est. Priority Date: 09/20/2004
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Cross, Charles W. Jr., McCobb, Gerald M., Ativanichayaphong, Soonthorn
• Primary Examiner(s): Dorvil; Richemond
• Assistant Examiner(s): Borsetti; Greg
• Application Number:
  US11/199,672
• Publication Number:
  US 20060074652A1
• Time in Patent Office: 2,121 Days
• Field of Search: 704/235, 704/275, 715/226
• US Class Current: 704/235
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

A computer-implemented method and system are provided for filling a graphic-based form field in response to a speech utterance. The computer-implemented method includes generating a grammar corresponding to the form field, the grammar being based on a user profile and comprising a semantic interpretation string. The method further includes creating an auto-fill event based upon the at least one grammar and responsive to the speech utterance, the auto-fill event causing the filling of the form field with data corresponding to the user profile. The system includes a grammar-generating module for generating a grammar corresponding to the form field, the grammar being based on a user profile and comprising a semantic interpretation string. The system also includes an event module for creating an auto-fill event based upon the at least one grammar and responsive to the speech utterance, the event causing the filling of the form field with data corresponding to the user profile.

Claims

1. A computer-implemented method of automatically filling a form field in response to a speech utterance corresponding to a label phrase, the method comprising:

generating at least one auto-fill grammar corresponding to the form field based, at least in part, on user-specific information, wherein the user-specific information comprises the label phrase and a semantic interpretation string corresponding to the label phrase;

determining, in response to a user accessing a multimodal application via a browser on a user device, whether the user device has the speech recognition capability;

downloading, in response to determining that the user device has the speech recognition capability, the at least one auto-fill grammar to the user device;

downloading, in response to determining that the user device does not have a speech recognition capability, a location on a Web site where the at least one auto-fill grammar resides to the user device, wherein the user device provides the location of the at least one auto-fill grammar to a remotely-located speech recognition engine to facilitate speech recognition by the remotely-located speech recognition engine; and

creating an auto-fill event based upon the at least one auto-fill grammar and responsive to the speech utterance corresponding to the label phrase, the auto-fill event causing the filling of the form field with the semantic interpretation string corresponding to the label phrase.

2. The method of claim 1, wherein the semantic interpretation string is retrieved from a record of a table specific to a stored user profile, the record establishing an association between the semantic interpretation string and the speech utterance.

3. The method of claim 1, wherein the form field is a synchronized voice form field of a voice markup language document, and wherein the generating step comprises generating at least one grammar defining a form field grammar corresponding to the synchronized voice form field.

4. The method of claim 3, further comprising parsing the voice markup language document to determine whether the voice markup language document contains the synchronized voice form field.

5. The method of claim 1, wherein the generating step comprises generating a voice command and control grammar and/or a content navigation grammar.

6. The method of claim 1, wherein the form field is a form field of a voice markup language document, and wherein the generating step comprises generating at least one grammar defining a link grammar corresponding to the form field.

7. A computer-implemented system of automatically filling a form field in response to a speech utterance corresponding to a label phrase, comprising:

a processor programmed to perform a method comprising;

generating at least one auto-fill grammar corresponding to the form field based, at least in part, on user-specific information, wherein the user specific information comprises the label phrase and a semantic interpretation string corresponding to the label phrase;

determining, in response to a user accessing a multimodal application via a browser on a user device, whether the user device has a speech recognition capability;

downloading, in response to determining that the user device has the speech recognition capability, the at least one auto-fill grammar to the user device;

downloading, in response to determining that the user device does not have the speech recognition capability, a location on a Web site where the at least one auto-fill grammar resides to the user device, wherein the user device provides the location of the at least one auto-fill grammar to a remotely-located speech recognition engine to facilitate speech recognition by the remotely-located speech recognition engine; and

creating an auto-fill event based upon the at least one auto-fill grammar-and responsive to the speech utterance corresponding to the label phrase, the auto-fill event causing the filling of the form field with the semantic interpretation string corresponding to the label phrase.

8. A non-transitory computer-readable storage medium encoded with a plurality of instructions that, when executed by a computer system, perform a method comprising:

generating at least one auto-fill grammar corresponding to a form field based, at least in part, on user-specific information, wherein the user-specific information comprises a label phrase and a semantic interpretation string corresponding to the label phrase;

determining in response to a user accessing a multimodal application via a browser on a user device, whether the user device has a speech recognition capability;

downloading, in response to determining that the user device has the speech recognition capability, the at least one auto-fill grammar to the user device;

downloading, in response to determining that the user device does not have the speech recognition capability, a location on a Web site where the at least one auto-fill grammar resides to the user device, wherein the user device provides the location of the at least one auto-fill grammar to a remotely-located speech recognition engine to facilitate speech recognition by the remotely-located speech recognition engine; and

creating an auto-fill event based upon the at least one auto-fill grammar and responsive to a speech utterance corresponding to the label phrase, the auto-fill event causing the filling of the form field with the semantic interpretation string corresponding to the label phrase.