METHODS AND APPARATUS FOR VOICE-ENABLING A WEB APPLICATION

• US 20140039885A1
• Filed: 08/02/2012
• Published: 02/06/2014
• Est. Priority Date: 08/02/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Reich, David E., Hardy, Christopher
• Granted Patent: US 9,781,262 B2
• Time in Patent Office: Days
• US Class Current: 704/231
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 2203/251 where a voice mode or a visual mode can be used interchangeably
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

Methods and apparatus for voice-enabling a web application, wherein the web application includes one or more web pages rendered by a web browser on a computer. At least one information source external to the web application is queried to determine whether information describing a set of one or more supported voice interactions for the web application is available, and in response to determining that the information is available, the information is retrieved from the at least one information source. Voice input for the web application is then enabled based on the retrieved information.

Claims

1. A method of determining a collective set of supported voice interactions for a plurality of frames in a web browser including a first frame and a second frame, wherein the first frame corresponds to a first web application and the second frame corresponds to a second web application, the method comprising:

determining a first set of supported voice interactions available for the first frame;

determining a second set of supported voice interactions available for the second frame;

determining the collective set of supported voice interactions based on the first set of supported voice interactions and the second set of voice interactions; and

instructing an external speech engine to recognize voice input corresponding to the collective set of voice interactions.

2. The method of claim 1, further comprising:

associating a first agent with the first frame and a second agent with the second frame, wherein the first agent is configured to monitor first events associated with the first frame and the second agent is configured to monitor second events associated with the second frame; and

wherein the first set is determined based, at least in part, on the first events and the second set is determined based, at least in part on the second events.

3. The method of claim 1, wherein the collective set of supported voice interactions comprises a union of the supported voice interactions in the first set and the second set.

4. The method of claim 1, wherein the collective set of supported voice interactions includes less than all of the supported voice interactions in the first set and the second set.

5. The method of claim 1, wherein determining the first set of supported voice interactions comprises determining an identity of the first web application.

6. The method of claim 5, wherein determining the identity of the first web application is performed based, at least in part, on an identifier for a web page of the first web application.

7. The method of claim 1, wherein determining the first set of supported voice interactions available for the first frame comprises monitoring for browser events in the first frame.

8. A computer-readable storage medium encoded with a plurality of instructions that, when executed by a computer, perform a method of determining a collective set of supported voice interactions for a plurality of frames in a web browser including a first frame and a second frame, wherein the first frame corresponds to a first web application and the second frame corresponds to a second web application, the method comprising:

determining a first set of supported voice interactions available for the first frame;

determining a second set of supported voice interactions available for the second frame;

determining the collective set of supported voice interactions based on the first set of supported voice interactions and the second set of voice interactions; and

instructing an external speech engine to recognize voice input corresponding to the collective set of voice interactions.

9. The computer-readable storage medium of claim 8, wherein the method further comprises:

associating a first agent with the first frame and a second agent with the second frame, wherein the first agent is configured to monitor first events associated with the first frame and the second agent is configured to monitor second events associated with the second frame; and

wherein the first set is determined based, at least in part, on the first events and the second set is determined based, at least in part on the second events.

10. The computer-readable storage medium of claim 8, wherein the collective set of supported voice interactions comprises a union of the supported voice interactions in the first set and the second set.

11. The computer-readable storage medium of claim 8, wherein the collective set of supported voice interactions includes less than all of the supported voice interactions in the first set and the second set.

12. The computer-readable storage medium of claim 8, wherein determining the first set of supported voice interactions comprises determining an identity of the first web application.

13. The computer-readable storage medium of claim 12, wherein determining the identity of the first web application is performed based, at least in part, on an identifier for a web page of the first web application.

14. The computer-readable storage medium of claim 8, wherein determining the first set of supported voice interactions available for the first frame comprises monitoring for browser events in the first frame.

15. A computer for determining a collective set of supported voice interactions for a plurality of frames in a web browser including a first frame and a second frame, wherein the first frame corresponds to a first web application and the second frame corresponds to a second web application, the computer comprising:

at least one processor programmed to;

determine a first set of supported voice interactions available for the first frame;

determine a second set of supported voice interactions available for the second frame;

determine the collective set of supported voice interactions based on the first set of supported voice interactions and the second set of voice interactions; and

instruct an external speech engine to recognize voice input corresponding to the collective set of voice interactions.

16. The computer of claim 15, wherein the at least one processor is further programmed to:

associate a first agent with the first frame and a second agent with the second frame, wherein the first agent is configured to monitor first events associated with the first frame and the second agent is configured to monitor second events associated with the second frame; and

wherein the first set is determined based, at least in part, on the first events and the second set is determined based, at least in part on the second events.

17. The computer of claim 15, wherein the collective set of supported voice interactions comprises a union of the supported voice interactions in the first set and the second set.

18. The computer of claim 15, wherein the collective set of supported voice interactions includes less than all of the supported voice interactions in the first set and the second set.

19. The computer of claim 15, wherein determining the first set of supported voice interactions comprises determining an identity of the first web application.

20. The computer of claim 19, wherein determining the identity of the first web application is performed based, at least in part, on an identifier for a web page of the first web application.