Methods and apparatus for voiced-enabling a web application

• US 9,292,252 B2
• Filed: 08/02/2012
• Issued: 03/22/2016
• Est. Priority Date: 08/02/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Hardy, Christopher, Reich, David E.
• Primary Examiner(s): Gillis, Brian J
• Assistant Examiner(s): Mohammadi, Kamran
• Application Number:
  US13/565,000
• Publication Number:
  US 20140040745A1
• Time in Patent Office: 1,328 Days
• Field of Search: 709216-218, 715/728, 379/88.01
• US Class Current: 1/1
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Methods and apparatus for voice-enabling a web application, wherein the web application includes one or more web pages rendered by a web browser on a computer. At least one information source external to the web application is queried to determine whether information describing a set of one or more supported voice interactions for the web application is available, and in response to determining that the information is available, the information is retrieved from the at least one information source. Voice input for the web application is then enabled based on the retrieved information.

Claims

1. A method of voice-enabling a web application, wherein the web application includes one or more web pages received from a web server and rendered by a web browser of an electronic device, the method comprising:

identifying the web application based, at least in part, on an identifier associated with a web page of the web application;

issuing a query to at least one information source other than the web server to determine whether information describing a set of one or more supported voice interactions for the web application is available, wherein the query includes an identification of the web application, wherein the at least one information source includes voice interaction information for a plurality of different web applications, each of which comprises one or more web pages, wherein the querying at least one information source other than the web server comprises sending a request to the at least one information source, wherein the request includes information associated with the web application, wherein the at least one information source includes a local data source associated with the electronic device and/or an external data source connected to the electronic device via at least one publicly-accessible network;

retrieving from the at least one information source, in response to determining that the information describing a set of one or more supported voice interactions for the web application is available, the information describing the set of one or more supported voice interactions for the web application, wherein the set of one or more supported voice interactions comprises at least one first supported voice interaction that is always active during execution of the web application and at least one second supported voice interaction that is only active in a particular context of the web application;

determining, based on content of a rendered web page of the web application, whether the web application is in the particular context; and

enabling voice input for the web application based on the retrieved information specifying the set of one or more supported voice interactions, wherein enabling voice input for the web application comprises enabling the at least one second supported voice interaction in response to determining that the web application is in the particular context.

2. The method of claim 1, wherein the identifier associated with the web page comprises a uniform resource locator for the web page.

3. The method of claim 1, wherein the information associated with the identified web application comprises a unique identifier for the identified web application.

4. The method of claim 1, wherein the at least one information source comprises the local data source, and wherein issuing a query to the at least one information source comprises issuing the query to the local data source.

5. The method of claim 1, wherein retrieving the information describing the set of supported voice interactions comprises:

sending a request for the information to the external data source connected to the computer via at least one publicly-accessible network; and

receiving the information from the external data source in response to the request.

6. The method of claim 5, further comprising:

storing the information in the local data source associated with the electronic device.

7. The method of claim 1, wherein enabling voice input for the web application comprises mapping the set of one or more supported voice commands to at least one capability of the web application.

8. The method of claim 1, further comprising:

determining that the web browser is loading a web page for the web application; and

wherein the issuing the query to the at least one information source is performed in response to determining that the web browser is loading a web page for the web application.

9. The method of claim 1, further comprising:

determining that a voice application associated with a speech engine is executing on the electronic device; and

wherein the issuing the query to the at least one information source is performed in response to determining that the voice application associated with the speech engine is executing on the electronic device.

10. The method of claim 1, wherein enabling voice input for the web application comprises:

receiving a voice input;

determining whether the voice input is a voice command; and

instructing, based on the voice input, the web application to invoke at least one capability of the web application corresponding to the voice command.

16. The method of claim 1, wherein the set of one or more supported voice interactions for the web application includes a voice interaction selected from the group consisting of composing a message, discarding a message, sending a message, closing a web application, minimizing a web application, panning in a window of the web application, zooming in a window of the web application, and displaying available voice commands for the web application.

11. A non-transitory computer-readable storage medium encoded with a plurality of instructions that, when executed by a computer, perform a method of voice-enabling a web application, wherein the web application includes one or more web pages received from a web server and rendered by a web browser executing on the computer, the method comprising:

identifying the web application based, at least in part, on an identifier associated with a web page of the web application;

issuing a query to at least one information source other than the web server to determine whether information describing a set of one or more supported voice interactions for the web application is available, wherein the query includes an identification of the web application, wherein the at least one information source includes voice interaction information for a plurality of different web applications, each of which comprises one or more web pages, wherein the querying at least one information source other than the web server comprises sending a request to the at least one information source, wherein the request includes information associated with the identified web application, wherein the at least one information source includes a local data source associated with the electronic device and/or an external data source connected to the electronic device via at least one publicly-accessible network;

retrieving from the at least one information source, in response to determining that the information describing a set of one or more supported voice interactions for the web application is available, the information describing the set of one or more supported voice interactions for the web application, wherein the set of one or more supported voice interactions comprises at least one first supported voice interaction that is always active during execution of the web application and at least one second supported voice interaction that is only active in a particular context of the web application;

determining, based on content of a rendered web page of the web application, whether the web application is in the particular context; and

enabling voice input for the web application based on the retrieved information specifying the set of one or more supported voice interactions, wherein enabling voice input for the web application comprises enabling the at least one second supported voice interaction in response to determining that the web application is in the particular context.

12. The non-transitory computer-readable storage medium of claim 11, wherein the web browser executes on a computer, and wherein retrieving the information describing the set of supported voice interactions comprises:

sending a request for the information to the external data source connected to the computer via at least one publicly-accessible network; and

receiving the information from the external data source in response to the request.

17. The non-transitory computer-readable storage medium of claim 11, wherein the set of one or more supported voice interactions for the web application includes a voice interaction selected from the group consisting of composing a message, discarding a message, sending a message, closing a web application, minimizing a web application, panning in a window of the web application, zooming in a window of the web application, and displaying available voice commands for the web application.

13. A computer, comprising:

at least one storage device having stored thereon a plurality of instructions; and

at least one processor programmed to execute the plurality of instructions to;

identify a web application based, at least in part, on an identifier associated with a web page of the web application, wherein the web page is received from a web server;

issue a query to at least one information source other than the web server to determine whether information describing a set of one or more supported voice interactions for the web application is available, wherein the query includes an identification of the web application, wherein the at least one information source includes voice interaction information for a plurality of different web applications, each of which comprise one or more web pages, wherein the querying at least one information source other than the web server comprises sending a request to the at least one information source, wherein the request includes information associated with the identified web application, wherein the at least one information source includes a local data source associated with the electronic device and/or an external data source connected to the electronic device via at least one publicly-accessible network;

retrieve from the at least one information source, in response to determining that the information describing a set of one or more supported voice interactions for the web application is available, the information describing the set of one or more supported voice interactions for the web application, wherein the set of one or more supported voice interactions comprises at least one first supported voice interaction that is always active during execution of the web application and at least one second supported voice interaction that is only active in a particular context of the web application;

determine, based on content of a rendered web page of the web application, whether the web application is in the particular context; and

enable voice input for the web application based on the retrieved information specifying the set of one or more supported voice interactions, wherein enabling voice input for the web application comprises enabling the at least one second supported voice interaction in response to determining that the web application is in the particular context.

14. The computer of claim 13, wherein enabling voice input for the web application comprises mapping the set of one or more supported voice commands to at least one capability of the web application.

15. The computer of claim 13, wherein the at least one processor is further programmed to:

determine that a voice application associated with a speech engine is executing on the computer; and

wherein the issuing the query to the at least one information source is performed in response to determining that the voice application associated with the speech engine is executing on the computer.

18. The computer of claim 13, wherein the set of one or more supported voice interactions for the web application includes a voice interaction selected from the group consisting of composing a message, discarding a message, sending a message, closing a web application, minimizing a web application, panning in a window of the web application, zooming in a window of the web application, and displaying available voice commands for the web application.