System, method and architecture for control and multi-modal synchronization of speech browsers

• US 9,065,911 B2
• Filed: 09/28/2007
• Issued: 06/23/2015
• Est. Priority Date: 09/28/2007
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Bachleda, Frantisek, Kleindienst, Jan, Labsky, Martin, Sedivy, Jan, Seredi, Ladislav, Ures, Lubos, Grueneberg, Keith
• Primary Examiner(s): Han, Qi
• Application Number:
  US11/864,229
• Publication Number:
  US 20090089064A1
• Time in Patent Office: 2,825 Days
• Field of Search: 704/271, 704/270, 704/235, 704/231, 704/275, 704/270.1
• US Class Current: 1/1
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 2207/40 terminals with audio html browser
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals

Abstract

Clients connecting to a VoiceXML browser obtain a control channel. Using this channel, clients may initialize a new VoiceXML session or attach to an existing VoiceXML session. The client after obtaining a session may perform a range of actions including controlling and monitoring actions.

Claims

1. A method of operating a lightweight VoiceXML browser installed on a client computer, the method comprising:

determining, by at least one processor on the client computer, whether a web page displayed by a web browser executing on the client computer includes a Flash application integrated with the web page; and

establishing a communication channel between the Flash application and the lightweight VoiceXML browser, when it is determined that the web page includes the web a Flash application.

2. The method of claim 1, wherein determining whether a web page displayed by a web browser executing on the client computer includes a Flash application comprises determining, by a plug-in associated with the web browser, information about content of the web page.

3. The method of claim 1, wherein establishing a communication channel between the Flash application and the lightweight VoiceXML browser when it is determined that the web page includes the Flash application comprises:

determining whether a user has logged into the Flash application on the web page; and

establishing the communication channel in response to determining that the user has logged into the Flash application on the web page.

4. The method of claim 3, further comprising:

determining whether the user has logged out of the Flash application on the web page; and

disconnecting the communication channel between the Flash application and the lightweight VoiceXML browser, in response to determining that the user has logged out of the Flash application on the web page.

5. The method of claim 1, wherein the web application provides a rich-media interface.

6. The method of claim 1, wherein establishing a communication channel between the Flash application and the lightweight VoiceXML browser comprises establishing a socket connection between the Flash application and the lightweight VoiceXML browser.

7. The method of claim 6, wherein the socket connection is a persistent socket connection.

8. A client device comprising:

a web browser executing on the client device and configured to interpret and render web pages retrieved from a web server;

a lightweight VoiceXML browser; and

at least one storage device in communication with at least one processor programmed to;

determine whether a web page displayed by the web browser includes a Flash application integrated with the web page; and

establish a communication channel between the Flash application and the lightweight VoiceXML browser, when it is determined that the web page includes a Flash application.

9. The client device of claim 8, further comprising a plug-in associated with the web browser, and wherein determining whether a web page displayed by the web browser includes a Flash application comprises determining, by the plug-in, information about content of the web page.

10. The client device of claim 8, wherein establishing a communication channel between the Flash application and the lightweight VoiceXML browser when it is determined that the web page includes the Flash application comprises:

determining whether a user has logged into the Flash application on the web page; and

establishing the communication channel in response to determining that the user has logged into the Flash application on the web page.

11. The client device of claim 10, wherein the at least one processor is further programmed to:

determine whether the user has logged out of the Flash application on the web page; and

disconnect the communication channel between the Flash application and the lightweight VoiceXML browser, in response to determining that the user has logged out of the Flash application on the web page.

12. The client device of claim 8, wherein the web application provides a rich-media interface.

13. The client device of claim 8, wherein establishing a communication channel between the Flash application and the lightweight VoiceXML browser comprises establishing a socket connection between the Flash application and the lightweight VoiceXML browser.

14. The client device of claim 13, wherein the socket connection is a persistent socket connection.