System and method for providing network coordinated conversational services

• US 8,868,425 B2
• Filed: 09/11/2012
• Issued: 10/21/2014
• Est. Priority Date: 10/02/1998
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Maes, Stephane H., Gopalakrishnan, Ponani S.
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US13/610,221
• Publication Number:
  US 20130006620A1
• Time in Patent Office: 770 Days
• Field of Search: 704/231, 704/258, 704/270, 704/270.1, 704/275
• US Class Current: 704/270.1
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/401 wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference

Abstract

A system and method for providing automatic and coordinated sharing of conversational resources, e.g., functions and arguments, between network-connected servers and devices and their corresponding applications. In one aspect, a system for providing automatic and coordinated sharing of conversational resources includes a network having a first and second network device, the first and second network device each comprising a set of conversational resources, a dialog manager for managing a conversation and executing calls requesting a conversational service, and a communication stack for communicating messages over the network using conversational protocols, wherein the conversational protocols establish coordinated network communication between the dialog managers of the first and second network device to automatically share the set of conversational resources of the first and second network device, when necessary, to perform their respective requested conversational service.

Claims

1. A mobile device configured to communicate with at least one server over a network to facilitate allocation of conversational resources, the mobile device comprising:

at least one processor configured to;

in response to receiving a request for a conversational service, determine, based at least in part on available conversational resources at the mobile device, which one of the following three ways is to be used for processing the requested conversational service;

(1) processing the requested conversational service locally using the mobile device,

(2) processing the requested conversational service remotely using the at least one server, and

(3) processing the requested conversational service at least in part locally using the mobile device and at least in part remotely using the at least one server, wherein the determining is performed without evaluating whether processing the requested conversational service locally produces acceptable results; and

automatically communicate with the at least one server in furtherance of processing of the requested conversational service, when it is determined that the requested conversational service is to be processed partially or fully using the at least one server.

2. The mobile device of claim 1, wherein the at least one processor is configured to determine that the requested conversational service is to be processed remotely using the at least one server, when the requested conversational service is a conversational service that, prior to receiving the request for the conversational service, has been designated as a type of service to be processed remotely.

3. The mobile device of claim 1, wherein the at least one processor is configured to determine whether requested conversational service is to be processed locally, remotely, or locally and remotely, further based on conditions of the network.

4. The mobile device of claim 1, wherein when it is determined that the requested conversational service is to be processed at least in part using the mobile device, the at least one processor is configured to:

process the requested conversational service at least in part using conversational resources at the mobile device.

5. The mobile device of claim 1, wherein processing the requested conversational service comprises performing speech recognition on a speech waveform, and the at least one processor is configured to automatically communicate with the at least one server by:

transmitting a compressed speech waveform corresponding to the speech waveform.

6. The mobile device of claim 1, wherein processing the requested conversational service comprises performing text-to-speech synthesis, and the at least one processor is configured to automatically communicate with the at least one server by:

receiving a compressed speech waveform corresponding to a synthesized speech waveform synthesized using the at least one server and/or compressed features of the synthesized speech waveform.

7. The mobile device of claim 1, wherein processing the requested conversational service comprises performing speech recognition on a speech waveform, and the at least one processor is configured to automatically communicate with the at least one server by transmitting compressed features of the speech waveform to the at least one server.

13. The method of claim 1, wherein processing the requested conversational service comprises performing text-to-speech synthesis, and automatically communicating with the at least one server comprises:

receiving a compressed speech waveform corresponding to a synthesized speech waveform synthesized using the at least one server and/or compressed features of the synthesized speech waveform.

14. The method of claim 1, wherein processing the requested conversational service comprises performing speech recognition on a speech waveform, and automatically communicating with the at least one server comprises transmitting compressed features of the speech waveform to the at least one server.

8. A method for facilitating allocation of conversational resources among a mobile device and at least one server, the method comprising:

in response to receiving a request for a conversational service, determining at the mobile device, based at least in part on available conversational resources at the mobile device, which one of the following three ways is to be used for processing the requested conversational service;

(1) processing the requested conversational service locally using the mobile device,

(2) processing the requested conversational service remotely using the at least one server, and

(3) processing the requested conversational service at least in part locally using the mobile device and at least in part remotely using the at least one server, wherein the determining is performed without evaluating whether processing the requested conversational service locally produces acceptable results; and

automatically communicating, via a network, with the at least one server in furtherance of processing of the requested conversational service, when it is determined that the requested conversational service is to be processed partially or fully using the at least one server.

9. The method of claim 8, wherein the determining comprises determining that the requested conversational service is to be processed remotely using the at least one server, when the requested conversational service is a conversational service that, prior to receiving the request for the conversational service, has been designated as a type of service to be processed remotely.

10. The method of claim 8, wherein the determining is further based on conditions of the network.

11. The method of claim 8, wherein when it is determined that the requested conversational service is to be processed at least in part using the mobile device, the method further comprises:

processing the requested conversational service at least in part by using conversational resources at the mobile device.

12. The method of claim 8, wherein processing the requested conversational service comprises performing speech recognition on a speech waveform, and automatically communicating with the at least one server comprises:

transmitting a compressed speech waveform corresponding to the speech waveform.

15. At least one non-transitory computer readable storage medium tangibly embodying program instructions that, when executed by at least one processor, cause the at least one processor to perform a method for facilitating allocation of conversational resources among a mobile device and at least one server, the method comprising:

in response to receiving a request for a conversational service, determining at the mobile device, based at least in part on available conversational resources at the mobile device, which one of the following three ways is to be used for processing the requested conversational service;

(1) processing the requested conversational service locally using the mobile device,

(2) processing the requested conversational service remotely using the at least one server, and

(3) processing the requested conversational service at least in part locally using the mobile device and at least in part remotely using the at least one server, wherein the determining is performed without evaluating whether processing the requested conversational service locally produces acceptable results; and

automatically communicating, via a network, with the at least one server in furtherance of processing of the requested conversational service, when it is determined that the requested conversational service is to be processed partially or fully using the at least one server.

16. The at least one non-transitory computer readable medium of claim 15, wherein the determining comprises determining that the requested conversational service is to be processed remotely using the at least one server, when the requested conversational service is a conversational service that, prior to receiving the request for the conversational service, has been designated as a type of service to be processed remotely.

17. The at least one non-transitory computer readable medium of claim 15, wherein the determining is further based on conditions of the network.

18. The at least one non-transitory computer readable medium of claim 15, wherein when it is determined that the requested conversational service is to be processed at least in part using the mobile device, the method further comprises:

processing the requested conversational service at least in part by using conversational resources at the mobile device.

19. The at least one non-transitory computer readable medium of claim 15, wherein processing the requested conversational service comprises performing speech recognition on a speech waveform, and automatically communicating with the at least one server comprises:

transmitting a compressed speech waveform corresponding to the speech waveform.

20. The at least one non-transitory computer readable medium of claim 15, wherein processing the requested conversational service comprises performing text-to-speech synthesis, and automatically communicating with the at least one server comprises:

receiving a compressed speech waveform corresponding to a synthesized speech waveform synthesized using the at least one server and/or compressed features of the synthesized speech waveform.