Location-based responses to telephone requests

• US 10,163,441 B2
• Filed: 12/29/2017
• Issued: 12/25/2018
• Est. Priority Date: 04/02/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Hafsteinsson, Gudmundur, LeBeau, Michael J., Marmasse, Natalia, Agarwal, Sumit, Nishar, Dipchand
• Primary Examiner(s): Guerra-Erazo, Edgar X
• Application Number:
  US15/858,874
• Publication Number:
  US 20180190286A1
• Time in Patent Office: 361 Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2242/15 Information service where the information is dependent on the location of the subscriber
• CPC Class Codes: H04W 4/14 Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]

Abstract

A method for receiving processed information at a remote device is described. The method includes transmitting from the remote device a verbal request to a first information provider and receiving a digital message from the first information provider in response to the transmitted verbal request. The digital message includes a symbolic representation indicator associated with a symbolic representation of the verbal request and data used to control an application. The method also includes transmitting, using the application, the symbolic representation indicator to a second information provider for generating results to be displayed on the remote device.

Claims

1. A computer-implemented method, comprising:

transmitting, from a computing device and to a first remote service, an indication of a verbal input from a user of the computing device;

receiving, by the computing device and from the first remote service, a response to the verbal input, the response to the verbal input including;

(i) an indication of a particular application that the first remote service identified as having significance to the verbal input from the user of the computing device, and

(ii) a symbolic representation of the verbal input;

in response to receiving the response to the verbal input;

(i) establishing a connection with a second remote service that corresponds to the particular application that the first remote service identified as having significance to the verbal input from the user of the computing device, and

(ii) launching the particular application within an interface presented by the computing device;

transmitting, from the computing device and to the second remote service, a query;

receiving, by the computing device and from the second remote service, a response to the query; and

presenting, by the computing device and through the interface as an output of the particular application, the response to the query.

2. The computer-implemented method of claim 1, wherein:

transmitting the indication of the verbal input from the computing device and to the first remote service comprises transmitting a recording of the verbal input to the first remote service; and

the first remote service is configured to use a speech-to-text converter to convert the recording of the verbal input to a textual representation of the verbal input.

3. The computer-implemented method of claim 1, wherein the first remote service is configured to use an application selector to select the particular application from a plurality of possible applications based on content of the verbal input from the user of the computing device.

4. The computer-implemented method of claim 1, wherein the particular application is installed on the computing device.

5. The computer-implemented method of claim 1, further comprising generating the query at the computing device based on the response to the verbal input.

6. The computer-implemented method of claim 5, wherein generating the query based on the response to the verbal input comprises formatting the query to include data that is based on the symbolic representation of the verbal input.

7. The computer-implemented method of claim 1, comprising using the indication of the particular application that the first remote service identified as having significance to the verbal input from the user of the computing device to establish the connection with the second remote service that corresponds to the particular application.

8. The computer-implemented method of claim 1, wherein the symbolic representation of the verbal input comprises a textual representation of the verbal input resulting from a speech-to-text conversion of the verbal input.

14. The computer-readable medium of claim 5, wherein generating the query based on the response to the verbal input comprises formatting the query to include data that is based on the symbolic representation of the verbal input.

9. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor of a computing device, causes the processor to perform operations comprising:

transmitting, from the computing device and to a first remote service, an indication of a verbal input from a user of the computing device;

receiving, by the computing device and from the first remote service, a response to the verbal input, the response to the verbal input including;

(i) an indication of a particular application that the first remote service identified as having significance to the verbal input from the user of the computing device, and

(ii) a symbolic representation of the verbal input;

in response to receiving the response to the verbal input;

(i) establishing a connection with a second remote service that corresponds to the particular application that the first remote service identified as having significance to the verbal input from the user of the computing device, and

(ii) launching the particular application within an interface presented by the computing device;

transmitting, from the computing device and to the second remote service, a query;

receiving, by the computing device and from the second remote service, a response to the query; and

presenting, by the computing device and through the interface as an output of the particular application, the response to the query.

10. The computer-readable medium of claim 9, wherein:

transmitting the indication of the verbal input from the computing device and to the first remote service comprises transmitting a recording of the verbal input to the first remote service; and

the first remote service is configured to use a speech-to-text converter to convert the recording of the verbal input to a textual representation of the verbal input.

11. The computer-readable medium of claim 9, wherein the first remote service is configured to use an application selector to select the particular application from a plurality of possible applications based on content of the verbal input from the user of the computing device.

12. The computer-readable medium of claim 9, wherein the particular application is installed on the computing device.

13. The computer-readable medium of claim 9, wherein the operations further comprise generating the query at the computing device based on the response to the verbal input.

15. The computer-readable medium of claim 9, wherein the operations further comprise using the indication of the particular application that the first remote service identified as having significance to the verbal input from the user of the computing device to establish the connection with the second remote service that corresponds to the particular application.

16. The computer-readable medium of claim 9, wherein the symbolic representation of the verbal input comprises a textual representation of the verbal input resulting from a speech-to-text conversion of the verbal input.

17. A computing device comprising:

a processor; and

a computer-readable medium having instructions stored thereon that, when executed by the processor, cause the processor to perform operations comprising;

transmitting, from the computing device and to a first remote service, an indication of a verbal input from a user of the computing device;

receiving, by the computing device and from the first remote service, a response to the verbal input, the response to the verbal input including;

(i) an indication of a particular application that the first remote service identified as having significance to the verbal input from the user of the computing device, and

(ii) a symbolic representation of the verbal input;

in response to receiving the response to the verbal input;

(i) establishing a connection with a second remote service that corresponds to the particular application that the first remote service identified as having significance to the verbal input from the user of the computing device, and

(ii) launching the particular application within an interface presented by the computing device;

transmitting, from the computing device and to the second remote service, a query;

receiving, by the computing device and from the second remote service, a response to the query; and

presenting, by the computing device and through the interface as an output of the particular application, the response to the query.