Voice application finding and user invoking applications related to a single entity

• US 8,706,505 B1
• Filed: 07/17/2013
• Issued: 04/22/2014
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bringert, Bjorn Erik, Pietryka, Pawel, Hodgson, Peter John, Tickner, Simon, Penha, Henrique, Cohen, Richard Zarek, Zanolin, Luca, Foster, Marcus
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US13/944,229
• Time in Patent Office: 279 Days
• Field of Search: 704/275
• US Class Current: 704/275
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A computing device is configured to initiate actions in response to speech input that includes a name or other indication of an entity, in a first spoken utterance, followed by an action, in a second spoken utterance. The computing device receives the first spoken utterance, identifies an entity based on the first spoke utterance, and indicates a plurality of available actions based on the identified entity. The computing device then receives the second spoken utterance and identifies a selection of at least one of the available actions based on the second spoken utterance. The computing device then initiates the at least one selected action.

Claims

1. A method, comprising:

receiving, by a computing device, a first spoken utterance;

obtaining, by the computing device, first text based upon speech recognition performed upon the first spoken utterance;

identifying, by the computing device, an entity based on the first text;

indicating, by the computing device, a plurality of available actions based on the identified entity, wherein the plurality of available actions corresponds to a plurality of applications;

receiving, by the computing device, a selection of at least one action from among the plurality of available actions; and

invoking, by the computing device, one or more of the plurality of applications based on the at least one selected action.

2. The method of claim 1, wherein receiving, by the computing device, a selection of at least one action from among the plurality of available actions comprises:

after indicating the plurality of available actions, receiving, by the computing device, a second spoken utterance;

obtaining, by the computing device, second text based upon speech recognition performed upon the second spoken utterance; and

identifying, by the computing device, the at least one selected action based on the second text.

3. The method of claim 1, wherein identifying the entity based on the first text comprises:

determining a search query based on the first text;

performing a search based on the search query;

receiving at least one search result for the search; and

identifying the entity in the at least one search result.

4. The method of claim 1, wherein indicating, by the computing device, a plurality of available actions based on the identified entity comprises:

visually displaying textual or graphical indications of the available actions.

5. The method of claim 1, wherein indicating, by the computing device, a plurality of available actions based on the identified entity comprises:

providing audible indications of the available actions in the form of synthesized speech.

6. The method of claim 1, further comprising:

determining that the first text includes a selection criterion, wherein the plurality of applications satisfy the selection criterion.

7. The method of claim 1, wherein the entity is a person or a place.

8. A non-transitory computer readable medium having stored therein instructions executable by at least one processor to cause a computing device to perform functions, the functions comprising:

receiving a first spoken utterance;

obtaining first text based upon speech recognition performed upon the first spoken utterance;

identifying an entity based on the first text;

indicating a plurality of available actions based on the identified entity, wherein the plurality of available actions corresponds to a plurality of applications;

receiving a selection of at least one action from among the plurality of available actions and

invoking one or more of the plurality of applications based on the at least one selected action.

9. The non-transitory computer readable medium of claim 8, wherein receiving a selection of at least one action from among the plurality of available actions comprises:

after indicating the plurality of available actions, receiving a second spoken utterance;

obtaining second text based upon speech recognition performed upon the second spoken utterance; and

identifying the at least one selected action based on the second text.

10. The non-transitory computer readable medium of claim 8, wherein identifying the entity based on the first text comprises:

determining a search query based on the first text;

performing a search based on the search query;

receiving at least one search result for the search; and

identifying the entity in the at least one search result.

11. The non-transitory computer readable medium of claim 8, wherein indicating the plurality of applications comprises visually displaying textual or graphical indications of the applications.

12. The non-transitory computer readable medium of claim 8, wherein indicating the plurality of applications comprises providing audible indications of the applications in the form of synthesized speech.

13. The non-transitory computer readable medium of claim 8, wherein the entity is a person or a place.

14. A computing device, comprising:

at least one processor;

data storage;

a plurality of instructions stored in the data storage and executable by the at least one processor to cause the computing device to perform functions, the functions comprising;

receiving a first spoken utterance;

obtaining first text based upon speech recognition performed upon the first spoken utterance;

identifying an entity based on the first text;

indicating a plurality of available actions based on the identified entity, wherein the plurality of available actions corresponds to a plurality of applications;

receiving a selection of at least one action from among the plurality of available actions and

invoking one or more of the plurality of applications based on the at least one selected action.

15. The computing device of claim 14, further comprising a display, wherein indicating a plurality of available actions based on the identified entity comprises displaying textual or graphical indications of the available actions on the display.

16. The computing device of claim 14, further comprising a text-to-speech (TTS) engine, wherein indicating a plurality of available actions based on the identified entity comprises using the TTS engine to describe the available actions in a spoken form.

17. The computing device of claim 14, wherein receiving a selection of at least one action from among the plurality of available actions comprises:

after indicating the plurality of available actions, receiving a second spoken utterance;

obtaining second text based upon speech recognition performed upon the second spoken utterance; and

identifying the at least one selected action based on the second text.

18. The computing device of claim 17, further comprising a communication interface.

19. The computing device of claim 18, wherein obtaining first text based upon speech recognition performed upon the first spoken utterance comprises communicating with a network server through the communication interface.

20. The computing device of claim 18, wherein obtaining second text based upon speech recognition performed upon the second spoken utterance comprises communicating with a network server through the communication interface.