Voice control for asynchronous notifications

• US 8,468,022 B2
• Filed: 09/25/2012
• Issued: 06/18/2013
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bringert, Bjorn Erik, Pietryka, Pawel, Hodgson, Peter John, Burke, Dave, Penha, Henrique, Tickner, Simon, Cohen, Richard Zarek, Zanolin, Luca, LeBeau, Michael J.
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US13/626,375
• Publication Number:
  US 20130085761A1
• Time in Patent Office: 266 Days
• Field of Search: 704/270, 704/270.1, 704/275
• US Class Current: 704/275
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00

Abstract

A computing device may receive an incoming communication and, in response, generate a notification that indicates that the incoming communication can be accessed using a particular application on the communication device. The computing device may further provide an audio signal indicative of the notification and automatically activate a listening mode. The computing device may receive a voice input during the listening mode, and an input text may be obtained based on speech recognition performed upon the voice input. A command may be detected in the input text. In response to the command, the computing device may generate an output text that is based on at least the notification and provide a voice output that is generated from the output text via speech synthesis. The voice output identifies at least the particular application.

Claims

1. A method comprising:

providing, by a computing device, an audio signal indicative of a notification and automatically activating a listening mode on the computing device, wherein the notification indicates that an incoming communication can be accessed using a particular application on the computing device;

receiving a voice input during the listening mode;

obtaining an input text based on speech recognition performed upon the voice input;

detecting a command in the input text;

generating an output text in response to detecting the command in the input text, wherein the output text is based on at least the notification;

providing, by the computing device, a voice output that identifies at least the particular application prior to receiving a selection of the particular application, wherein the voice output is generated from the output text via speech synthesis; and

receiving an additional voice input after providing the voice output, wherein the additional voice input selects the particular application.

2. The method of claim 1, further comprising:

obtaining an additional input text based on speech recognition performed upon the additional voice input;

determining that the additional input text identifies the particular application; and

in response to determining that the additional input text identifies the particular application, invoking the particular application.

3. The method of claim 2, wherein invoking the particular application comprises invoking the particular application in a voice mode.

4. The method of claim 1, wherein the incoming communication is one of a text message, an email, a voicemail, or a missed call.

5. The method of claim 1, further comprising:

receiving the incoming communication; and

generating the notification in response to receiving the incoming communication.

6. The method of claim 5, further comprising:

displaying an indication of a total number of current notifications.

7. The method of claim 6, wherein the current notifications include the notification and one or more stored notifications, wherein each stored notification indicates that a respective incoming communication can be accessed using a respective application on the computing device.

8. The method of claim 7, wherein the current notifications relate to incoming communications that can be accessed using a plurality of different applications.

9. The method of claim 8, wherein the voice output identifies each of the different applications.

10. The method of claim 9, wherein the output text is based on the notification and the one or more stored notifications.

11. The method of claim 8, further comprising:

displaying identifications of each of the different applications and indications of how many of the current notifications relate to each of the different applications.

12. A non-transitory computer-readable medium having stored thereon program instructions that, upon execution by a computing device, cause the computing device to perform operations comprising:

receiving an incoming communication;

generating a notification in response to receiving the incoming communication, wherein the notification indicates that the incoming communication can be accessed using a particular application on the computing device;

providing an audio signal indicative of the notification and automatically activating a listening mode on the computing device;

receiving a voice input during the listening mode;

obtaining an input text based on speech recognition performed upon the voice input;

detecting a command in the input text;

generating an output text in response to detecting the command in the input text, wherein the output text is based on at least the notification;

providing a voice output that identifies at least the particular application prior to receiving a selection of the particular application, wherein the voice output is generated from the output text via speech synthesis; and

receiving an additional voice input after providing the voice output, wherein the additional voice input selects the particular application.

13. The non-transitory computer-readable medium of claim 12, wherein the operations further comprise displaying an indication of a total number of current notifications.

14. The non-transitory computer-readable medium of claim 13, wherein the current notifications include the notification and one or more stored notifications, wherein each stored notification indicates that a respective incoming communication can be accessed using a respective application on the computing device.

15. The non-transitory computer-readable medium of claim 13, wherein the current notifications relate to incoming communications that can be accessed using a plurality of different applications.

16. The non-transitory computer-readable medium of claim 15, wherein the voice output identifies each of the different applications.

17. A computing device, comprising:

an audio input unit;

an audio output unit;

at least one processor; and

a memory, wherein the memory stores instructions that upon execution by the at least one processor cause the computing device to perform operations comprising;

receiving an incoming communication;

generating a notification in response to receiving the incoming communication, wherein the notification indicates that the incoming communication can be accessed using a particular application on the computing device;

providing, via the audio output unit, an audio signal indicative of the notification and automatically activating a listening mode on the computing device;

receiving, via the audio input unit, a voice input during the listening mode;

obtaining an input text based on speech recognition performed upon the voice input;

detecting a command in the input text;

generating an output text in response to detecting the command in the input text, wherein the output text is based on at least the notification;

providing, via the audio output unit, a voice output that identifies at least the particular application prior to receiving a selection of the particular application, wherein the voice output is generated from the output text via speech synthesis; and

receiving an additional voice input after providing the voice output, wherein the additional voice input selects the particular application.

18. The computing device of claim 17, wherein the operations further comprise:

obtaining an additional input text based on speech recognition performed upon the additional voice input;

determining that the additional input text identifies the particular application; and

in response to determining that the additional input text identifies the particular application, invoking the particular application.

19. The computing device of claim 18, wherein invoking the particular application comprises invoking the particular application in a voice mode.

20. The computing device of claim 17, further comprising a display, wherein the operations further comprise displaying an indication of a total number of current notifications, wherein the current notifications include the notification and one or more stored notifications, and wherein each stored notification indicates that a respective incoming communication can be accessed using a respective application on the computing device.