Contingent device actions during loss of network connectivity

• US 10,224,056 B1
• Filed: 12/17/2013
• Issued: 03/05/2019
• Est. Priority Date: 12/17/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Torok, Fred, Mutagi, Rohan, Gundeti, Vikram Kumar, Deramat, Frederic Johan Georges
• Primary Examiner(s): Baker, Matthew H
• Application Number:
  US14/109,319
• Time in Patent Office: 1,904 Days
• Field of Search: 704200-231, 704246, 704251-255, 704270-2701, 704273-275, 704E17001-E17016, 704E15001-E1505, 704E11001-E11007
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 12/2825 Reporting to a device located outside the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; telephonic communication systems adapted for combination with telemetering systems H04M11/002

Abstract

A speech-based system includes a local device in a user premises and a network-based control service that directs the local device to perform actions for a user. The control service may specify a first action that is to be performed upon detection by the local device of a stimulus. In some cases, performing the first action may rely on the availability of network communications with the control service or with another service. In these cases, the control service also specifies a second, fallback action that does not rely upon network communications. Upon detecting the stimulus, the local device performs the first action if network communications are available. If network communications are not available, the local device performs the second, fallback action.

Claims

1. A device, comprising:

a network communications interface configured to connect to one or more network-based computing devices through a communications network;

a microphone to generate an audio signal based at least in part on audio, the audio signal representing speech;

a speaker;

a memory storing first audio data; and

control logic configured to perform acts comprising;

sending the audio signal to the one or more network-based computing devices for recognition of the speech;

receiving a command from the one or more network-based computing devices, the command indicating a notification time derived from the audio signal using speech recognition, wherein the notification time is a time for obtaining, via the communications network, second audio data from a network source; and

at the notification time;

determining that the communications network is unavailable; and

causing, based at least in part on determining that the communications network is unavailable, output of audio content represented by the first audio data using the speaker.

2. The device of claim 1, wherein the command further indicates the first audio data.

3. The device of claim 1, wherein the command contains the first audio data.

4. The device of claim 1, wherein the second audio data comprises music or spoken word.

5. The device of claim 1, wherein the network source comprises a network-accessible music repository.

6. A device, comprising:

one or more processors; and

one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising;

transmitting, to one or more network-based computing devices, an audio signal;

receiving one or more commands from the one or more network-based computing devices, wherein the one or more commands specify a stimulus for obtaining, via a network communication, first audio data from a source, and wherein the one or more commands are derived from the audio signal using speech recognition;

storing second audio data;

determining that the stimulus has occurred; and

in response to determining that the stimulus has occurred;

determining that the first audio data is at least temporarily unobtainable from the source; and

causing output of audio content represented by the second audio data based at least in part on the first audio data being at least temporarily unobtainable from the source.

7. The device of claim 6, the acts further comprising:

receiving an indication that a current time of day corresponds to a predefined time of day,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication.

8. The device of claim 6, the acts further comprising:

receiving an indication that a predefined amount of time has elapsed,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication.

9. The device of claim 6, the acts further comprising:

receiving an indication that a predefined environmental condition has occurred,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication.

10. The device of claim 6, wherein the first audio data comprises a first error message and the second audio data comprises a second error message, and wherein the first error message contains more information than the second error message.

11. The device of claim 6, wherein the first audio data comprises an error message that is generated dynamically by the one or more network-based computing devices and the second audio data comprises a predefined error message.

12. The device of claim 6, the acts further comprising receiving, prior to determining that the stimulus has occurred, the second audio data from the one or more network-based computing devices.

13. The device of claim 6, wherein the one or more commands further specify that the device is to output the audio content represented by the second audio data based at least in part on the first audio data being unobtainable.

14. A method, comprising:

receiving, at a local device and from one or more remote network-based computing devices associated with a remote control service providing services to a plurality of devices, an identification of a stimulus, and an indication of a primary action that is to be initiated at the device in response to the stimulus occurring, wherein the primary action relies on access to the remote control service through a communications network;

receiving, at the local device and from the one or more remote network-based computing devices, an indication of a contingent action that is to be initiated at the device in response to the stimulus occurring, wherein the contingent action may be performed without access to the remote control service;

storing, by the local device, audio content;

determining, by the local device, that the stimulus has occurred; and

in response to determining that the stimulus has occurred;

determining, by the local device, that the remote control service is inaccessible; and

based at least in part on determining that the remote control service is inaccessible, performing, by the local device, the contingent action, wherein the contingent action includes at least outputting the audio content.

15. The method of claim 14, wherein the primary action comprises controlling one or more devices within a home.

16. The method of claim 14, wherein:

the primary action comprises obtaining and presenting a weather forecast; and

the audio content corresponds to a previously cached weather forecast.

17. The method of claim 14, wherein the primary action comprises notifying, by the local device, a user using a first communications medium.

18. The method of claim 14, wherein:

the primary action comprises receiving and outputting an error message that is generated dynamically by a network-accessible source; and

the audio content comprises a predefined error message.

19. The method of claim 14, wherein the primary action comprises obtaining additional audio content using the communications network and outputting the additional audio content.

20. The method of claim 14, further comprising:

receiving, from the one or more remote network-based computing devices, an indication of a predefined time of day,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication of the predefined time of day.