Audio associating of computing devices

• US 10,379,808 B1
• Filed: 09/29/2015
• Issued: 08/13/2019
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Angel, Justin-Josef, Breitbard, Eric Alan, Ryan, Sean Robert, Murdock, Robert Steven, McQueen, Michael Douglas, Chase, Ryan Charles, Swann, Colin Neil
• Primary Examiner(s): Le, Thuykhanh
• Application Number:
  US14/869,405
• Time in Patent Office: 1,414 Days
• Field of Search: None
• CPC Class Codes: G06F 3/1407 General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/54 for retrieval

Abstract

Methods, systems and apparatus for associating electronic devices together based on received audio commands are described. Methods for associating an audio-controlled device with a physically separate display screen device such that information responses can then be provided in both audio and graphic formats using the two devices in conjunction with each other are described. The audio-controlled device can receive audio commands that can be analyzed to determine the author, which can then be used to further streamline the association operation.

Claims

1. A system, comprising:

at least one processor; and

at least one memory including instructions that, when executed by the at least one processor, cause the system to;

receive, from a first device, first audio data representing first speech;

determine the first audio data includes a first request to output first content, the first content corresponding to visual content;

determine a second device including a display;

cause the second device to present second content using the display;

receive, from the first device, second audio data representing second speech;

determine the second speech indicates the second content;

based at least in part on determining the second speech indicates the second content, generate an association between the first device and the second device; and

based at least in part on the association, cause the second device to present the first content using the display.

2. The system of claim 1, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third audio data representing third speech;

determine the third audio data includes a second request to present further content using a different display;

determine a third device including a second display;

cause the third device to present third content using the second display;

receive, from the first device, fourth audio data representing fourth speech;

determine the fourth speech indicates the third content;

terminate the first association; and

generate a second association between the first device and the third device.

3. The system of claim 1, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

represent, in a user account, the second device as a default display device.

4. The system of claim 1, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third audio data representing third speech;

determine the third audio data includes a second request to output third content;

determine a response to the second request;

cause the second device to present at least one graphic, representing the response, using the display; and

cause at least one speaker component, associated with the second device, to output audio representing the response.

5. A system, comprising:

at least one processor; and

at least one memory including instructions that, when executed by the at least one processor, cause the system to;

receive, from a first device, first audio data representing first speech;

determine the first audio data includes a first request to output first content;

identify a user account associated with the first device;

select, from the user account, a second device including a display;

cause the second device to present second content using the display;

receive, from the first device, second audio data representing second speech;

determine the second speech indicates the second content;

based at least in part on determining the second speech indicates the second content, generate a first association between the first device and the second device; and

cause the second device to present the first content.

6. The system of claim 5, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third audio data representing third speech;

determine the third audio data includes a second request to present further content using a different display;

select, from the user account, a third device including a second display;

cause the third device to present third content using the second display;

receive, from the first device, fourth audio data representing fourth speech;

determine the fourth speech indicates the third content;

terminate the first association; and

generate a second association between the first device and the third device.

7. The system of claim 5, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

represent, in the user account, the second device as a default display device.

8. The system of claim 5, wherein the second content is at least one image.

9. The system of claim 5, wherein the second content is text comprising one or more words.

10. The system of claim 5, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third audio data representing third speech;

determine the third audio data includes a second request to output third content;

determine a response to the second request;

cause the second device to present at least one image, representing the response, using the display; and

cause at least one speaker component, associated with the second device, to output audio representing the response.

11. The system of claim 5, wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the system to:

determine a messaging system associated with the second device; and

causing the messaging system to perform at least one of;

sending a notification to the second device, the notification including the second content;

or

send an image to the second device, the image corresponding to the second content.

12. A method, comprising:

receiving, from a first device, first audio data representing first speech;

determining the first audio data includes a first request to output first content;

determining a second device including a display;

causing the second device to present second content using the display;

receiving, from the first device, second audio data representing second speech;

determining the second speech indicates the second content;

based at least in part on determining the second speech indicates the second content, generating a first association between the first device and the second device; and

causing the second device to present the first content.

13. The method of claim 12, further comprising:

determining a messaging system associated with the second device; and

causing the messaging system to send a push notification to the second device, the push notification including the second content.

14. The method of claim 12, further comprising:

determining a messaging system associated with the second device; and

causing the messaging system to send an image to the second device, the image corresponding to the second content.

15. The method of claim 12, further comprising:

determining a messaging system associated with the second device; and

causing the messaging system to send a text message to the second device, the text message including the second content.

16. The method of claim 12, further comprising:

receiving, from the first device, third audio data representing third speech;

determining the third audio data includes a second request to switch presentment of content from the second device to a different device;

determining a third device including a second display;

causing the third device to present third content using the second display;

receiving, from the first device, fourth audio data representing fourth speech;

determining the fourth speech indicates the third content;

terminating the first association; and

generating a second association between the first device and the third device.

17. The method of claim 16, further comprising:

determining a messaging system associated with the third device; and

causing the messaging system to send a push notification to the third device, the push notification including the third content.

18. The method of claim 16, further comprising:

representing, in a user account, the third device as a default display device.

19. The method of claim 12, further comprising:

determining a first user that originated the second speech;

determining the first user is unauthorized to receive the first content; and

preventing the second device from presenting the first content.

20. The method of claim 12, further comprising:

determining a user account represents the second device as a default display device.