Response endpoint selection based on user proximity determination

• US 10,778,778 B1
• Filed: 02/22/2016
• Issued: 09/15/2020
• Est. Priority Date: 12/14/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Blanksteen, Scott Ian
• Primary Examiner(s): Barry, Lance Leonard
• Application Number:
  US15/049,914
• Time in Patent Office: 1,667 Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04L 51/07 characterised by the inclusion of specific contents
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/18 Commands or executable codes
• CPC Class Codes: H04L 51/21 Monitoring or handling of messages
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings

Abstract

A computer-implemented method involves receiving a request corresponding to input provided by a user and generating first data associated with a response to the request. Second data associated with a proximity of the user to the first computing device may be received from the first computing device, and third data associated with a proximity of the user to the second computing device may be received from the second computing device. Based at least on the second data and the third data, it may be determined that the user is closer to the first computing device than to the second computing device. Based at least in part on the user being closer to the first computing device than to the second computing device, it may be determined that the response is to be sent to the first computing device.

Claims

1. A computer-implemented method comprising:

receiving a request corresponding to input provided by a user;

generating first data associated with a response to the request;

receiving, from a first computing device, second data associated with a proximity of the user to the first computing device;

receiving, from a second computing device, third data associated with a proximity of the user to the second computing device;

determining, based at least on the second data and the third data, that the user is closer to the first computing device than to the second computing device;

determining, based at least in part on the user being closer to the first computing device than to the second computing device, that the response is to be sent to the first computing device; and

sending the first data associated with the response to the first computing device for presentation of the response to the user.

2. The computer-implemented method as recited in claim 1, wherein the second data further indicates at least a direction the user is moving while uttering the request and wherein determining that the response is to be sent to the first computing device is further based at least on in part the first computing device being located in the direction.

3. The computer-implemented method as recited in claim 1, wherein the request is received by a third computing device at a first location and the first computing device is at a second location different from the first location.

4. The computer-implemented method as recited in claim 1, wherein generating the first data associated with the response further comprises determining a time to send the first data associated with the response.

5. The computer-implemented method as recited in claim 4, further comprising:

accessing a user profile including a calendar of the user indicating at least one appointment of the user;

determining a venue of the at least one appointment of the user, the at least one appointment scheduled for a period including the time to send the first data associated with the response; and

determining that the venue of the at least one appointment is near the first computing device;

wherein determining that the response is to be sent to the first computing device is further based at least in part on the venue of the at least one appointment being near the first computing device.

6. The computer-implemented method as recited in claim 4, wherein determining the time to send the first data associated with the response further comprises at least one of:

determining, from the request, that the user has requested that the first data associated with the response be sent at a specific time;

accessing fourth data associated with a previous request from a user profile of the user;

or

accessing fifth data associated with an activity pattern from the user profile of the user.

7. The computer-implemented method as recited in claim 1, further comprising:

determining that the first computing device is within a threshold distance of a location of the user, based on sensor data captured by a sensor of the first computing device;

wherein determining that the response is to be sent to the first computing device is further based at least in part on the first computing device being within the threshold distance of the location of the user.

8. The computer-implemented method as recited in claim 7, wherein the location of the user comprises at least one of an intersection of geographical coordinates, a position relative to at least one of the first computing device or the second computing device, or a distance from at least one of the first computing device or the second computing device.

9. The computer-implemented method as recited in claim 1, further comprising:

analyzing audio data, representing at least a voice of the user, captured by the first computing device; and

detecting that the user is within a threshold distance of the first computing device based at least in part on the audio data;

wherein determining that the response is to be sent to the first computing device is further based at least in part on the user being within the threshold distance.

10. The computer-implemented method as recited in claim 1, wherein determining that the response is to be sent to the first computing device further comprises:

analyzing visual data representing at least one image captured by the first computing device; and

determining that the user is represented in the at least one image.

11. The computer-implemented method as recited in claim 1, wherein:

the second data indicates a first distance between the user and the first computing device;

the third data indicates a second distance between the user and the second computing device; and

determining that user is closer to the first computing device than to the second computing device comprises determining that the first distance is lesser than the second distance.

12. The computer-implemented method as recited in claim 1, wherein:

the second data indicates a first time at which audio was detected by the first computing device;

the third data indicates a second time at which the audio was detected by the second computing device; and

determining that user is closer to the first computing device than to the second computing device comprises determining that the first time was earlier than the second time.

13. A system, comprising:

one or more processors; and

one or more computer-readable media having computer-executable instructions that, when executed by the one or more processors, cause the system to perform operations comprising;

receiving a request associated with input provided by a user;

generating first data associated with a response to the request;

receiving, from a first computing device, second data associated with a proximity of the user to the first computing device;

receiving, from a second computing device, third data associated with a proximity of the user to the second computing device;

determining, based at least on the second data and the third data, that the user is closer to the first computing device than to the second computing device;

determining, based at least in part on the user being closer to the first computing device than to the second computing device, that the response is to be sent to the first computing device; and

sending the first data associated with the response to the first computing device for presentation of the response to the user.

14. The system as recited in claim 13, wherein the second data further indicates at least a direction the user is moving while uttering the request and wherein determining that the response is to be sent to the first computing device is further based at least in part the first computing device being located in the direction.

15. The system as recited in claim 13, wherein the request is received from a third computing device at a first location and the first computing device is at a second location different from the first location.

16. The system as recited in claim 13, wherein generating the first data associated with the response further comprises determining a time to send the first data associated with the response.

17. The system as recited in claim 16, wherein the operations further comprise:

accessing a user profile including a calendar of the user indicating at least one appointment of the user;

determining a venue of the at least one appointment of the user, the at least one appointment scheduled for a period including the time to send the first data associated with the response; and

determining that the venue of the at least one appointment is near the first computing device;

wherein determining that the response is to be sent to the first computing device is further based at least in part on the venue of the at least one appointment being near the first computing device.

18. The system as recited in claim 16, wherein determining the time to send the first data associated with the response further comprises at least one of:

determining, from the request, that the user has requested that the first data associated with the response be sent at a specific time;

accessing fourth data associated with a previous request from a user profile of the user;

or

accessing fifth data associated with an activity pattern from the user profile of the user.

19. The system as recited in claim 13, wherein:

the second data indicates a first distance between the user and the first computing device;

the third data indicates a second distance between the user and the second computing device; and

determining that user is closer to the first computing device than to the second computing device comprises determining that the first distance is lesser than the second distance.

20. The system as recited in claim 13, wherein:

the second data indicates a first time at which audio was detected by the first computing device;

the third data indicates a second time at which the audio was detected by the second computing device; and

determining that user is closer to the first computing device than to the second computing device comprises determining that the first time was earlier than the second time.

21. A system, comprising:

one or more processors; and

at least one computer-readable storage media storing computer-executable instructions, which when executed by the one or more processors cause the system to perform operations comprising;

receiving, from a first computing device, a request corresponding to input provided by a user to a user interface of the first computing device;

generating first data associated with a response to the request;

receiving, from a second computing device, second data associated with a proximity of the user to the second computing device;

receiving, from a third computing device, third data associated with a proximity of the user to the third computing device;

determining, based at least on the second data and the third data, that the user is closer to the second computing device than to the third computing device;

determining, based at least in part on the user being closer to the second computing device than to the third computing device, that the response is to be sent to the second computing device; and

sending the first data associated with the response to the second computing device for output via the user interface.

22. The system as recited in claim 21, wherein the computer-executable instructions cause the system to further perform operations comprising:

determining that the second computing device is within a threshold distance of a location of the user, based on sensor data captured by a sensor of the second computing device;

wherein determining that the response is to be sent to the second computing device is further based at least in part on the second computing device being within the threshold distance of the location of the user.

23. The system as recited in claim 22, wherein the location comprises at least one of an intersection of geographical coordinates, a position relative to at least one of the second computing device or the third computing device, or a distance from at least one of the second computing device or the third computing device.

24. The system as recited in claim 21, wherein the computer-executable instructions cause the system to further perform operations comprising:

analyzing audio data, representing at least a voice of the user, captured by of the second computing device; and

detecting that the user is within a threshold distance of the second computing device based at least in part on the audio data;

wherein determining that the response is to be sent to the second computing device is further based at least in part on the user being within the threshold distance.

25. The system as recited in claim 21, wherein the second data further indicates at least a direction the user is moving while uttering the request and wherein determining that the response is to be sent to the second computing device is further based at least in part the second computing device being located in the direction.

26. The system as recited in claim 21, wherein:

the second data indicates a first distance between the user and the second computing device;

the third data indicates a second distance between the user and the third computing device; and

determining that user is closer to the second computing device than to the third computing device comprises determining that the first distance is lesser than the second distance.

27. The system as recited in claim 21, wherein:

the second data indicates a first time at which audio was detected by the second computing device;

the third data indicates a second time at which the audio was detected by the third computing device; and

determining that the user is closer to the second computing device than to the third computing device comprises determining that the first time was earlier than the second time.