Context-aware notifications

• US 9,747,072 B2
• Filed: 10/17/2016
• Issued: 08/29/2017
• Est. Priority Date: 04/22/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Noble, Isaac Scott, Bell, Matthew Paul, Strutt, Guenael Thomas
• Primary Examiner(s): LEE, NICHOLAS J
• Application Number:
  US15/295,908
• Publication Number:
  US 20170102916A1
• Time in Patent Office: 316 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10

Abstract

Systems and approaches are provided for presenting incoming notifications to a computing device based on a determined context of the computing device. Various sensors of the device can be used to determine the context of the device with respect to a user, the state of the device itself, or the context of the device with respect to the environment in which the device is situated. The user can then be informed of received notifications in a manner likely to get the user'"'"'s attention while not being overly obtrusive to the user or others within the vicinity of the user.

Claims

1. A computer-implemented method, comprising:

receiving a first notification;

analyzing first image data to determine that a specified object is within a first specified distance from a display;

presenting visual data associated with the first notification via the display;

receiving a second notification;

analyzing second image data to determine that the specified object is between the first specified distance and a second specified distance from the display;

presenting first aural data associated with the second notification at a first volume;

receiving a third notification;

analyzing third image data to determine that the specified object is at least the second specified distance from the display; and

presenting second aural data associated with the third notification at a second volume greater than the first volume.

2. The computer-implemented method of claim 1, further comprising:

capturing the first image data using one or more cameras;

identifying a first representation of a head of a user in the first image data as a first representation of the specified object;

determining that a first line of sight of the user is directed to the display based on the first representation of the head;

determining a first position of the first representation of the head within the first image data;

determining a first distance between the head and the display based at least in part on the first position and one or more predetermined characteristics of the one or more cameras; and

determining that the first distance is within the first specified distance.

3. The computer-implemented method of claim 2, further comprising:

capturing the second image data using the one or more cameras;

identifying a second representation of the head in the second image data as a second representation of the specified object;

determining that a second line of sight of the user is directed away from the display based on the second representation of the head;

determining a second position of the second representation of the head within the second image data;

determining a second distance between the head and the display based at least in part on the second position and the one or more predetermined characteristics; and

determining that the second distance is between the first specified distance and the second specified distance.

4. The computer-implemented method of claim 3, further comprising:

capturing the third image data using the one or more cameras;

identifying no representation of the head in the third image data; and

determining a third distance between the head and the display is at least the second specified distance from the display based at least in part on no representation of the head being identified in the third image data and the one or more predetermined characteristics.

5. The computer-implemented method of claim 1, further comprising:

presenting the first aural data as a first pattern or for a first duration; and

presenting the second aural data as a second pattern or for a second duration.

6. The computer-implemented method of claim 1, further comprising:

determining an amount of ambient noise; and

determining the first volume based at least in part on the amount of ambient noise.

7. The computer-implemented method of claim 1, further comprising:

presenting first vibration data associated with the second notification at a first vibration level; and

presenting second vibration data associated with the third notification at a second vibration level.

8. The computer-implemented method of claim 1, further comprising:

determining a geographic location of a computing device;

determining that the geographic location is associated with operating the computing device in a silent mode;

receiving a fourth notification; and

presenting vibration data associated with the fourth notification via the computing device.

9. The computer-implemented method of claim 1, further comprising:

flashing one or more light emitting diodes within a same period of time of presenting at least one of the visual data, the first aural data, or the second aural data.

10. The computer-implemented method of claim 1, further comprising:

analyzing at least one of the first image data, the second image data, or the third image data using a facial detection algorithm.

11. A system, comprising:

one or more processors;

a display;

memory including instructions that, upon execution by the one or more processors, cause the system to;

receive a first electronic message;

determine that a specified object is within a first specified distance from a display;

present visual data associated with the first electronic message via the display;

receive a second electronic message;

determine that the specified object is between the first specified distance and a second specified distance from the display;

present first aural data associated with the second electronic message at a first volume;

receive a third electronic message;

determine that the specified object is at least the second specified distance from the display; and

present second aural data associated with the third electronic message at a second volume greater than the first volume.

12. The system of claim 11, wherein the instructions upon execution further cause the system to:

capture first image data using one or more cameras;

identify a first representation of a head of a user in the first image data as a first representation of the specified object;

determine that a first line of sight of the user is directed to the display based on the first representation of the head;

determine a first position of the first representation of the head within the first image data;

determine a first distance between the head and the display based at least in part on the first position and one or more predetermined characteristics of the one or more cameras; and

determine that the first distance is within the first specified distance.

13. The system of claim 12, wherein the instructions upon execution further cause the system to:

capture second image data using the one or more cameras;

identify a second representation of the head in the second image data as a second representation of the specified object;

determine that a second line of sight of the user is directed away from the display based on the second representation of the head;

determine a second position of the second representation of the head within the second image data;

determine a second distance between the head and the display based at least in part on the second position and the one or more predetermined characteristics; and

determine that the second distance is between the first specified distance and the second specified distance.

14. The system of claim 13, wherein the instructions upon execution further cause the system to:

capture third image data using the one or more cameras;

identify no representation of the head in the third image data; and

determine a third distance between the head and the display is at least the second specified distance from the display based at least in part on no representation of the head being identified in the third image data and the one or more predetermined characteristics.

15. The system of claim 14, wherein the instructions upon execution further cause the system to:

analyze at least one of the first image data, the second image data, or the third image data using a facial detection algorithm.

16. A computer-implemented method, comprising:

receiving a first electronic message;

determining that a specified object is within a first specified distance from a display;

presenting visual data associated with the first electronic message via the display;

receiving a second electronic message;

determining that the specified object is between the first specified distance and a second specified distance from the display;

presenting first aural data associated with the second electronic message at a first volume;

receiving a third electronic message;

determining that the specified object is at least the second specified distance from the display; and

presenting second aural data associated with the third electronic message at a second volume greater than the first volume.

17. The computer-implemented method of claim 16, further comprising:

determining an amount of ambient noise; and

determining the first volume based at least in part on the amount of ambient noise.

18. The computer-implemented method of claim 16, further comprising:

presenting first vibration data associated with the second electronic message at a first vibration level; and

presenting second vibration data associated with the third electronic message at a second vibration level.

19. The computer-implemented method of claim 16, further comprising:

determining a geographic location of a computing device;

determining that the geographic location is associated with operating the computing device in a silent mode;

receiving a fourth notification; and

presenting vibration data associated with the fourth notification via the computing device.

20. The computer-implemented method of claim 16, further comprising:

flashing one or more light emitting diodes within a same period of time of presenting at least one of the visual data, the first aural data, or the second aural data.