Context-aware notifications

• US 9,471,141 B1
• Filed: 07/06/2015
• Issued: 10/18/2016
• Est. Priority Date: 04/22/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Noble, Isaac Scott, Bell, Matthew Paul, Strutt, Guenael Thomas
• Primary Examiner(s): Lee, Nicholas
• Application Number:
  US14/792,496
• Time in Patent Office: 470 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion

Abstract

Systems and approaches are provided for presenting incoming notifications to a computing device based on a determined context of the computing device. Various sensors of the device can be used to determine the context of the device with respect to a user, the state of the device itself, or the context of the device with respect to the environment in which the device is situated. The user can then be informed of received notifications in a manner likely to get the user'"'"'s attention while not being overly obtrusive to the user or others within the vicinity of the user.

Claims

1. A system, comprising:

one or more processors;

a display;

one or more cameras;

one or more speakers;

memory including instructions that, upon being executed by the one or more processors, cause the system to;

receive a first notification to the system;

determine, using first image data captured by the one or more cameras, that a first line of sight is directed to the display;

provide visual data associated with the first notification for presentation via the display;

receive a second notification to the system;

determine, using second image data captured by the one or more cameras, that a second line of sight is directed away from the display;

provide first aural data associated with the second notification for presentation via the speaker, the first aural data corresponding to a first volume;

receive a third notification to the system;

determine, using third image data captured by the one or more cameras, that a third line of sight is directed away from the display;

receive proximity information of one or more objects relative to the display;

determine, using the proximity information, that a proximity of the one or more objects exceeds a proximity threshold; and

provide second aural data associated with the third notification for presentation via the speaker, the second aural data corresponding to a second volume greater than the first volume.

2. The system of claim 1, wherein the instructions further cause the system to:

receive second proximity information of the one or more objects relative to the display; and

determine, using the second proximity information, that a second proximity of the one or more objects is within the proximity threshold,

wherein the first volume is selected for the first aural data based at least in part on the second proximity being within the proximity threshold.

3. The system of claim 1,

wherein the first aural data further differs from the second aural data based at least in part on at least one of a pattern or a duration of time.

4. The system of claim 1, further comprising:

a microphone,

wherein the instructions upon being executed further cause the system to;

receive audio data from the microphone; and

determine ambient noise information using the audio data,

wherein the first volume is selected based at least in part on the ambient noise information.

5. The system of claim 4, wherein the ambient noise information is used to determine that an ambient noise level is below a threshold noise level.

6. The system of claim 4, wherein the ambient noise information is used to determine that an ambient noise level exceeds a threshold noise level.

7. The system of claim 1, further comprising:

a first electronic device including the display; and

a second electronic device including at least one of the camera or the speaker.

15. The system of claim 1, further comprising:

one or more haptic elements,

wherein the instructions upon being executed further cause the system to;

provide first haptic data associated with the second notification for output via the one or more haptic elements.

16. The system of claim 15, wherein the instructions upon being executed further cause the system to:

provide second haptic data associated with the third notification for output via the one or more haptic elements,

wherein the first haptic data differs from the second haptic data based at least in part on at least one of a pattern, a duration of time, or an intensity level.

8. A system, comprising:

one or more processors;

a first electronic device including a display;

one of a second electronic device including a camera and a speaker, or the second electronic device including the camera and a third electronic device including the speaker; and

memory including instructions that, upon being executed by the one or more processors, cause the system to;

receive a first notification to the system;

determine that a line of sight of a user is directed relative to the display based at least in part on first image data captured by the camera;

provide visual data associated with the first notification for presentation via the display;

receive a second notification to the system;

determine that the line of sight is directed away from the display based at least in part on second image data captured by the camera;

provide first aural data associated with the second notification for presentation via the speaker, the first aural data corresponding to a first volume;

receive a third notification to the system;

determine that the line of sight is directed away from the display based at least in part on third image data captured by the camera;

receive proximity information of the user relative to the display;

determine that a proximity of the user exceeds a proximity threshold based at least in part on the proximity information; and

provide second aural data associated with the third notification for presentation via the speaker, the second aural data corresponding to a second volume greater than the first volume.

9. The system of claim 8, wherein the instructions upon being executed further cause the system to:

determine second proximity information of the user relative to the display; and

determine that a second proximity of the user is within the proximity threshold based at least in part on the second proximity information,

wherein the first volume is selected for the first aural data based at least in part on the second proximity being within the proximity threshold.

10. The system of claim 8, wherein the first aural data further differs from the second aural data based at least in part on at least one of a pattern or a duration of time.

17. The system of claim 8, further comprising:

a haptic element,

wherein the instructions upon being executed further cause the system to;

provide first haptic data associated with the second notification for output via the haptic element.

18. The system of claim 17, wherein the instructions upon being executed further cause the system to:

provide second haptic data associated with the third notification for output via the haptic element,

wherein the first haptic data differs from the second haptic data based at least in part on at least one of a pattern, a duration of time, or an intensity level.

11. A computer-implemented method, comprising:

receiving a first notification to a system;

determining that a line of sight of a user is directed to a display of the system based at least in part on first image data captured by one or more cameras of the system;

presenting visual data associated with the first notification via the display;

receiving a second notification to the system;

determining that the line of sight is directed away from the display based at least in part on second image data captured by the one or more cameras;

presenting first aural data associated with the second notification via a speaker of the system, the first aural data corresponding to a first volume;

receiving a third notification to the system;

determining that the line of sight is directed away from the display based at least in part on third image data captured by the one or more cameras;

receiving proximity information of the user relative to the display;

determining that a proximity of the user exceeds a proximity threshold based at least in part on the proximity information; and

presenting second aural data associated with the third notification via the speaker, the second aural data corresponding to a second volume greater than the first volume.

12. The computer-implemented method of claim 11, further comprising:

capturing audio data using a microphone of the system; and

determining an ambient noise level based at least in part on the audio data,

wherein the first volume is selected based at least in part on the ambient noise level being below a threshold noise level.

13. The computer-implemented method of claim 11, further comprising:

capturing audio data using a microphone of the system; and

determining an ambient noise level based at least in part on the audio data,

wherein the first volume is selected based at least in part on the ambient noise level exceeding the threshold noise level.

14. The computer-implemented method of claim 11, wherein the camera is incorporated within a first electronic device of the system and the speaker is incorporated within a second electronic device of the system.

19. The computer-implemented method of claim 11, further comprising:

presenting first haptic data associated with the second notification via one or more haptic elements of the system.

20. The computer-implemented method of claim 19, further comprising:

presenting second haptic data associated with the third notification for output via the one or more haptic elements,

wherein the first haptic data differs from the second haptic data based at least in part on at least one of a pattern, a duration of time, or an intensity level.