Adjusting information depth based on user's attention

• US 9,639,231 B2
• Filed: 03/17/2014
• Issued: 05/02/2017
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Google Inc. (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Petersen, Morten Just, Connolly, Emmet, Duarte, Matias Gonzalo, Faaborg, Alexander
• Primary Examiner(s): BHARGAVA, ANIL K
• Application Number:
  US14/216,371
• Publication Number:
  US 20150261387A1
• Time in Patent Office: 1,142 Days
• Field of Search: 715765
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/576 associated with a pictorial or graphical representation
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2203/2066 Call type detection of indication, e.g. voice or fax, mobile of fixed, PSTN or IP
• CPC Class Codes: H04M 2203/2072 Schedules, e.g. personal calendars
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 3/53358 Message preview

Abstract

A computing device is described that includes one or more processors and at least one module operable by the processors to output, for display, first information for an event, and, responsive to determining that a user of the computing device has viewed a display device of the computing device for at least a threshold amount of time, output, for display, second information for the event, the second information including information associated with the event and not included in the first information. The module is further operable to, responsive to determining that the user of the computing device has viewed the display device for at least another threshold amount of time greater than the first threshold amount of time, output, for display, third information for the event, the third information including additional information associated with the event and not included in the first information or the second information.

Claims

1. A method comprising:

outputting, by a computerized watch and for display, first information for an event;

receiving, by the computerized watch, first motion data generated based on first user movements detected by an accelerometer of the computerized watch;

determining, by the computerized watch and based on the first motion data, a first duration of time that the user is viewing a display device of the computerized watch;

responsive to determining that a user of the computerized watch has viewed the display device of the computerized watch for at least a first threshold amount of time, automatically outputting, by the computerized watch and for display, second information for the event, the second information including information associated with the event and not included in the first information; and

after outputting the second information;

receiving, by the computerized watch, second motion data generated based on second user movements detected by the accelerometer of the computerized watch;

determining, by the computerized watch and based on the second motion data, that the user continues to view the display device of the computerized watch; and

responsive to determining that the user of the computerized watch has viewed the display device for at least a second threshold amount of time that is greater than the first threshold amount of time, automatically outputting, by the computerized watch and for display, third information for the event, the third information including additional information associated with the event and not included in either the first information or the second information.

2. The method of claim 1, wherein:

the event is an incoming communication,

the first information includes at least one of an image of a sender of the incoming communication or a graphical representation of a subject of the incoming communication,

the second information includes at least one of an indication of a name of the sender or an indication of a type of the incoming communication, and

the third information includes at least a portion of text of the incoming communication.

3. The method of claim 2, wherein the at least the portion of the text of the incoming communication is generated using speech-to-text processing of an audio message.

4. The method of claim 1, further comprising:

outputting, by the computerized watch and for display, information associated with a first event;

receiving, by the computerized watch, an indication of a first user input detected by a presence-sensitive input device;

outputting, by the computerized watch and for display, information associated with a second event;

receiving, by the computerized watch, an indication of a second user input detected by the presence-sensitive input device;

outputting, by the computerized watch and for display, information associated with a third event, therein the third event is the event associated with the notification; and

responsive to determining that at least a third threshold amount of time has elapsed since receiving the indication of the second user input, outputting the second graphical indication of the notification including the second information for the event.

5. The method of claim 1, wherein determining that the user is viewing the display device of the computerized watch further comprises:

capturing, with a camera of the computerized watch, at least one image including a face of the user; and

determining, based on a position of at least one eye of the user in the at least one image and the first motion data, that the user is viewing the display device of the computerized watch.

6. The method of claim 1, wherein the first threshold amount of time and the second threshold amount of time change based on a determined activity of the user.

7. The method of claim 1, wherein the event is one or more of a calendar event, an incoming communication, a system notification, a current activity of the user.

8. The method of claim 1, further comprising:

determining, by the computerized watch, important information for the event; and

generating, based on the important information, the first information for the event.

9. The method of claim 8, wherein determining the important information for the event comprises:

determining an attention level of the user;

determining a level of detail of at least a portion of event information for the event; and

responsive to determining that the level of detail of the portion of the event information satisfies the attention level of the user, determining that the portion of the event information is the important information.

10. The method of claim 8, wherein determining the important information for the event comprises:

determining a location of the computerized watch; and

determining a respective relevancy for one or more portions of event information for the event,

wherein the important information is a particular portion of the one or more portions of the event information has a highest relative relevancy.

11. The method of claim 8, wherein determining the important information for the event comprises:

determining, based on one or more of a location of the user, a current time, a time of the event, a location of the event, and a respective urgency for one or more portions of the event information for the event,

wherein the important information is a particular portion of the one or more portions of the event information has a highest relative urgency.

12. The method of claim 1, further comprising:

prior to outputting the first information for the event;

receiving, by the computerized watch, third motion data generated based on third user movements detected by the accelerometer of the computerized watch, the third user movements including a rotation of the computerized watch; and

determining, by the computerized watch and based on the third motion data, that the user is viewing the display device of the computerized watch,

wherein outputting the first information for the event is in response to determining that the user is viewing the display device.

13. A computerized watch comprising:

one or more processors;

an accelerometer configured to detect first user movements and generate, based on the first user movements, first motion data;

a display device; and

at least one module operable by the one or more processors to;

output, for display by the display device, first information for an event;

determine, based on the first motion data, a first duration of time that the user is viewing the display device; and

responsive to determining that a user of the computerized watch has viewed the display device for at least a first threshold amount of time, automatically output, for display by the display device, second information for the event, the second information including information associated with the event and not included in the first information,

wherein the accelerometer is further configured to detect second user movements subsequent to detecting the first user movements and generate second motion data based on the second user movements, and

wherein the at least one module is further operable by the one or more processors to;

after outputting the second information;

receive, from the accelerometer, the second motion data;

determine, based on the second motion data, that the user continues to view the display device of the computerized watch; and

responsive to determining that the user of the computerized watch has viewed the display device for at least a second threshold amount of time that is greater than the first threshold amount of time, automatically output, for display by the display device, third information for the event, the third information including additional information associated with the event and not included in either the first information or the second information.

14. The computerized watch of claim 13, wherein the at least one module is further operable by the one or more processors to:

output, for display by the display device, information associated with a first event;

receive an indication of a first user input detected by a presence-sensitive input device;

output, for display by the display device, information associated with a second event;

receive an indication of a second user input detected by the presence-sensitive input device;

output, for display by the display device, information associated with a third event, therein the third event is the event associated with the notification; and

responsive to determining that at least a third threshold amount of time has elapsed since receiving the indication of the second user input, output the second graphical indication of the notification including the second information for the event.

15. The computerized watch of claim 13, further comprising:

a camera that capture at least one image including a face of the user,

wherein the at least one module is further operable by the one or more processors to determine, based on a position of at least one eye of the user in the at least one image and the first motion data, that the user is viewing the display device of the computerized watch.

16. The computerized watch of claim 13, wherein the first threshold amount of time and the second threshold amount of time change based on a determined activity of the user.

17. The computerized watch of claim 13, wherein the at least one module is further operable by the one or more processors to:

determine important information for the event; and

generate, based on the important information, the first information for the event.

18. The computerized watch of claim 13, wherein:

the accelerometer is further configured to detect third user movements, and generate, based on the third user movements, third motion data, the third user movements including a rotation of the computerized watch; and

the at least one module is further operable by the one or more processors to determine, based on the third motion data, that the user is viewing the display device of the computerized watch, and output the first information for the event in response to determining that the user is viewing the display device.

19. A non-transitory computer-readable storage medium comprising instructions that, when executed, configure one or more processors of a computerized watch to:

output, for display, first information for an event;

receive first motion data generated based on first user movements detected by an accelerometer of the computerized watch;

determining, based on the first motion data, a first duration of time that the user is viewing a display device of the computerized watch;

responsive to determining that a user of the computerized watch has viewed the display device of the computerized watch for at least a first threshold amount of time, automatically output, for display, second information for the event, the second information including information associated with the event and not included in the first information; and

after outputting the second information;

receive second motion data generated based on second user movements detected by the accelerometer of the computerized watch;

determine, based on the second motion data, that the user continues to view the display device of the computerized watch; and

responsive to determining that the user of the computerized watch has viewed the display device for at least a second threshold amount of time that is greater than the first threshold amount of time, automatically output, for display, third information for the event, the third information including additional information associated with the event and not included in either the first information or the second information.