Gaze-based content display

• US 8,643,680 B2
• Filed: 04/08/2011
• Issued: 02/04/2014
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Baldwin, Leo B., Selker, Edwin Joseph
• Primary Examiner(s): AMIN, JWALANT B
• Application Number:
  US13/083,303
• Publication Number:
  US 20120256967A1
• Time in Patent Office: 1,033 Days
• Field of Search: None
• US Class Current: 345/684
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2380/14 Electronic books and readers
• CPC Class Codes: G09G 5/34 for rolling or scrolling

Abstract

A user interface can enable a user to control the display of content in a way that is natural for the user and requires little physical interaction. The gaze direction and/or viewing location of a user can be determined using any of a variety of imaging or other such technologies. By determining the location at which the user is gazing, an electronic device can control aspects such as the scroll rate or page turns of displayed content. In many cases, a device utilizes the natural reading or viewing style of a user to determine appropriate aspects for that user, and can update automatically as conditions change based at least in part upon the change in gaze location and/or viewing patterns.

Claims

1. A method of displaying content on an electronic device, comprising:

capturing image information using at least one image capture element of the electronic device;

analyzing, using a processor of the electronic device, the image information to determine a viewing location of a user with respect to the electronic device;

based at least in part upon the determined viewing location, controlling a rate at which displayed content is scrolled on the electronic device when the determined viewing location is at least partially on a display element of the electronic device, the rate at which the displayed content is scrolled being adjusted as the viewing location of the user moves away from a central portion of the display element;

determining for the user, using the processor of the electronic device, a target viewing location away from the central portion of the display element; and

adjusting the rate at which the displayed content is scrolled to substantially direct the viewing location of the user to the target viewing location for at least a period of time,

wherein the rate at which displayed content is scrolled on the electronic device is controllable by the user through changes in the viewing location of the user away from at least one of the central portion or the target viewing location and without a requirement for physical interaction between the user and the electronic device.

2. The method of claim 1, further comprising:

selecting a range of target viewing locations for the user with respect to the electronic device; and

adjusting the scrolling rate when the viewing location for the user falls outside the range of target viewing locations.

3. The method of claim 2, wherein the range of target viewing locations changes over time.

4. The method of claim 2, wherein the scrolling rate is increased when the viewing location is on a first side of the range of target viewing locations and decreased when the viewing location is on a second side of the range of target viewing locations.

5. A computer-implemented method of displaying content on an electronic device, comprising:

under control of one or more computing systems configured with executable instructions,

displaying content on a display element of an electronic device;

determining, using a processor of the electronic device, a gaze direction of a user with respect to the electronic device;

controlling a rate at which displayed content is scrolled on the display element based at least in part upon the determined gaze direction moving substantially away from a central portion of the display element;

determining for the user, using the processor of the electronic device, a target viewing location that is directed substantially away from the central portion of the display element; and

adjusting the rate at which the displayed content is scrolled to substantially direct the gaze direction of the user to the target viewing location for at least a period of time,

wherein the user is able to adjust the display of content on the display element through changes in gaze direction away from at least one of the central portion of the display element or the target viewing location.

6. The computer-implemented method of claim 5, wherein determining the gaze direction of the user comprises:

capturing one or more images using at least one image capture element of the electronic device;

analyzing the captured one or more images to determine the gaze direction of the user.

7. The computer-implemented method of claim 6, wherein analyzing the captured one or more images to determine the gaze direction of the user includes analyzing the one or more images to determine a relative position of the user with respect to the electronic device and determining a relative location of at least one portion of the eyes of the user.

8. The computer-implemented method of claim 6, wherein the image capture element includes at least one of a camera or infrared detector.

9. The computer-implemented method of claim 6, further comprising:

analyzing the captured one or more images to authenticate an identity of a user, the electronic device configured to alter the display of the content based upon the identity of the user.

10. The computer-implemented method of claim 6, further comprising:

maintaining a model for the user useful in displaying content upon the user being authenticated.

11. The computer-implemented method of claim 5, wherein displaying at least a second view of content includes at least one of scrolling the content and displaying a different portion of the content.

12. The computer-implemented method of claim 11, wherein a rate of the scrolling is determined at least in part based upon the gaze direction of the user with respect to the electronic device.

13. The computer-implemented method of claim 12, wherein the rate is determined based upon at least one of a plurality of zones and a rate function.

14. The computer-implemented method of claim 5, wherein the scrolled content corresponds to a display of an image or media file upon the gaze direction of the user falling upon an element associated with that image or media file.

15. The computer-implemented method of claim 5, wherein a default scroll speed for the user is adjusted based at least in part upon adjustments made during viewing of the content by the user.

16. The computer-implemented method of claim 5, wherein the user is able to assign specific actions to regions of the display element, the user able to activate one of those specific actions by gazing at an associated region.

17. The computer-implemented method of claim 5, wherein a default scrolling speed for the content is based at least in part upon a type of the content.

18. The computer-implemented method of claim 5, wherein the scrolled content includes a different page of content, and wherein the scrolled content is displayed further based upon a user moving the gaze direction toward a region associated with a beginning of a new page of content.

19. A computing device, comprising:

a processor;

a display element;

at least one image capture element; and

a memory device including instructions operable to be executed by the processor to perform a set of actions, enabling the processor to;

display content on a display element of an electronic device;

determine, using a processor of the electronic device, a gaze direction of a user associated with a default viewing location with respect to the electronic device;

controlling a rate at which displayed content is scrolled on the display element based at least in part upon the determined gaze direction moving substantially away from a central portion of the display element;

determine for the user, using the processor of the electronic device, a target viewing location that is directed substantially away from the central portion of the display element; and

adjust the rate at which the displayed content is scrolled to substantially direct the gaze direction of the user to the target viewing location for at least a period of time,

wherein the user is able to adjust the display of content on the display element through changes in gaze direction away from at least one of the central portion of the display element or the target viewing location.

20. The computing device of claim 19, wherein determining the gaze direction of the user comprises:

capturing one or more images using at least one image capture element of the electronic device;

analyzing the captured one or more images to determine a relative position of the user and information about the eyes of the user.

21. The computing device of claim 19, wherein the at least one image capture element includes at least one of a camera or infrared detector.

22. The computing device of claim 19, wherein the instructions when executed further cause the computing device to:

analyze the captured one or more images to authenticate an identity of a user, the electronic device configured to alter the display of the content based upon the identity of the user.

23. A non-transitory computer-readable storage medium storing processor-executable instructions for controlling a computing device, comprising:

program code for displaying content on a display element of an electronic device;

program code for determining, using a processor of the electronic device, a gaze direction of a user with respect to the electronic device;

program code for controlling a rate at which displayed content is scrolled on the display element based at least in part upon the determined gaze direction moving substantially away from a central portion of the display element;

program code for determining for the user, using the processor of the electronic device, a target viewing location that is directed substantially away from the central portion of the display element; and

program code for adjusting the rate at which the displayed content is scrolled to substantially direct the gaze direction of the user to the target viewing location for at least a period of time,

wherein the user is able to adjust the display of content on the display element through changes in gaze direction away from at least one of the central portion of the display element or the target viewing location.

24. The non-transitory computer-readable storage medium of claim 23, wherein determining the gaze direction of the user comprises:

capturing one or more images using at least one image capture element of the electronic device;

analyzing the captured one or more images to determine a relative position of the user and information about eye position of the user.

25. The non-transitory computer-readable storage medium of claim 23, further comprising:

program code for analyzing the captured one or more images to authenticate an identity of a user, the electronic device configured to alter the display of the content based upon the identity of the user.