GAZE-BASED CONTENT DISPLAY

• US 20120256967A1
• Filed: 04/08/2011
• Published: 10/11/2012
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Baldwin, Leo B., Selker, Edwin Joseph
• Granted Patent: US 8,643,680 B2
• Time in Patent Office: Days
• US Class Current: 345/684
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2380/14 Electronic books and readers
• CPC Class Codes: G09G 5/34 for rolling or scrolling

Abstract

A user interface can enable a user to control the display of content in a way that is natural for the user and requires little physical interaction. The gaze direction and/or viewing location of a user can be determined using any of a variety of imaging or other such technologies. By determining the location at which the user is gazing, an electronic device can control aspects such as the scroll rate or page turns of displayed content. In many cases, a device utilizes the natural reading or viewing style of a user to determine appropriate aspects for that user, and can update automatically as conditions change based at least in part upon the change in gaze location and/or viewing patterns.

Claims

1. A method of displaying content on an electronic device, comprising:

capturing image information using at least one image capture element of the electronic device;

analyzing, using a processor of the electronic device, the image information to determine a viewing location of a user with respect to the electronic device; and

based at least in part upon the determined viewing location, controlling a rate at which displayed content is scrolled on the electronic device when the determined viewing location is at least partially on a display element of the electronic device,

wherein the rate at which displayed content is scrolled on the electronic device is controllable by the user through changes in the viewing location of the user and without a requirement for physical interaction between the user and the electronic device.

2. The method of claim 1, further comprising:

selecting a range of target viewing locations for the user with respect to the electronic device; and

adjusting the scrolling rate when the viewing location for the user fills outside the range of target viewing locations.

3. The method of claim 2, wherein in the range of target viewing locations changes over time.

4. The method of claim 2, wherein the scrolling rate is increased when the viewing location is on a first side of the range of target viewing locations and decreased when the viewing location is on a second side of the range of target viewing locations.

5. A computer-implemented method of displaying content on an electronic device, comprising:

under control of one or more computing systems configured with executable instructions,

displaying a first view of content on a display element of an electronic device;

determining a gaze direction of a user with respect to the electronic device; and

displaying at least a second view of content on the display element based at least in part upon the determined gaze direction,

wherein the user is able to adjust the display of content on the display element through changes in gaze direction of the user with respect to the electronic device.

6. The computer-implemented method of claim 5, wherein determining the gaze direction of the user comprises:

capturing one or more images using at least one image capture element of the electronic device;

analyzing the captured one or more images to determine the gaze direction of the user.

7. The computer-implemented method of claim 6, wherein analyzing the captured one or more images to determine the gaze direction of the user includes analyzing the one or more images to determine a relative position of the user with respect to the electronic device and determining a relative location of at least one portion of the eyes of the user.

8. The computer-implemented method of claim 6, wherein the image capture element includes at least one of a camera or infrared detector.

9. The computer-implemented method of claim 6, further comprising:

analyzing the captured one or more images to authenticate an identity of a user, the electronic device configured to alter the display of information based upon the identity of the user.

10. The computer-implemented method of claim 6, further comprising:

maintaining a model for the user useful in displaying content upon the user being authenticated.

11. The computer-implemented method of claim 5, wherein displaying at least a second view of content includes at least one of scrolling the content and displaying a different portion of the content.

12. The computer-implemented method of claim 11, wherein a rate of the scrolling is determined at least in part based upon the gaze direction of the user with respect to the electronic device.

13. The computer-implemented method of claim 12, wherein the rate is determined based upon at least one of a plurality of zones and a rate function.

14. The computer-implemented method of claim 5, wherein the second view of content corresponds to a display of an image or media file upon the gaze direction of the user falling upon an element associated with that image or media file.

15. The computer-implemented method of claim 5, wherein a default scroll speed for the user is adjusted based at least in part upon adjustments made during viewing of the content by the user.

16. The computer-implemented method of claim 5, wherein the user is able to assign specific actions to regions of the display element, the user able to activate one of those specific actions by gazing at the associated region.

17. The computer-implemented method of claim 5, wherein a default scrolling speed for the content is based at least in part upon a type of the content.

18. The computer-implemented method of claim 5, wherein the second view includes a different page of content, and wherein the second view is displayed further based upon a user moving the gaze direction toward a region associated with the beginning of a new page of content.

19. A computing device, comprising:

a processor;

a display element;

at least one image capture element; and

a memory device including instructions operable to be executed by the processor to perform a set of actions, enabling the processor to;

display a first view of content on a display element of an electronic device;

determine a gaze direction of a user with respect to the electronic device; and

display at least a second view of content on the display element based at least in part upon the determined gaze direction,

wherein the user is able to adjust the display of content on the display element through changes in gaze direction of the user with respect to the electronic device.

20. The computing device of claim 19, wherein determining the gaze direction of the user comprises:

capturing one or more images using at least one image capture element of the electronic device;

analyzing the captured one or more images to determine a relative position of the user and information about the eyes of the user.

21. The computing device of claim 19, wherein the at least one image capture element includes at least one of a camera or infrared detector.

22. The computing device of claim 19, wherein the instructions when executed further cause the computing device to:

analyze the captured one or more images to authenticate an identity of a user, the electronic device configured to alter the display of information based upon the identity of the user.

23. A non-transitory computer-readable storage medium storing processor executable instructions for controlling a computing device, comprising:

program code for displaying a first view of content on a display element of an electronic device;

program code for determining a gaze direction of a user with respect to the electronic device; and

program code for displaying at least a second view of content on the display element based at least in part upon the determined gaze direction;

wherein the user is able to adjust the display of content on the display element through changes in gaze direction of the user with respect to the electronic device.

24. The non-transitory computer-readable storage medium of claim 23, wherein determining the gaze direction of the user comprises:

capturing one or more images using at least one image capture element of the electronic device;

analyzing the captured one or more images to determine a relative position of the user and information about the eye position of the user.

25. The non-transitory computer-readable storage medium of claim 23, further comprising:

program code for analyzing the captured one or more images to authenticate an identity of a user, the electronic device configured to alter the display of information based upon the identity of the user.