Automatic scrolling based on gaze detection

• US 10,534,526 B2
• Filed: 12/21/2017
• Issued: 01/14/2020
• Est. Priority Date: 03/13/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Olsson, Anders, Skogo, Marten
• Primary Examiner(s): Brier, Jeffery A
• Application Number:
  US15/851,292
• Publication Number:
  US 20180181272A1
• Time in Patent Office: 754 Days
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

Disclosed are various embodiments for automatic scrolling of content displayed on a display device in response to gaze detection. Content may be displayed in a window rendered on a display screen. Gaze detection components may be used to detect that a user is gazing at the displayed content and to determine a gaze point relative to the display screen. At least one applicable scroll zone relative to the display screen and a scroll action associated with each applicable scroll zone may be determined. In response to determining that the gaze point is within a first applicable scroll zone, an associated first scroll action may be initiated. The first scroll action causes the content to scroll within the window until at least one of: expiration of a defined period, determining that a portion of the content scrolls past a defined position within the window, determining that the gaze point is outside of the first scroll zone, and detecting an indicator that the user begins reading the content.

Claims

1. A computing device, comprising:

a display screen;

a camera configured to capture image data corresponding to a user;

a memory configured to store computer-executable instructions; and

a processor configured to access the memory and execute the computer executable instructions to at least;

provide content for presentation within a window of the display screen, the window being divided into a plurality of scroll zones;

detect a gaze point of the user being within a first scroll zone of the plurality of scroll zones based at least in part on a portion of the image data;

initiate a scrolling action based at least in part on the gaze point being within the first scroll zone; and

upon termination of the scrolling action, decrease a size of the first scroll zone to define a contracted scroll zone.

2. The computing device of claim 1, wherein the processor is further configured to access the memory and execute the computer-executable instructions to at least:

detect a subsequent gaze point of the user being within the contracted scroll zone based at least in part on a subsequent portion of the image data; and

initiate a second scrolling action based at least in part on the subsequent gaze point being within the contracted scroll zone.

3. The computing device of claim 2, wherein detecting the subsequent gaze point being within the contracted scroll zone is based at least in part on the user'"'"'s gaze being directed to an area bounded by a perimeter of the contracted scroll zone.

4. The computing device of claim 1, wherein decreasing the size of the first scroll zone comprises decreasing an area of the first scroll zone to define the contracted scroll zone.

5. The computing device of claim 1, wherein decreasing the size of the first scroll zone comprises decreasing the size of the first scroll zone for a predefined time period, after which a contracted size of the contracted scroll zone returns to the size of the first scroll zone.

6. The computing device of claim 1, wherein the computing device comprises a handheld portable device.

7. The computing device of claim 1, wherein:

the computing device further comprises a bezel extending around a portion of a first perimeter edge of the computing device; and

the camera is integrated into the bezel at a position between a second perimeter edge of the display screen and the first perimeter edge of the computing device.

8. The computing device of claim 1, wherein the camera is positioned to view a face of the user when the face of the user is directed toward the display screen.

9. The computing device of claim 1, wherein the scrolling action scrolls the content within the window.

10. A computer-implemented method, comprising:

providing content for presentation within a window of a display screen, the window being divided into a plurality of scroll zones;

detecting that a user gaze point is within a first scroll zone based at least in part on image data captured at least while a user views the content;

initiate a scrolling action based at least in part on detecting that the user gaze point is within the first scroll zone; and

upon conclusion of the scrolling action, decreasing a size of the first scroll zone to define a smaller scroll zone.

11. The computer-implemented method of claim 10, further comprising concluding the scrolling action based at least in part on detecting that the user gaze point has moved to a position outside of the first scroll zone.

12. The computer-implemented method of claim 10, wherein:

the method further comprises receiving, via a user interface, a user input corresponding to the conclusion of the scrolling action; and

decreasing the size of the first scroll zone is based at least in part on the user input.

13. The computer-implemented method of claim 10, further comprising:

detecting that a subsequent user gaze point is within the contracted scroll zone based at least in part on subsequent image data; and

initiating a second scrolling action based at least in part on detecting that the subsequent gaze point is within the contracted scroll zone.

14. The computer-implemented method of claim 13, wherein detecting that the subsequent gaze point is within the contracted scroll zone is based at least in part on the user'"'"'s gaze being directed to an area bounded by a perimeter of the contracted scroll zone.

15. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by one or more computer systems, cause the one or more computer systems to perform operations comprising:

providing content for presentation within a window of a display screen, the window being divided into a plurality of display zones;

detecting that a user gaze point is within a first scroll zone based at least in part on image data captured at least while a user views the content;

initiate a scrolling action based at least in part on detecting that the user gaze point is within the first scroll zone, the scrolling action scrolling the content within the window; and

upon conclusion of the scrolling action, decreasing a size of the first scroll zone to define a smaller scroll zone.

16. The one or more non-transitory computer-readable media of claim 15, wherein initiating a subsequent scrolling action of the content depends in part on a subsequent gaze point being detected in the smaller scroll zone.

17. The one or more non-transitory computer-readable media of claim 15, wherein the one or more non-transitory computer-readable media are included in a handheld portable device.

18. The one or more non-transitory computer-readable media of claim 15, wherein decreasing the size of the first scroll zone comprises decreasing an area of the first scroll zone to define the smaller scroll zone.