Automatic scrolling based on gaze detection

• US 9,864,498 B2
• Filed: 03/13/2013
• Issued: 01/09/2018
• Est. Priority Date: 03/13/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Olsson, Anders, Skog, Mrten
• Primary Examiner(s): Brier, Jeffery A
• Application Number:
  US13/802,240
• Publication Number:
  US 20140268054A1
• Time in Patent Office: 1,763 Days
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

Automatic scrolling of content displayed on a display device in response to gaze detection. Content may be displayed in a window rendered on a display screen. Gaze detection components may be used to detect that a user is gazing at the content and to determine a gaze point. At least one scroll zone relative to the display screen and a scroll action associated with each scroll zone may be determined. In response to determining that the gaze point is within a scroll zone, an associated scroll action may be initiated. The scroll action causes the content to scroll within the window until at least one of: expiration of a defined period, determining that a portion of the content scrolls past a defined position within the window, determining that the gaze point is outside of the scroll zone, and detecting an indicator that the user begins reading the content.

Claims

1. A computing device configured for automatic scrolling of displayed content in response to gaze detection, comprising:

a display screen;

a microprocessor for executing an application program module comprising computer-executable instructions for displaying content in a window rendered on the display screen;

gaze detection components for detecting that a user is gazing at the displayed content and for determining a gaze point relative to the display screen;

wherein the microprocessor further executes a gaze detection program module comprising computer-executable instructions for;

providing an interface for receiving user input defining a plurality of scroll points relative to the display screen;

determining a scroll zone relative to each defined scroll point;

associating a scroll action with each scroll point, wherein each scroll action is selected from a group consisting of;

scrolling the displayed content within the window for a determined period of time,

scrolling the displayed content in a first direction within the window until the gaze point is detected as being moved to a first predefined position with respect to a first scroll point,

scrolling the displayed content in a second direction within the window until the gaze point is detected as being moved to a second predefined position with respect to a second scroll point, and

scrolling the displayed content within the window until a particular portion of the displayed content passes a predefined position within the window; and

in response to determining that the gaze point is within a particular predefined position relative to a particular scroll point, initiating a particular scroll action associated with the particular scroll point.

2. The computing device of claim 1, wherein:

at least one scroll zone comprises an area near an edge of the display screen, the at least one scroll zone being determined relative to at least one scroll point; and

a scroll action associated with the at least one scroll point comprises scrolling the displayed content within the window in the direction of the edge.

3. The computing device of claim 1, wherein:

at least one scroll zone comprises an area away from the display screen.

4. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

in response to determining that the gaze point is within a second particular scroll zone determined relative to a second particular scroll point, initiating a second particular scroll action associated with the second particular scroll point.

5. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

in response to termination of the particular scroll action, refraining from initiating a subsequent scroll action until after expiration of a predefined time period.

6. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

terminating the particular scroll action when the gaze point is moved to a particular position with respect to the particular scroll point;

in response to terminating the particular scroll action, temporarily decreasing a size of a particular scroll zone associated with the particular scroll point.

7. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

detecting gaze data patterns and applying statistical analysis to the gaze data patterns to determine whether the gaze point is within a predefined area relative to the particular scroll point.

8. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

disabling a scroll mode, wherein none of the scroll actions will be initiated if the scroll mode is disabled.

9. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

adjusting the sensitivity of the particular scroll action by dynamically adjusting a size of a particular scroll zone associated with the particular scroll point.

10. The computing device of claim 1, wherein:

the gaze detection components include a camera for detecting images of at least one facial feature of the user selected from a group consisting of;

a nose, a mouth, a distance between two eyes, a head pose, and a chin; and

the gaze detection components use the at least one facial feature to determine the gaze point.

11. The computing device of claim 1, wherein the gaze detection program module further comprises computer-executable instructions for:

determining that the gaze point remains within a particular scroll zone for a threshold period of time before initiating the particular scroll action, the particular scroll zone being determined relative to the particular scroll point.

12. The computing device of claim 1, wherein the user input defining the plurality of scroll points relative to the display screen enables user adjustment of the sensitivity of at least one scroll action associated with at least one scroll point.

13. A computer-implemented method for automatic scrolling of displayed content in response to gaze detection, comprising:

displaying content in a window rendered on a display screen;

detecting, by gaze detection components, that a user is gazing at the displayed content and determining, by the gaze detection components, a gaze point relative to the display screen;

providing an interface for receiving user input defining a plurality of scroll points relative to the display screen;

determining a scroll zone relative to each defined scroll point;

associating a scroll action with each scroll point, wherein each scroll action is selected from a group consisting of;

scrolling the displayed content within the window for a determined period of time,

scrolling the displayed content in a first direction within the window until the gaze point is detected as being moved to a first predefined position with respect to a first scroll point,

scrolling the displayed content in a second direction within the window until the gaze point is detected as being moved to a second predefined position with respect to a second scroll point, and

scrolling the displayed content within the window until a particular portion of the displayed content passes a predefined position within the window; and

in response to determining that the gaze point is within a particular predefined position relative to a particular scroll point, initiating a particular scroll action associated with the particular scroll point.

14. The computer-implemented method of claim 13, further comprising:

in response to determining that the gaze point is within a second particular scroll zone determined relative to a second particular scroll point, initiating a second particular scroll action associated with the second particular scroll point.

15. The computer-implemented method of claim 13, wherein:

at least one scroll zone comprises an area away from the display screen.

16. The computer-implemented method of claim 13, further comprising:

in response to termination of the particular scroll action, refraining from initiating a subsequent scroll action until after expiration of a predefined time period.

17. The computer-implemented method of claim 13, further comprising:

terminating the particular scroll action when the gaze point is moved to a particular position with respect to the particular scroll point;

in response to terminating the particular scroll action, temporarily decreasing a size of a particular scroll zone associated with the particular scroll point.

18. The computer-implemented method of claim 13, further comprising:

detecting gaze data patterns and applying statistical analysis to the gaze data patterns to determine whether the gaze point is within a predefined area relative to the particular scroll point.

19. The computer-implemented method of claim 13, further comprising:

adjusting the sensitivity of the particular scroll action by dynamically adjusting a size of a particular scroll zone associated with the particular scroll point.

20. The computer-implemented method of claim 13, further comprising:

detecting images of at least one facial feature of the user selected from a group consisting of;

a nose, a mouth, a distance between two eyes, a head pose, and a chin; and

wherein the at least one facial feature is used to determine the gaze point.

21. The computer-implemented method of claim 13, further comprising:

determining that the gaze point remains within a particular scroll zone for a threshold period of time before initiating the particular scroll action, the particular scroll zone being determined relative to the particular scroll point.

22. A non-transitory machine readable medium having instructions stored thereon for automatic scrolling of displayed content in response to gaze detection, the instructions executable by at least one processor to at least:

display content in a window rendered on a display screen;

detect, with gaze detection components, that a user is gazing at the displayed content and determine, with the gaze detection components, a gaze point relative to the display screen;

provide an interface for receiving user input defining a plurality of scroll points relative to the display screen;

determine a scroll zone relative to each defined scroll point;

associate a scroll action with each scroll zone, wherein each scroll action is selected from a group consisting of;

scrolling the displayed content within the window for a determined period of time,

scrolling the displayed content in a first direction within the window until the gaze point is detected as being moved to a first predefined position with respect to a first scroll point,

scrolling the displayed content in a second direction within the window until the gaze point is detected as being moved to a second predefined position with respect to a second scroll point, and

scrolling the displayed content within the window until a particular portion of the displayed content passes a predefined position within the window; and

in response to determining that the gaze point is within a particular predefined position relative to a particular scroll point, initiating a particular scroll action associated with the particular scroll point.