Gaze-based automatic scrolling

• US 10,082,863 B2
• Filed: 05/12/2013
• Issued: 09/25/2018
• Est. Priority Date: 05/11/2012
• Status: Active Grant

• Current Assignee: Umoove Services Ltd
• Original Assignee: Umoove Services Ltd
• Inventors: Kempinski, Yitzchak
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): SHREWSBURY, NATHAN K
• Application Number:
  US14/400,350
• Publication Number:
  US 20150128075A1
• Time in Patent Office: 1,962 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/34 for rolling or scrolling
• CPC Class Codes: G09G 5/38 with means for controlling the display position

Abstract

Embodiments of the invention may include a method of scrolling content on an electronic display upon detection that a gaze of a user is pointed to a pre-defined area of the display, such as for example an edge of the display. A scroll may be triggered by the gaze point of the user being directed to the pre-defined area of the screen or on a plane of the screen. A scroll may move the displayed content by a fixed amount or by a distance that is sufficient to bring the gaze point of the user our of the pre-defined area that triggered the scroll. A scroll may continue for example so long as a smooth pursuit of the viewers eyes is maintained. Embodiments may include tracking a position of a viewer of an electronic display, and altering an orientation of a one or more elements of the display to correspond to the changed orientation of the user. A layout of content that is display may be altered to accommodate the change in orientation. In some embodiments, an orientation of the displayed content may changed in real time to match the change in orientation of the user. In some embodiments, a resting or permanent orientation may be adopted once the position of the user becomes fixed.

Claims

1. A method for scrolling content that is displayed on an electronic display screen, the method comprising:

tracking a direction of a gaze of a viewer of the displayed content; and

scrolling the displayed content on the display screen, upon detection of the tracked gaze direction on a predefined region of the display screen,

wherein continuous scrolling is maintained while the tracked gaze direction is at the same region of the display screen during scrolling, and wherein the scrolling corresponds to the tracked gaze direction so as to allow smooth pursuit of the eyes of the viewer, and wherein tracking the direction of the gaze comprises calculating a displacement vector from an initial position to the gaze point, and wherein scrolling the displayed content comprises scrolling the content in a direction that is determined by a direction of the displacement vector.

2. The method of claim 1, wherein tracking the direction of the gaze comprises acquiring a plurality of successive images of the viewer by an imaging device that is positioned at known location relative to the display screen.

3. The method of claim 1, comprising altering a speed of the scrolling to reflect a smooth pursuit of an eye of the viewer.

4. The method of claim 1, wherein tracking the direction of the gaze comprises:

tracking a position of an iris of the user relative to a position of an object in three-dimensional space; and

calculating a gaze point of the iris based on the tracked position of the iris.

5. The method of claim 1, wherein the predefined region adjoins an edge of the display screen.

6. The method of claim 1, wherein the predefined region adjoins a boundary of a display window.

7. The method of claim 1, further comprising continuing the scroll so long as the gaze direction is in the pre-defined region.

8. The method of claim 1, further comprising continuing the scroll when an iris of the viewer is in a smooth pursuit of the displayed content.

9. The method of claim 1, wherein the scroll is initiated upon detection of the tracked gaze direction on a predefined region external to an edge of the display screen.

10. The method of claim 1, wherein scrolling the displayed content comprises causing a portion of the displayed content that is displayed at the gaze point to move to a location that is nearer to a center of the displayed content.

11. The method of claim 1, wherein scrolling the displayed content comprises causing a portion of the displayed content that is displayed at the gaze point to move to a location that is nearer to a center of a predetermined comfort range.

12. The method of claim 1, wherein scrolling the displayed content comprises scrolling the displayed content in a scroll direction that is directed away from the gaze point and toward a center of the displayed content.

13. The method of claim 1, wherein scrolling the displayed content comprises scrolling the content at a scrolling rate that is determined by a magnitude of the displacement vector.

14. The method of claim 1, wherein scrolling the displayed content comprises scrolling the content through a distance that is determined by a magnitude of the displacement vector.

15. The method of claim 1, wherein scrolling the displayed content comprises scrolling the content through a distance that is sufficient to display in its entirety a screen object at the gaze point.

16. The method of claim 1, wherein scrolling the displayed content comprises scrolling the content only after the gaze point remains in the predefined region for a predetermined period of time.

17. An electronic device, comprising:

a display screen, configurable to display scrollable content;

an imager, located at a known position relative to the display screen and configurable to acquire a series of images of a viewer of the display screen; and

a processor, configured to;

track a point of a gaze of the viewer from the series of acquired images;

determine when the tracked gaze point is at a predefined area; and

scroll the displayed content on the display screen, upon detection of the tracked gaze point on the predefined area,

wherein the processor is configured to continuously scroll the displayed content while the tracked gaze point is at the same area during scrolling, and wherein the processor is configured to scroll in accordance with the tracked gaze point so as to allow smooth pursuit of the eyes of the viewer, and wherein the processor is configured to calculate a displacement vector from an initial position to the gaze point, and wherein the processor is configured to scroll the content in a direction that is determined by a direction of the displacement vector.

18. The device of claim 17, wherein the processor is configured to track the gaze point by estimating an expected size and expected location of an image of an iris within that acquired image, and determining a location of the iris image within the acquired image by identifying a region within the expected location, the size of the region being consistent with the expected size, wherein pixels of the region have luminance values that are darker than pixels of other regions within the expected location.