Component determination and gaze provoked interaction

• US 10,558,262 B2
• Filed: 01/20/2015
• Issued: 02/11/2020
• Est. Priority Date: 11/18/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Lannsjo, Rebecka
• Primary Examiner(s): Tung, Kee M
• Assistant Examiner(s): Valdez, Patrick F
• Application Number:
  US14/600,896
• Publication Number:
  US 20150138079A1
• Time in Patent Office: 1,848 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

According to the invention, a method for changing a display based at least in part on a gaze point of a user on the display is disclosed. The method may include receiving information identifying a location of the gaze point of the user on the display. The method may also include, based at least in part on the location of the gaze point, causing a virtual camera perspective to change, thereby causing content on the display associated with the virtual camera to change.

Claims

1. A method for changing a display based at least in part on a gaze point of a user on the display, wherein the method comprises:

causing, with a processor, an image to be displayed on the display at a first zoom level, wherein the image includes a plurality of items and is centered about a first point in the image;

receiving, at the processor, a zoom out command indicated by continuous contact by the user with an input device;

upon receipt of the zoom out command, causing, with the processor, a zooming out of the image on the display while the image remains centered around the first point;

receiving, at the processor, an indication that the user has released the continuous contact with the input device;

in response to the indication that the user has released the continuous contact with the input device, automatically performing, by the processor, steps comprising;

receiving information identifying a location of the gaze point of the user on the display when the continuous contact with the input device is released;

determining that the location of the gaze point is positioned over an item displayed at a second point in the image, wherein the second point is different from the first point in the image;

determining a second zoom level at which to display the image, wherein the second zoom level is automatically and dynamically determined based on whether the item is a map, a text document, or a picture, and the second zoom level is different from the first zoom level;

causing the image to be displayed at the second zoom level and centered on the display about the item; and

wherein the speed at which the zooming is performed between the first zoom level and the second zoom level is moderated by the length of time upon which pressure is maintained on the input device.

2. The method for changing a display based at least in part on a gaze point of a user on the display of claim 1, wherein:

a speed at which the zooming out of the image on the display is changed is based at least in part on a proximity of the gaze point to a center of the display.

3. The method for changing a display based at least in part on a gaze point of a user on the display of claim 1, wherein the speed at which the zooming is performed is increased by some predetermined rate based at least in part of the magnitude of the input from the input device.

4. A non-transitory machine readable medium having instructions stored thereon for changing a display based at least in part on a gaze point of a user on the display, the instructions executable by at least one processor for at least:

causing an image to be displayed on the display at a first zoom level, wherein the image includes a plurality of items and is centered about a first point in the image;

receiving a zoom out command indicated by continuous contact by the user with an input device;

upon receipt of the zoom out command, causing a zooming out of the image on the display while the image remains centered around the first point;

receiving an indication that the user has released the continuous contact with the input device;

in response to the indication that the user has released the continuous contact with the input device, automatically performing operations comprising;

receiving information identifying a location of the gaze point of the user on the display when the continuous contact with the input device is released;

determining that the location of the gaze point is positioned over an item displayed at a second point in the image, wherein the second point is different from the first point in the image;

determining a second zoom level at which to display the image, wherein the second zoom level is automatically and dynamically determined based on whether the item is a map, a text document, or a picture, and the second zoom level is different from the first zoom level;

causing the image to be displayed at the second zoom level and centered on the display about the item; and

wherein the speed at which the zooming is performed between the first zoom level and the second zoom level is moderated by the length of time upon which pressure is maintained on the input device.

5. The non-transitory machine readable medium of claim 4, wherein:

a speed at which the zooming out of the image on the display is changed is based at least in part on a proximity of the gaze point to an edge of the display.

6. The non-transitory machine readable medium of claim 4, wherein the speed at which the zooming is performed is increased by some predetermined rate based at least in part of the magnitude of the input from the input device.

7. A system for changing a display based at least in part on a gaze point of a user, the system comprising:

a display;

an eye tracking device for determining a location of the gaze point of the user on the display;

a memory storing computer-executable program code; and

a processor, communicatively coupled to the display, the eye tracking device, and the memory, wherein the computer-executable program code, when executed by the processor, causes the processor to perform operations comprising;

causing an image to be displayed on the display at a first zoom level, wherein the image includes a plurality of items and is centered about a first point in the image;

receiving a zoom out command indicated by continuous contact by the user with an input device;

upon receipt of the zoom out command, causing a zooming out of the image on the display while the image remains centered around the first point;

receiving an indication that the user has released the continuous contact with the input device;

in response to the indication that the user has released the continuous contact with the input device;

receiving, from the eye tracking device, information identifying the location of the gaze point of the user on the display when the continuous contact with the input device is released;

determining that the location of the gaze point is positioned over an item displayed at a second point in the image, wherein the second point is different from the first point in the image;

determining a second zoom level at which to display the image, wherein the second zoom level is automatically and dynamically determined based on whether the item is a map, a text document, or a picture;

causing the image to be displayed at the second zoom level and centered on the display about the item,

wherein the speed at which the zooming is performed between the first zoom level and the second zoom level is moderated by the length of time upon which pressure is maintained on the input device.

8. The system for changing a display based at least in part on a gaze point of a user of claim 7, wherein:

a speed at which the zooming out of the image on the display is changed is based at least in part on a proximity of the gaze point to an edge of the display.

9. The system for changing a display based at least in part on a gaze point of a user of claim 7, wherein the speed at which the zooming is performed is increased by some predetermined rate based at least in part of the magnitude of the input from the input device.