Fast wake-up in a gaze tracking system

• US 10,198,070 B2
• Filed: 09/18/2017
• Issued: 02/05/2019
• Est. Priority Date: 08/09/2012
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Skogo, Marten, Olsson, Anders, Elvesjo, John Mikael, Yu, Aron
• Primary Examiner(s): Shankar, Vijay
• Assistant Examiner(s): Almeida, Cory A
• Application Number:
  US15/707,030
• Publication Number:
  US 20180129281A1
• Time in Patent Office: 505 Days
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

A gaze tracking system, leaving a low power mode in response to an activation signal, captures an initial burst of eye pictures in short time by restricting the image area of a sensor, with the purpose of enabling an increased frame rate. Subsequent eye pictures are captured at normal frame rate. The first gaze point value is computed memorylessly based on the initial burst of eye pictures and no additional imagery, while subsequent values may be computed recursively by taking into account previous gaze point values or information from previous eye pictures. The restriction of the image area may be guided by a preliminary overview picture captured using the same or a different sensor. From the gaze point values, the system may derive a control signal to be supplied to a computer device with a visual display.

Claims

1. A method for initiating control of a gaze tracking system from a low power mode, wherein the method comprises:

in response to a gaze tracking activation signal, leaving a low power mode of the gaze tracking system;

capturing, at a first frame rate, a first plurality of pictures of at least a portion of a head of a viewer using a first restricted region of a light-sensitive surface;

determining, based on only the first plurality of pictures a first gaze point value of the viewer;

providing a first control signal to a computer device based on the first gaze point value;

capturing, at a second frame rate, lower than the first frame rate, a second plurality of pictures of at least a portion of the head of the viewer using a second region of the light-sensitive surface;

determining a second gaze point value of the viewer based on a picture from the second plurality of pictures and a picture from the first plurality of pictures; and

providing a second control signal to the computer device based on the second gaze point value.

2. The method of claim 1, wherein:

the gaze tracking activation signal is provided from a physical input device.

3. The method of claim 1, wherein determining the first gaze point value comprises:

jointly filtering images in the first plurality of pictures.

4. The method of claim 3, wherein determining the second gaze point value comprises:

jointly filtering images in the second plurality of pictures and at least one picture from the first plurality of pictures.

5. The method of claim 1, wherein:

the first restricted region of the light-sensitive surface is 10 percent or less of the light-sensitive surface.

6. The method of claim 1, wherein:

the second region of the light-sensitive surface is larger than the first restricted region of the light-sensitive surface.

7. The method of claim 1, wherein:

a ratio of the first frame rate to the second frame rate is at least 2 to 1.

8. A system for initiating a gaze tracking system associated with a computer system from a low power mode, wherein the system comprises:

an eye tracking device;

one or more processors configured to;

in response to a gaze tracking activation signal, leaving a low power mode of the gaze tracking system;

capturing, at a first frame rate using a first restricted region of a light-sensitive surface of the eye tracking device, a first plurality of pictures of at least a portion of a head of a viewer;

determining, based on only the first plurality of pictures, a first gaze point value of the viewer;

providing a first control signal to a computer system based on the first gaze point value;

capturing, at a second frame rate lower than the first frame rate, using a second region of the light-sensitive surface of the eye tracking device, a second plurality of pictures of at least a portion of the head of the viewer;

determining a second gaze point value of the viewer based on a picture from the second plurality of pictures and a picture from the first plurality of pictures; and

providing a second control signal to the computer system based on the second gaze point value.

9. The system of claim 8, wherein determining the first gaze point value comprises:

jointly filtering images in the first plurality of pictures.

10. The system of claim 9, wherein determining the second gaze point value comprises:

jointly filtering images in the second plurality of pictures and at least one picture from the first plurality of pictures.

11. The system of claim 8, further comprising:

a physical input device for providing the gaze tracking activation signal.

12. The system of claim 8, wherein:

the second region of the light-sensitive surface is larger than the first restricted region of the light-sensitive surface.

13. The system of claim 8, wherein the eye tracking device comprises:

a rolling shutter sensor.

14. The system of claim 8, wherein:

the first restricted region of the light-sensitive surface overlaps the second region of the light-sensitive surface.

15. A non-transitory computer readable medium having instructions stored thereon executable by a computing device for initiating a gaze tracking system from a low power mode that when executed cause the computing device to perform operations comprising:

leaving a low power mode of the gaze tracking system in response to a gaze tracking activation signal;

capturing, at a first frame rate using a first restricted region of a light-sensitive surface, a first plurality of pictures of at least a portion of a head of a viewer;

determining, based on only the first plurality of pictures, a first gaze point value of the viewer;

providing a first control signal to a computer system based on the first gaze point value;

capturing, at a second frame rate lower than the first frame rate, using a second region of the light-sensitive surface, a second plurality of pictures of at least a portion of the head of the viewer;

determining a second gaze point value of the viewer based on a picture from the second plurality of pictures and a picture from the first plurality of pictures; and

providing a second control signal to the computer system based on the second gaze point value.

16. The non-transitory computer readable medium of claim 15, wherein:

the gaze tracking activation signal is provided by a physical input device.

17. The non-transitory computer readable medium of claim 15, wherein:

the gaze tracking activation signal is provided in response to a detected presence of a user.

18. The non-transitory computer readable medium of claim 15, wherein determining the first gaze point value comprises:

jointly filtering images in the first plurality of pictures.

19. The non-transitory computer readable medium of claim 18, wherein determining the second gaze point value comprises:

jointly filtering images in the second plurality of pictures and at least one picture from the first plurality of pictures.

20. The non-transitory computer readable medium of claim 15, wherein:

the first restricted region of the light-sensitive surface is 10 percent or less of the light-sensitive surface.