GAZE DETECTION METHOD AND APPARATUS

• US 20160357255A1
• Filed: 06/02/2016
• Published: 12/08/2016
• Est. Priority Date: 06/03/2015
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Lindh, Fredrik, Gustavsson, Mattias, Vennstrom, Anders, Edling, Andreas
• Granted Patent: US 10,216,268 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G05D 1/0242 using non-visible light signals, e.g. IR or UV signals
• CPC Class Codes: G05D 1/0244 using reflecting strips
• CPC Class Codes: G05D 1/0263 using magnetic strips
• CPC Class Codes: G05D 1/027 comprising intertial navigation means, e.g. azimuth detector inertial navigation G01C21/16; inertial navigation combined with non-inertial navigation instruments G01C21/165
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method for determining if a user'"'"'s gaze is directed in the direction of a zone of interest in a 3D scene comprises: providing a 3D scene containing a zone of interest; associating a property with the zone of interest; creating a bitmap representing the location of the zone of interest in a projected view of the 3D scene, each pixel of the bitmap to which the zone of interest is projected storing the property of the zone of interest; detecting the direction of the user'"'"'s gaze; using the bitmap to determine if the detected user'"'"'s gaze is directed in the direction of the zone of interest.

Claims

1. A method for determining if a user'"'"'s gaze is directed in the direction of a zone of interest in a 3D scene, the method comprising:

providing a 3D scene containing a zone of interest;

associating a property with the zone of interest;

creating a bitmap representing the location of the zone of interest in a projected view of the 3D scene, each pixel of the bitmap to which the zone of interest is projected storing the property of the zone of interest;

detecting the direction of the user'"'"'s gaze;

using the bitmap to determine if the detected user'"'"'s gaze is directed in the direction of the zone of interest.

2. A method according to claim 1, further comprising:

wherein the step of detecting comprises detecting the direction of the user'"'"'s gaze relative to the bitmap or another projection of the 3D scene.

3. A method according to claim 2, further comprising:

providing a visual representation for the user, corresponding to the 3D scene; and

wherein the step of detecting comprises detecting the direction of the user'"'"'s gaze within the visual representation.

4. A method according to claim 3, wherein a viewport for the bitmap and a viewport for the visual representation are at the same position with respect to the 3D scene.

5. A method according to claim 3, wherein a viewport for the bitmap and a viewport for the visual representation are not at the same position with respect to the 3D scene.

6. A method according to claim 3, wherein a viewport for the visual representation is of a second scene corresponding to the 3D scene.

7. A method according to claim 3, wherein the zone of interest, or part of the zone of interest, is not visible within the visual representation.

8. A method according to claim 7, wherein the zone of interest, or the part of the zone of interest, is not visible within the visual representation because it is hidden behind one or more other objects.

9. A method according to claim 7, further comprising determining that the user'"'"'s gaze is directed to the zone of interest, or the part of the zone of interest, that is not visible within the visual representation.

10. A method according to claim 1, wherein there are multiple zones of interest.

11. A method according to claim 10, wherein different zones of interests are associated with different properties.

12. A method according to claim 10, wherein the step of creating includes creating a bitmap with a pixel containing multiple properties of zones of interest, and the step of creating further comprises allocating the properties in the pixel an index to indicate the relative depth of the zones of interest within the scene.

13. A method according to claim 1 wherein the property is one of an identifier for the zone of interest, information concerning the motion of the zone of interest, or information concerning the visual importance of the zone of interest.

14. A method according to claim 1, further comprising associating multiple properties with the zone of interest.

15. A method according to claim 1, wherein the 3D scene is a simulated 3D scene.

16. A method according to claim 1, wherein the bitmap is created using depth buffer and/or stencil buffer data corresponding to the 3D scene.

17. A method according to claim 1, wherein the bitmap further undergoes a non-linear deformation.

18. A method according to claim 1, further comprising initiating an interaction when it is detected that the user'"'"'s gaze is directed in the direction of the zone of interest.

19. An apparatus for determining if a user'"'"'s gaze is directed in the direction of a zone of interest in a 3D scene, the apparatus comprising:

a buffer configured to store a bitmap representing the location of a zone of interest in a projected view of a 3D scene, each pixel of the bitmap to which the zone of interest is projected storing a property of the zone of interest;

a detector for detecting the direction of the user'"'"'s gaze;

a processor for using the bitmap to determine if the gaze detected by the detector is directed in the direction of the zone of interest.

20. An apparatus according to claim 19, wherein the processor is further configured to initiate an interaction when it is detected that the user'"'"'s gaze is directed in the direction of the zone of interest.