SYSTEMS AND METHODS FOR IDENTIFYING GAZE TRACKING SCENE REFERENCE LOCATIONS
First Claim
1. A system for determining reference locations, comprising:
- a device configured to be worn on a wearer'"'"'s head;
a scene camera mounted on the device oriented away from the wearer for capturing scene camera images of the environment of the wearer;
an eye-tracking camera mounted on the device oriented towards an eye of the wearer for capturing eye-tracking locations of at least one of the wearer'"'"'s eyes; and
one or more processors coupled to the scene camera for determining scene reference locations within the scene camera images and coupled to the eye-tracking camera, the one or more processors using the scene reference locations and the eye-tracking locations to determine locations being viewed by the wearer.
4 Assignments
0 Petitions
Accused Products
Abstract
A system is provided for identifying reference locations within the environment of a device wearer. The system includes a scene camera mounted on eyewear or headwear coupled to a processing unit. The system may recognize objects with known geometries that occur naturally within the wearer'"'"'s environment or objects that have been intentionally placed at known locations within the wearer'"'"'s environment. One or more light sources may be mounted on the headwear that illuminate reflective surfaces at selected times and wavelengths to help identify scene reference locations and glints projected from known locations onto the surface of the eye. The processing unit may control light sources to adjust illumination levels in order to help identify reference locations within the environment and corresponding glints on the surface of the eye. Objects may be identified substantially continuously within video images from scene cameras to provide a continuous data stream of reference locations.
-
Citations
47 Claims
-
1. A system for determining reference locations, comprising:
-
a device configured to be worn on a wearer'"'"'s head; a scene camera mounted on the device oriented away from the wearer for capturing scene camera images of the environment of the wearer; an eye-tracking camera mounted on the device oriented towards an eye of the wearer for capturing eye-tracking locations of at least one of the wearer'"'"'s eyes; and one or more processors coupled to the scene camera for determining scene reference locations within the scene camera images and coupled to the eye-tracking camera, the one or more processors using the scene reference locations and the eye-tracking locations to determine locations being viewed by the wearer. - View Dependent Claims (5, 6, 7, 9, 10, 16)
-
-
2-4. -4. (canceled)
-
8. (canceled)
-
11-15. -15. (canceled)
-
17-21. -21. (canceled)
-
22. A system for gaze tracking, comprising:
-
an electronic object comprising a display and a plurality of reflective reference objects located around the display; and a device configured to be worn on a wearer'"'"'s head, the device comprising; a) a scene camera mounted on the device oriented away from the wearer for capturing scene camera images of the environment of the wearer; b) an eye-tracking camera mounted on the device oriented towards an eye of the wearer for capturing eye-tracking locations of at least one of the wearer'"'"'s eyes; and c) one or more processors coupled to the scene camera for identifying the reference objects within the scene camera images and coupled to the eye-tracking camera, the one or more processors using the locations of the reference objects in the scene camera images and the eye-tracking locations to determine locations on the display being viewed by the wearer. - View Dependent Claims (23, 24, 25, 26, 27, 28)
-
-
29-31. -31. (canceled)
-
32. A method for determining reference locations, comprising:
-
placing a device on a wearer'"'"'s head; providing a scene camera on the device positioned for capturing images of the environment of the wearer, the scene camera coupled to a scene processor for determining scene reference locations within scene camera images acquired from the scene camera; and providing an eye-tracking camera on the device positioned for capturing eye-tracking locations of at least one of the wearer'"'"'s eyes, the eye-tracking camera and the scene camera coupled to a processor for using the scene reference locations and the eye-tracking locations to determine locations being viewed by the wearer. - View Dependent Claims (34, 39, 45, 46)
-
-
33. (canceled)
-
35-38. -38. (canceled)
-
40-44. -44. (canceled)
-
47-50. -50. (canceled)
Specification