Method and apparatus for eye tracking

• US 6,359,601 B1
• Filed: 12/27/1994
• Issued: 03/19/2002
• Est. Priority Date: 09/14/1993
• Status: Expired due to Term

• Current Assignee: Simulated Percepts, LLC
• Original Assignee: Francis J. Maguire
• Inventors: Maguire, Jr., Francis J.
• Primary Examiner(s): WU, XIAO MIN
• Application Number:
  US08/364,718
• Time in Patent Office: 2,639 Days
• Field of Search: 345/7-8, 345/9, 345/156, 345/157, 345/158, 345/169, 348/42, 348/15, 348/20
• US Class Current: 345/7
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/38 for tracking vertical translational head movements
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

The attitude of a human eye with respect to a head coordinate system is monitored for the purpose of determining the visual axis and for providing a control signal for control purposes such as controlling an image. The position, attitude or both of the head with respect to a reference frame may also be monitored for translating and/or transforming the monitored visual axis into other reference frames. Transformations and translations of the visual axis into additional reference frames is also disclosed.

Claims

1. Apparatus, comprising:

an eye monitor, responsive to an eye direction, for providing an eye direction signal with respect to an associated head coordinate system;

a head translatory position monitor, responsive to a translatory position associated with a head translating with respect to a reference coordinate system, for providing a head translatory position signal;

a signal processor, responsive to the eye direction signal and the head translatory position signal, for providing the eye direction signal referenced to the reference coordinate system with respect to both head translatory position and eye direction; and

a control, responsive to the eye direction signal referenced to the reference coordinate system, for providing a control signal.

2. The apparatus of claim 1, further comprising a head attitude monitor, responsive to attitude of the associated head in the reference coordinate system, for providing a head attitude signal, wherein the signal processor is responsive to the head attitude signal for providing the eye direction signal referenced to the reference coordinate system and wherein the control is responsive to the eye direction signal referenced to the reference coordinate system for providing the control signal.

3. The apparatus of claim 2, wherein said apparatus further comprises a body position monitor, responsive to a body translatory position in the reference coordinate system, for providing a body translatory position signal, wherein the signal processor is responsive to the body translatory position signal for providing the eye direction signal referenced to the reference coordinate system and wherein the control is responsive to the eye direction signal referenced to the reference coordinate system for providing the control signal.

4. The apparatus of claim 3, wherein said apparatus further comprises a body attitude monitor, responsive to body attitude in the reference coordinate system, for providing a body attitude signal, wherein the signal processor is responsive to the body attitude signal for providing the eye direction signal referenced to the reference coordinate system and wherein the control is responsive to the eye direction signal referenced to the reference coordinate system for providing the control signal.

5. A method for monitoring an eye in a head attached to a body, comprising the steps of:

sensing attitude of an eye with respect to a coordinate system of said head for providing an eye attitude signal;

sensing attitude of the head coordinate system with respect to a selected coordinate system for providing a head attitude signal;

sensing translatory position of the selected coordinate system with respect to a reference coordinate system for providing a translatory reference frame position signal;

providing, with respect to the eve attitude signal, the head attitude signal, and to the translatory reference frame position signal, the eye attitude signal referenced to the reference coordinate system; and

providing a control signal according to the eye attitude signal referenced to the reference coordinate system.

6. The method of claim 5, wherein the selected coordinate system is a coordinate system of said body.

7. Apparatus for monitoring an eye, comprising:

means for sensing attitude of an eye with respect to an associated head coordinate system for providing an eye attitude signal;

means for sensing attitude of the head coordinate system with respect to an associated body coordinate system for providing a head attitude signal;

means for sensing attitude and translatory position of the body coordinate system with respect to a reference coordinate system for providing a body translatory position signal and a body attitude signal both referenced to the reference coordinate system;

means responsive to the eye attitude signal, the head attitude signal, the body translatory position signal and the body attitude signal, for providing the eye attitude signal referenced to the reference coordinate system; and

means responsive to the eye attitude signal referenced to the reference coordinate system for providing a control signal.

8. The apparatus of claim 7, further comprising means for sensing translatory position of the head coordinate system with respect to the body coordinate system for providing a translatory head position signal and wherein the means responsive to the eye attitude signal, the head attitude signal, the body translatory position signal and the body attitude signal is also responsive to the head translatory position signal for providing the eye attitude signal referenced to the reference coordinate system.