Method and apparatus for tracking eye movement

• US 7,736,000 B2
• Filed: 02/25/2009
• Issued: 06/15/2010
• Est. Priority Date: 08/27/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Locarna Systems, Inc.
• Inventors: Enriquez, Mario, Swindells, Colin, Pedrosa, Ricardo
• Primary Examiner(s): Sugarman; Scott J
• Assistant Examiner(s): PINKNEY, DAWAYNE
• Application Number:
  US12/392,574
• Publication Number:
  US 20100053555A1
• Time in Patent Office: 475 Days
• Field of Search: 351209-211, 351205-206, 351/200, 351/246
• US Class Current: 351/210
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

An eye tracking apparatus includes a first image detector for capturing scene images, a second image detector fixed relative to the first image detector for capturing eye images including a pupil of a person and a reference object located within an image detection field, a processor for receiving the scene images and the eye images and outputting eye tracking images, each of the eye tracking images including a gaze point corresponding to a line of sight of the person, the processor for determining a location of the gaze point based on a calibration mapping that maps pupil location within the image detection field to the scene images and a correction mapping that corrects for movement of the reference object within the image detection field of the second image detector. Wherein the first image detector and the second image detector are coupled to a wearable accessory and movement of the reference object within the image detection field corresponds to movement of the wearable accessory relative to the person.

Claims

1. A method of correcting for movement of a reference object within an image detection field of an eye tracking apparatus said method comprising:

providing said eye tracking apparatus, said eye tracking apparatus including a first image detector for capturing scene images, a second image detector for capturing eye images including a pupil of said person and a processor for receiving said scene images and said eye images and outputting eye tracking images, each of said eye tracking images including a gaze point corresponding to a line of sight of said person, said first image detector and said second image detector being coupled to a wearable accessory and being fixed relative to one another;

mounting said wearable accessory on said person;

identifying said reference object, said reference object being a marker applied to the skin of said person and being located within said image detection field of said second image detector;

performing a calibration method and generating a calibration mapping, said calibration mapping for mapping pupil location within said image detection field to said scene images;

capturing said scene images and said eye images;

determining a location of said reference object within said image detection field on each of said eye images;

applying said calibration mapping to each of said eye tracking images and adjusting said gaze point on each of said eye tracking images to correct for movement of said reference object within said image detection field;

wherein movement of said reference object within said image detection field corresponds to movement of said wearable accessory relative to said person.

2. A computer-readable medium comprising instructions executable on a processor for implementing the method of claim 1.

3. A method of correcting for movement of a reference object within an image detection field of an eye tracking apparatus as claimed in claim 1, wherein said gaze point on each eye tracking image is adjusted based on a correction mapping.

4. A method of correcting for movement of a reference object within an image detection field of an eye tracking apparatus as claimed in claim 1, wherein said correction mapping defines a difference between a calibrated location and calibrated orientation of said reference object and a location and orientation of said reference object on each of said eye images.

5. A method of correcting for movement of a reference object within an image detection field of an eye tracking apparatus as claimed in claim 1, wherein said first image detector is a first video camera and said second image detector is a second video camera.

6. An eye tracking apparatus comprising:

a first image detector for capturing scene images;

a second image detector for capturing eye images including a pupil of a person and a reference object located within an image detection field, said second image detector being fixed relative to said first image detector and said reference object being a marker applied to the skin of said person;

a processor for receiving said scene images and said eye images and outputting eye tracking images, each of said eye tracking images including a gaze point corresponding to a line of sight of said person, said processor for determining a location of said gaze point based on a calibration mapping that maps pupil location within said image detection field to said scene images and a correction mapping that corrects for movement of said reference object within said image detection field of said second image detector;

wherein said first image detector and said second image detector are coupled to a wearable accessory and movement of said reference object within said image detection field corresponds to movement of said wearable accessory relative to said person.

7. An eye tracking apparatus as claimed in claim 6, wherein said first image detector is a first video camera and said second image detector is a second video camera.

8. An eye tracking apparatus as claimed in claim 6, wherein said correction mapping defines a difference between a calibrated location and calibrated orientation of said reference object and a location and orientation of said reference object on each of said eye images.