BIOSENSORS, COMMUNICATORS, AND CONTROLLERS MONITORING EYE MOVEMENT AND METHODS FOR USING THEM

• US 20070273611A1
• Filed: 12/19/2006
• Published: 11/29/2007
• Est. Priority Date: 04/01/2004
• Status: Abandoned Application

• Current Assignee: Eyefluence, Inc. (Alphabet Inc.)
• Original Assignee: Eyefluence, Inc. (Alphabet Inc.)
• Inventors: Torch, William
• Application Number:
  US11/613,165
• Publication Number:
  US 20070273611A1
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: A61B 3/112 for measuring diameter of pupils
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Biosensor, communicator, and/or controller apparatus, systems, and methods are provided for monitoring movement of a person'"'"'s eye. The apparatus includes a device configured to be worn on a user'"'"'s head, a light source for directing light towards one or both eyes of the user, one or more image guides on the device for viewing one or both eyes of the user, and one or more cameras carried on the device and coupled to the image guides for acquiring images of the eyes and/or the user'"'"'s surroundings. The apparatus may include a cable and/or a transmitter for transmitting image data from the camera to a remote location, e.g., to processor and/or display for analyzing and/or displaying the image data. A system including the apparatus may be used to monitor one or more oculometric parameters, e.g., pupillary response, and/or to control a computer using the user'"'"'s eyes instead of a mouse.

Claims

1. A system for controlling a computing device, comprising:

a device configured to be worn on a person'"'"'s head;

a camera on the device for monitoring movement of at least one eye of the person, the camera configured for generating signals representing video images of the eye acquired by the camera;

a display disposed adjacent the device such that a pointer on the display is viewable by the person wearing the device; and

a processor coupled to the camera for processing the signals to monitor movement of the eye relative to a reference frame on the display, the processor coupled to the display for causing the pointer to move on the display based upon movement of the eye relative to the reference frame.

2. The system of claim 1, wherein the display is a heads-up display secured to the device such that the display is disposed a predetermined distance in front of the eye of the person wearing the device.

3. The system of claim 1, wherein the processor is coupled to the camera for monitoring the signals for video images indicating that the person wearing the device is looking at a specific location on the display, the processor configured for moving the pointer to the specific location.

4. The system of claim 3, wherein the processor is configured for monitoring the signals to detect video images indicating that the person wearing the device has blinked in a predetermined sequence while looking at the specific location to request a command be executed, the processor configured for executing the command on the computing device based upon detecting the video images.

5. The system of claim 1, further comprising a light source for directing light towards an eye of the person when the device is worn.

6. The system of claim 5, wherein the light source is configured for projecting the reference frame onto the eye of the person wearing the device.

7. The system of claim 1, wherein the processor is configured for displaying an image at a base location on the display, the processor further configured for monitoring the signals to detect video images indicating that the person wearing the device is looking at the base location to provide the reference frame for subsequent movement of the eye relative to the base location.

8. The system of claim 1, further comprising:

a light source for directing light towards the at least one eye of the person wearing the device; and

an image guide comprising a first end fixed on the device and positioned for viewing the at least one eye of the person wearing the device, and a second end coupled to the camera for acquiring video images of the at least one eye.

9. The system of claim 8, wherein the light source comprises first and second illumination fibers carried by the first and second image guides, respectively.

10. The system of claim 1, wherein the camera comprises a CCD or CMOS detector.

11. A method for controlling a computing device using a device worn on a user'"'"'s head, the device comprising a camera comprising an objective lens directed towards at least one eye of the user, the computer device comprising a display including a pointer displayed on the display, the method comprising:

monitoring movement of the at least one eye using the camera; and

correlating movement of the at least one eye relative to the pointer on the display to cause the pointer to follow movement of the at least one eye.

12. The method of claim 11, further comprising determining a base location of the at least one eye on an active area of the camera when the at least one eye looks at the pointer, and wherein the movement of the at least one eye is correlated by determining a change in location of the at least one eye on the active area relative to the base location to cause the pointer to move in response to the change in location.

13. The method of claim 11, further comprising monitoring the at least one eye for a predetermined sequence of eye movement, providing a signal to activate a command identified by the pointer on the display.

14. A method for controlling a computing device using a device worn on a user'"'"'s head, the device comprising a camera comprising an objective lens directed towards at least one eye of the user, the computer device comprising a display including a pointer displayed on the display, the method comprising:

monitoring movement of the at least one eye using the camera;

analyzing image data of the at least one eye from the camera while the at least one eye is substantially stationary to determine the location of the pupil of the at least one eye to provide a base location; and

correlating movement of the at least one eye relative to the base location on the display to cause the pointer to follow movement of the at least one eye.

15. The method of claim 14, wherein the display is a heads-up display secured to the device such that the display is disposed a predetermined distance in front of the at least one eye.

16. The method of claim 14, further comprising:

monitoring the at least one eye to determine when the user has blinked in a predetermined sequence while looking at a specific location to request a command be executed; and

executing the command on the computer device based upon the request.

17. The method of claim 14, further comprising monitoring the at least one eye for a predetermined sequence of eye movement, providing a signal to activate a command identified by the pointer on the display.