Biosensors, communicators, and controllers monitoring eye movement and methods for using them

• US 7,515,054 B2
• Filed: 04/01/2005
• Issued: 04/07/2009
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: William C. Torch
• Inventors: Torch, William C.
• Primary Examiner(s): Lee; Benjamin C
• Application Number:
  US11/097,788
• Publication Number:
  US 20090058660A1
• Time in Patent Office: 1,467 Days
• Field of Search: 340/573.1, 340575-576, 600/300, 351205-206, 351209-210
• US Class Current: 340/573.1
• CPC Class Codes: A61B 3/112 for measuring diameter of pupils
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Biosensor, communicator, and/or controller apparatus, systems, and methods are provided for monitoring movement of a person'"'"'s eye. The apparatus includes a device configured to be worn on a user'"'"'s head, a light source for directing light towards one or both eyes of the user, one or more image guides on the device for viewing one or both eyes of the user, and one or more cameras carried on the device and coupled to the image guides for acquiring images of the eyes and/or the user'"'"'s surroundings. The apparatus may include a cable and/or a transmitter for transmitting image data from the camera to a remote location, e.g., to processor and/or display for analyzing and/or displaying the image data. A system including the apparatus may be used to monitor one or more oculometric parameters, e.g., pupillary response, and/or to control a computer using the user'"'"'s eyes instead of a mouse.

Claims

1. A system for monitoring movement of a person'"'"'s eye, comprising:

a device configured to be worn on a person'"'"'s head;

a light source for directing light towards an eye of the person when the device is worn;

a camera on the device for monitoring movement of the eye, the camera configured for generating video signals representing video images acquired by the camera of the eye;

a processor communicating with the camera for processing the video signals to analyze a pupil of the eye by identifying the pupil of the eye from the video signals and monitoring at least one of a size of the pupil and an eccentricity of the pupil;

the processor is further configured for correlating the video signals to determine the person'"'"'s physical or mental state based at least partially upon analysis of the pupil identified by the processor; and

a display coupled to the processor for displaying video images of the eye from the video signals processed by the processor, the display superimposing a graphic onto the video images to identify the pupil.

2. The system of claim 1, wherein the camera comprises a CCD or CMOS detector, and at least one fiber optic bundle including a first end mounted to the device such that the first end is oriented towards an eye of the person when the device is worn.

3. The system of claim 2, wherein the light source comprises at least one illumination fiber carried by the fiber optic bundle.

4. The system of claim 1, further comprising a transmitter on the device for wirelessly transmitting output signals from the camera to a remote location.

5. The system of claim 4, wherein the processor is located at a location remote to the device, the processor coupled to a receiver for receiving the output signals transmitted by the transmitter.

6. The system of claim 1, wherein the processor is provided on the device.

7. The system of claim 1, further comprising one or more sensors on the device for measuring one or more physiological characteristics of the person, the processor coupled to the one or more sensors for correlating the one or more physiological characteristics with the video signals to determine to the person'"'"'s physical or mental state.

8. The system of claim 1, further comprising one or more sensors on the device for measuring one or more physiological characteristics of the user, the processor coupled to the one or more sensors for displaying the one or more physiological characteristics on the display along with the video images.

9. A method for monitoring movement of a person'"'"'s eye, comprising:

placing a head-wearable biosensor assembly on a person'"'"'s head, the biosensor assembly including a light source for directing light towards an eye of the person when the biosensor assembly is worn, and a camera oriented towards the eye;

emitting light from the light source towards the eye;

monitoring movement of the eye with the camera to generate video images of the eye;

correlating the video images and determining the person'"'"'s physical or metal state by a processor; and

generating by the processor a graphical output of the movement monitored by the camera, the graphical output comprising an artificial image superimposed upon the video images of the eye to identify at least one of a size of a pupil of the eye and an eccentricity of the pupil.

10. The method of claim 9, wherein correlating the video images to determine the person'"'"'s physical or mental state comprises analyzing the video images to monitor at least one of a relative location of the pupil, a size of the pupil, and an eccentricity of the pupil.

11. The method of claim 9, wherein correlating the video images to determine the person'"'"'s physical or mental state comprises monitoring changes in size of the pupil.

12. The method of claim 11, wherein monitoring changes in size of the pupil comprises:

detecting initial dilation of the pupil after the person closes and reopens the eye; and

determining a delay of the pupil to return to a relaxed size after the eye is reopened.

13. The method of claim 11, wherein monitoring changes in size of the pupil comprises:

determining eccentricity of the pupil; and

comparing the eccentricity of the pupil to data to determine the person'"'"'s physical or mental state.

14. The method of claim 9, further comprising transmitting the video images from the camera to a remote location, and wherein the graphical output is generated at the remote location.

15. The method of claim 9, wherein the graphical output is displayed in real time on a display.

16. The method of claim 9, wherein the biosensor assembly further comprises one or more sensors for measuring one or more physiological characteristics of the person, and wherein the one or more physiological characteristics are correlated with the video images to determine to the person'"'"'s physical or mental state.

17. The method of claim 9, wherein the biosensor assembly further comprises one or more sensors for measuring one or more physiological characteristics of the user, and wherein the one or more physiological characteristics are displayed on a display along with the video images.

18. The method of claim 9, wherein generating the graphical output comprises detecting contrast between the edge of the pupil and the surrounding iris of the eye.

19. The method of claim 18, wherein generating the graphical output further comprises creating a graphic halo or ellipse that is superimposed on the video images.

20. A method for monitoring a person'"'"'s eye, comprising:

placing a head-wearable biosensor assembly on a person'"'"'s head, the biosensor assembly comprising a light source directing light towards the person'"'"'s eye and a camera oriented towards the person'"'"'s eye that do not interfere substantially with the user'"'"'s vision;

emitting one or more pulses of light from the fight source, causing the eye to dilate from its relaxed state;

monitoring the eye with the camera to determine the reaction time of the eye to return to its relaxed state;

comparing the reaction time to reference data by a processor to determine the person'"'"'s physical or mental state; and

displaying video images of the eye from the video signals processed by the processor;

the processor superimposing a graphic onto the video images to identify at least one of a size of the pupil and an eccentricity of the pupil.

21. The method of claim 20, wherein comparing the reaction time comprises comparing the reaction time to reference data to confirm that the person is at least one of conscious, awake, and alive.

22. The method of claim 20, wherein emitting one or more pulses of light from the light source, causing the eye to dilate from its relaxed state;

and monitoring the eye with the camera to determine the reaction time of the eye to return to its relaxed state is repeated one or more times to avoid false negative determinations.

23. The method of claim 20, wherein the light source is outside the visible light range such that the person does not consciously observe the one or more pulses of light.

24. The method of claim 20, wherein comparing the reaction time comprises comparing the reaction time to reference data to determine whether the person is under the influence of alcohol or drugs.

25. The method of claim 20, wherein comparing the reaction time comprises comparing the reaction time to reference data to determine the amount of drug or alcohol in the person'"'"'s body.

26. A system for monitoring movement of a person'"'"'s eye, comprising:

a device configured to be worn on a person'"'"'s head;

a light source for directing light towards an eye of the person when the device is worn;

a camera on the device for monitoring movement of the eye, the camera configured for generating video signals representing video images acquired by the camera of the eye;

a processor communicating with the camera for processing the video signals to analyze a pupil of the eye by identifying the pupil of the eye from the video signals and at least one of a size of the pupil and an eccentricity of the pupil, the processor correlating the video signals to determine the person'"'"'s physical or mental state based at least partially upon the analysis of the pupil; and

a display coupled to the processor for displaying video images of the eye from the video signals processed by the processor the display superimposing a graphic onto the video images to identify at least one of a size of the pupil and an eccentricity of the pupil.

27. The system of claim 26, further comprising one or more sensors on the device for measuring one or more physiological characteristics of the user, the processor coupled to the one or more sensors for displaying the one or more physiological characteristics on the display along with the video images.

28. The system of claim 26, further comprising one or more sensors on the device for measuring one or more physiological characteristics of the person, the processor coupled to the one or more sensors for correlating the one or more physiological characteristics with the video signals to determine to the person'"'"'s physical or mental state.