System and method for monitoring eye movement

• US RE41,376 E1
• Filed: 04/03/2007
• Issued: 06/15/2010
• Est. Priority Date: 08/19/1996
• Status: Expired due to Term

• Current Assignee: Eyefluence, Inc. (Alphabet Inc.)
• Original Assignee: William C. Torch
• Inventors: Torch, William C.
• Primary Examiner(s): Mullen; Thomas J
• Application Number:
  US11/732,828
• Time in Patent Office: 1,169 Days
• Field of Search: 340/573.1, 340/575, 340/576, 340/825.19, 340/539.1, 382/117, 382/118, 600/558, 351/210
• US Class Current: 340/575
• CPC Class Codes: A61B 2503/22 Motor vehicles operators, e.g. drivers, pilots, captains
• CPC Class Codes: A61B 2562/043 in a linear array
• CPC Class Codes: A61B 3/0066 with identification means for the apparatus
• CPC Class Codes: A61B 3/10 Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/1103 Detecting eye twinkling
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/4094 Diagnosing or monitoring seizure diseases, e.g. epilepsy
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/6821 Eye
• CPC Class Codes: A61M 2021/0044 by the sight sense
• CPC Class Codes: A61M 2021/0083 especially for waking up
• CPC Class Codes: A61M 21/02 for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021
• CPC Class Codes: A61M 2205/3569 sublocal, e.g. between console and disposable
• CPC Class Codes: A61M 2205/3592 using telemetric means, e.g. radio or optical transmission
• CPC Class Codes: A61M 2230/06 Heartbeat rate only
• CPC Class Codes: A61M 2230/10 Electroencephalographic signals
• CPC Class Codes: A61M 2230/42 Rate
• CPC Class Codes: G01S 17/00 Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 7/481 : Constructional features, e.g. arrangements of optical elements
• CPC Class Codes: G06K 9/0061 : Preprocessing; Feature extraction
• CPC Class Codes: G06K 9/00845 : Recognising the driver's state or behaviour, e.g. attention, drowsiness anti-dozing alarms G08B21/06; safety device responsive to condition of driver B60K28/02; psychotechnic devices for vehicle drivers A61B5/18
• CPC Class Codes: G08B 21/06 : indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08B 25/016 : Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12

Abstract

Apparatus for monitoring movement of a person'"'"'s eye, e.g., to monitor drowsiness. The system includes a frame that is worn on a person'"'"'s head, an array of emitters on the frame for directing light towards the person'"'"'s eye, and an array of sensors on the frame for detecting light from the array of emitters. The sensors detect light that is reflected off of respective portions of the eye or its eyelid, thereby producing output signals indicating when the respective portions of the eye is covered by the eyelid. The emitters project a reference frame towards the eye, and a camera on the frame monitors movement of the eye relative to the reference frame. This movement may be correlated with the signals from the array of sensors and/or with signals from other sensors on the frame to monitor the person'"'"'s level of drowsiness.

Claims

1. A system for monitoring movement of a person'"'"'s eye, comprising:

a device configured to be worn on a person'"'"'s head;

an array ofone or more emitters on the device for directing light towards an eye of the person when the device is worn, the array of emitters configured for projecting a reference frame towards the eye ;

and

a camera oriented towards the eye for monitoring movement of the eye relative to the reference frame mounted on the device; and

one or more sensors on the device for detecting light from the array of one or more emitters that is reflected off of the eye or its eyelid, the one or more sensors producing an output signal indicating when the eye is open or closed.

2. The system of claim 1, wherein the one or more sensors comprise an array of sensors in a predetermined relationship with the array of one or more emitters for detecting light from the array of one or more emitters that is reflected off of respective portions of the eye or its eyelid, each sensor producing an output signal indicating when the respective portion of the eye is covered or not covered by the eyelid.

3. The system of claim 1, wherein the array of one or more emitters and the one or more sensors are disposed separately and substantially laterally from one another.

4. The system of claim 1, wherein the array of one or more emitters and the one or more sensors comprise solid state devices capable of operating both as an emitter and as a sensor.

5. The system of claim 1, wherein the camera is configured for producing a video signal, and wherein the system further comprises a processor for correlating the output signal from the one or more sensors with the video signal from the camera for determining the person'"'"'s level of drowsiness.

6. The system of claim 5, further comprising a warning indicator on the device, the warning indicator being activated when the processor determines a predetermined level of drowsiness has occurred.

7. The system of claim 1, wherein the array of one or more emitters comprises a plurality of emitters disposed in a substantially vertical arrangement on the device.

8. The system of claim 7, wherein the array of one or more emitters further comprises a plurality of emitters disposed in a substantially horizontal arrangement on the device.

9. The system of claim 1, wherein the array of one or more emitters is comprise an array of emitters configured for projecting a set of crossed bands towards the eye for dividing a region including the eye into four quadrants.

10. The system of claim 1, further comprising a transmitter on the device for wireless transmission of video output signals from the camera to a remote location.

11. The system of claim 1, wherein the array of one or more emitters comprise infrared emitters configured to emit pulses of infrared light.

12. The system of claim 11, wherein the camera comprises an infrared camera.

13. The system of claim 1, wherein the camera is mounted on the device.

14. The system of claim 13 1, wherein the camera comprises a fiberoptic assembly.

15. The system of claim 13 1, wherein the camera comprises at least one of a CCD and CMOS detector.

16. The system of claim 1, further comprising a sensor on the device for detecting one or more physiological characteristics of the person.

17. The system of claim 16, wherein the sensor comprises at least one of a EEG electrode, an EKG electrode, an oximetry sensor, a pulse sensor, an airflow sensor, and a temperature sensor.

18. The system of claim 1, further comprising at least one of an orientation sensor for detecting the spatial orientation of the device and an actigraphic sensor.

19. The system of claim 1, wherein the device comprises at least one of an eyeglass frame, a hat, a helmet, a visor, and a mask.

29. The system of claim 1, wherein the camera is oriented towards the eye for monitoring movement of the eye.

30. The system of claim 1, wherein the camera is oriented away from the person to monitor the person'"'"'s surroundings.

20. A system for monitoring movement of a person'"'"'s eye, comprising:

a frame configured to be worn on a person'"'"'s head;

an array of emitters on the frame for directing light towards an eye of the person when the device is worn, the array emitters configured to project a reference frame towards the eye;

an array of sensors on the frame in a predetermined relationship with the array of emitters for detecting light from the array of emitters that is reflected off of respective portions of the eye or its eyelid, each sensor producing an output signal indicating when the respective portion of the eye is covered or not covered by the eyelid;

and

a camera on the frame for monitoring movement of the eye relative to the reference frame, the camera configured for producing a video signal of a region of the eye and the reference frame; and

a transmitter coupled to the sensor for wireless transmission of the output signal and the video signal to a remote location .

21. The system of claim 20, further comprising a processor for correlating the output signal and the video signal to determine the person'"'"'s level of drowsiness.

22. The system of claim 21, further comprising a display for providing a graphical output of the output signal simultaneous with the video signal.

23. A method for monitoring movement of a person'"'"'s eye using a detection device including an array of emitters that are directed towards an eye of the person when the detection device is worn, and a camera oriented towards the eye, the method comprising:

emitting light from the array of emitters towards the eye to project a reference frame onto the eye;

monitoring movement of the eye relative to the reference frame with the camera; and

generating a graphical output of the movement monitored by the camera relative to the reference frame;

wherein the detection device further comprises one or more sensors, and wherein the method further comprises detecting light from the array of emitters reflected off of the eye with the one or more sensors, the one or more sensors producing a light intensity signal indicating when the eye is open or closed.

24. The method of claim 23, wherein the array of sensors is disposed in a predetermined relationship with the array of emitters for detecting light from the array of emitters that is reflected off of respective portions of the eye or its eyelid, each sensor producing an output signal indicating when the respective portion of the eye is covered or not covered by the eyelid.

25. The method of claim 24, further comprising correlating the output signal from the one or more sensors with video signals produced by the camera monitoring movement of the eye relative to the reference frame, thereby determining the person'"'"'s level of alertness.

26. The method of claim 23, wherein the monitoring step comprises measuring movement of the eye'"'"'s pupil relative to the reference frame.

27. The method of claim 26, further comprising graphically displaying the movement of the eye'"'"'s pupil relative to the reference frame.

28. The method of claim 25, further comprising providing a warning to the person when the determined level of alertness falls below a predetermined level.

31. A system for monitoring movement of a person'"'"'s eye, comprising:

a device configured to be worn on a person'"'"'s head;

one or more emitters on the device for directing light towards an eye of the person when the device is worn;

an imaging sensor on the device comprising a lens directed towards the eye of the person when the device is worn, the sensor configured for converting images of the eye into output signals;

a processor coupled to the sensor for monitoring one or more eye movement parameters of the eye based upon the output signals; and

one or more physiological sensors on the device for monitoring one or more physiological parameters.

32. The system of claim 31, further comprising a display coupled to the imaging sensor and the one or more physiological sensors for displaying the one or more eye movement parameters of the eye and the one or more physiological parameters.

33. The system of claim 31, wherein the imaging sensor further comprises a bundle of fiberoptic cables comprising a first end terminating in the lens.

34. A system for monitoring movement of a person'"'"'s eye, comprising:

a device configured to be worn on a person'"'"'s head;

one or more emitters on the device for directing light towards an eye of the person when the device is worn;

a two-dimensional array of sensors on the device directed towards the eye of the person when the device is worn, the sensors configured for converting images of the eye into output signals;

a processor coupled to the sensors for monitoring one or more eye movement parameters of the eye based upon the output signals; and

one or more sensors on the device for detecting one or more physiological characteristics of the person, the processor further configured for correlating the one or more physiological characteristics with the output signals to generate a composite fatigue index of the person wearing the device.

35. The system of claim 34, further comprising a camera on the device that is oriented away from the person to monitor the person'"'"'s surroundings.

36. A system for monitoring movement of a person'"'"'s eye, comprising:

a device configured to be worn on a person'"'"'s head;

one or more emitters on the device for directing light towards an eye of the person when the device is worn;

one or more sensors on the device for detecting light from the one or more emitters that is reflected off of the eye or its eyelid, the sensors configured for converting images of the eye into output signals;

one or more position sensors for determining a spatial orientation of the device when the device is worn; and

a processor coupled to the one or more sensors for monitoring one or more eye movement parameters of the eye based upon the output signals and coupled to the one or more position sensors, the processor correlating at least the spatial orientation determined using the one or more position sensors with the output signals to generate a composite fatigue index of the person wearing the device.

37. The system of claim 36, wherein the one or more position sensors comprise one or more actigraphic sensors to measure tilt or movement of the person'"'"'s head when the device is worn.

38. A method for monitoring movement of a person'"'"'s eye using a detection device including one or more emitters and an array of sensors that are directed towards an eye of the person when the detection device is worn, the method comprising:

emitting light from one or more emitters towards the eye;

detecting light from the one or more emitters reflected off of the eye with the array of sensors, the array of sensors producing light intensity signals indicating when the eye is open or closed; and

monitoring one or more eye movement parameters of the eye based upon the light intensity signals,

wherein the one or more eye movement parameters are monitored to monitor a psychological condition of the person.

39. The method of claim 38, wherein the one or more eye movement parameters are monitored to detect whether the person is lying.

40. A method for monitoring movement of a person'"'"'s eye using a detection device including one or more emitters and an array of sensors that are directed towards an eye of the person when the detection device is worn, the method comprising:

emitting light from one or more emitters towards the eye;

detecting light from the one or more emitters reflected off of the eye with the array of sensors, the array of sensors producing light intensity signals indicating when the eye is open or closed; and

monitoring one or more eye movement parameters of the eye based upon the light intensity signals,

wherein the one or more eye movement parameters are monitored to monitor a medical condition of the person.

41. The method of claim 40, wherein the one or more eye movement parameters are monitored to monitor a neurological condition of the person.

42. A method for monitoring movement of a person'"'"'s eye using a detection device including one or more emitters and an array of sensors that are directed towards an eye of the person when the detection device is worn, the method comprising:

emitting light from one or more emitters towards the eye;

detecting light from the one or more emitters reflected off of the eye with the array of sensors, the array of sensors producing light intensity signals indicating when the eye is open or closed; and

monitoring one or more eye movement parameters of the eye based upon the light intensity signals,

wherein the one or more eye movement parameters are monitored to monitor biofeedback from the person.

43. A method for monitoring movement of a person'"'"'s eye using a detection device including one or more emitters and an array of sensors that are directed towards an eye of the person when the detection device is worn, the method comprising:

emitting light from one or more emitters towards the eye;

detecting light from the one or more emitters reflected off of the eye with the array of sensors, the array of sensors producing light intensity signals indicating when the eye is open or closed; and

transmitting data signals to communicate with a remote location, the data signals comprising the light intensity signals and identification information transmitted with the light intensity signals to distinguish the detection device from a number of detection devices.

44. The method of claim 43, further comprising monitoring the person from the remote location using the light intensity signals.

45. The method of claim 44, further comprising activating or deactivating equipment when a predetermined condition is detected using the light intensity signals.

46. A method for monitoring movement of a person'"'"'s eye using a detection device including one or more emitters and an array of sensors that are directed towards an eye of the person when the detection device is worn, the method comprising:

emitting light from one or more emitters towards the eye;

detecting light from the one or more emitters reflected off of the eye with the array of sensors, the array of sensors producing light intensity signals indicating when the eye is open or closed; and

transmitting the light intensity signals to communicate with a remote location;

monitoring the person from the remote location using the light intensity signals; and

activating a warning indicator when a predetermined condition is detected using the light intensity signals.