Apparatus and method for detecting pupils

• US 7,280,678 B2
• Filed: 02/28/2003
• Issued: 10/09/2007
• Est. Priority Date: 02/28/2003
• Status: Active Grant

• Current Assignee: Wistron Corporation
• Original Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Inventors: Haven, Richard Earl, Anvar, David James, Fouquet, Julie Elizabeth, Wenstrand, John Stewart
• Primary Examiner(s): Johns, Andrew W.
• Assistant Examiner(s): Conover, Damon M
• Application Number:
  US10/377,687
• Publication Number:
  US 20040170304A1
• Time in Patent Office: 1,684 Days
• Field of Search: 382/117, 351/206, 348/78
• US Class Current: 382/117
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

Methods and apparatus for pupil detection are described. First light is emitted from a first light source at a first illumination angle relative to the axis of a detector. Second light is emitted from a second light source at a second illumination angle relative to the axis. The first light and the second light can have substantially equal intensities. The second illumination angle is greater than the first illumination angle. Reflected first light and reflected second light are received at the detector. The difference between the reflected first light and the reflected second light can be determined. The difference can be used to detect the pupils of a subject'"'"'s eyes.

Claims

1. An apparatus for pupil detection, said apparatus comprising:

a first detector for receiving reflected light;

a first light source for emitting first light at a first illumination angle relative to the axis of said first detector;

a second light source for emitting second light at a second illumination angle relative to said axis, said second illumination angle greater than said first illumination angle, said first light and said second light having substantially equal intensity;

wherein pupils of a subject'"'"'s eyes are detectable using the difference between reflected first light and reflected second light received at said first detector; and

a plurality of additional light sources that are sequentially illuminated to measure pupil diameter.

2. The apparatus of claim 1 further comprising:

a third light source for emitting third light at substantially a same wavelength as said first light, said first and third light sources symmetrically located about said axis; and

a fourth light source for emitting fourth light at substantially a same wavelength as said second light, said second and fourth light sources symmetrically located about said axis.

3. The apparatus of claim 1 wherein said first light and said second light have wavelengths that are substantially equal, wherein said first and second light sources are alternately activated.

4. The apparatus of claim 1 wherein said first detector captures reflected first light and reflected second light in consecutive frames, wherein said difference is determined from pairs of consecutive frames.

5. The apparatus of claim 1 wherein said first light and said second light have wavelengths that are different, wherein said first and second light sources are activated substantially at a same time.

6. The apparatus of claim 5 wherein said first light has a wavelength shorter than said second light.

7. The apparatus of claim 5 wherein said first detector comprises filters for differentiating between said reflected first light and said reflected second light, wherein said first detector captures a first sub-frame corresponding to said reflected first light and a second sub-frame corresponding to said reflected second light, wherein said difference is determined using said first and second sub-frames.

8. The apparatus of claim 7 wherein said first and second lights are infrared or near-infrared lights, wherein said first detector further comprises filters for distinguishing visible light from said reflected first and second lights, and wherein said first detector also captures a frame corresponding to said visible light.

9. The apparatus of claim 5 wherein said first detector comprises a first filter for blocking visible light and a second filter that blocks reflected first light.

10. The apparatus of claim 5 wherein reflected first light and reflected second light are captured in a single image.

11. The apparatus of claim 5 wherein said first detector comprises filters for differentiating between said reflected first light and said reflected second light, wherein said filters are configured so that a first pixel of said first detector receives first light and a second pixel adjacent to said first pixel receives second light.

12. The apparatus of claim 1 wherein said first light is polarized in one direction and said second light is polarized in a different direction.

13. The apparatus of claim 12 wherein said first detector comprises filters for differentiating between first polarized light and second polarized light.

14. The apparatus of claim 13 wherein said filters are configured so that a first pixel of said first detector receives first polarized light and a second pixel adjacent to said first pixel receives second polarized light.

15. The apparatus of claim 13 wherein said filters comprise semi-transparent material.

16. The apparatus of claim 1 further comprising a second detector.

17. The apparatus of claim 16 wherein said second detector has a smaller collection angle than said first detector, wherein said second detector is aimed using information from said first detector.

18. The apparatus of claim 16 wherein said second detector has a higher resolution than said first detector, wherein said second detector is aimed using information from said first detector.

19. The apparatus of claim 16 further comprising wavelength-selective filters positioned such that said first detector receives said reflected first light and said second detector receives said reflected second light.

20. The apparatus of claim 1 further comprising a beam splitter.

21. The apparatus of claim 1 wherein said first illumination angle ranges from approximately zero to three (3) degrees and wherein said second illumination angle ranges from approximately 3 to 15 degrees.

22. The apparatus of claim 1 wherein said first and second lights are emitted in timed bursts, said bursts separated by time intervals that are longer than said bursts.

23. The apparatus of claim 1 wherein said first and second lights are modulated to distinguish them from ambient conditions.

24. The apparatus of claim 1 wherein the intensity of said first and second lights is increased according to ambient light conditions.

25. The apparatus of claim 1 wherein a spectral range associated with said first and second lights is narrowed according to ambient light conditions.

26. The apparatus of claim 1 wherein said reflected first light and said reflected second light are filtered with a spike filter to filter out ambient lighting.

27. The apparatus of claim 1 wherein a collection angle of said detector is reduced according to ambient light conditions, wherein reducing said collection angle reduces collection of ambient light.

28. The apparatus of claim 1 wherein a depth of field of said detector is reduced, wherein said pupils are substantially in focus while objects more distant than said pupils are of reduced focus.

29. The apparatus of claim 1 wherein a wavelength for said first light and a wavelength for said second light that are different from dominant wavelengths of ambient light are selected.

30. The apparatus of claim 1 wherein an exposure time of said detector for a lower amount of ambient light is determined and wherein said exposure time is maintained with an increase in ambient light.

31. The apparatus of claim 1, used for drowsiness detection.

32. The apparatus of claim 1, used for lie detection.

33. The apparatus of claim 1, used for distinguishing between a live subject and an image of said subject.

34. The apparatus of claim 1, used for eye-based identification.

35. The apparatus of claim 1, used for facial-based identification.

36. The apparatus of claim 1 wherein said first detector comprises a mosaic of visible and infrared filters.

37. The apparatus of claim 1 wherein said first detector comprises a mosaic of infrared filters.

38. The apparatus of claim 1 wherein at least one of said first and second light sources is a vertical cavity surface-emitting laser.

39. A method for pupil detection, said method comprising:

emitting first light from a first light source at a first illumination angle relative to the axis of a detector;

emitting second light from a second light source at a second illumination angle relative to said axis, said second illumination angle greater than said first illumination angle, said first light and said second light having substantially equal brightness;

receiving reflected first light and reflected second light at said detector;

determining the difference between said reflected first light and said reflected second light, wherein pupils of a subject'"'"'s eyes are detectable from said difference;

receiving reflected light from a plurality of additional light sources that are sequentially illuminated; and

determining pupil diameter using said reflected light.

40. The method of claim 39 further comprising:

polarizing said first and second lights.

41. The method of claim 39 further comprising:

emitting third light from a third light source, said third light at substantially a same wavelength as said first light, said first and third light sources symmetrically located about said axis; and

emitting fourth light from a fourth light source, said fourth light at substantially a same wavelength as said second light, said second and fourth light sources symmetrically located about said axis.

42. The method of claim 39 wherein said first light and said second light have wavelengths that are substantially equal, wherein said first and second light sources are alternately actuated and wherein said detector captures reflected first light and reflected second light in consecutive frames.

43. The method of claim 39 wherein said first light and said second light have wavelengths that are different, wherein said first and second light sources are actuated substantially together and wherein said detector filters said reflected first light and said reflected second light using respective filters to capture a sub-frame corresponding to said reflected first light and a sub-frame corresponding to said reflected second light.

44. The method of claim 39 wherein said first and second lights are emitted in timed bursts, said bursts separated by time intervals that are longer than said bursts.

45. The method of claim 39 further comprising:

determining whether said subject is drowsy or alert.

46. The method of claim 39 further comprising:

determining whether said subject is lying or truthful.

47. The method of claim 39 further comprising:

distinguishing between a live subject and an image of said subject.

48. The method of claim 39 further comprising:

applying an eye-based identification technique subsequent to detection of said pupils.

49. The method of claim 39 further comprising:

using detection of said pupils to determine facial orientation.

50. An apparatus for pupil detection, said apparatus comprising:

a first detector for receiving reflected light;

a first light source for emitting first light at a first illumination angle relative to the axis of said first detector;

a second light source for emitting second light at a second illumination angle relative to said axis, said second illumination angle greater than said first illumination angle, said first light and said second light having substantially equal intensity;

wherein pupils of a subject'"'"'s eyes are detectable using the difference between reflected first light and reflected second light received at said first detector; and

a series of adjacent additional light sources that are positioned at different illumination angles and that are sequentially illuminated to measure pupil diameter, wherein measuring pupil diameter comprises comparing retinal return to the illumination angles of the light sources.

51. A method for pupil detection, said method comprising:

emitting first light from a first light source at a first illumination angle relative to the axis of a detector;

emitting second light from a second light source at a second illumination angle relative to said axis, said second illumination angle greater than said first illumination angle, said first light and said second light having substantially equal brightness;

receiving reflected first light and reflected second light at said detector;

determining the difference between said reflected first light and said reflected second light, wherein pupils of a subject'"'"'s eyes are detectable from said difference;

receiving reflected light from a series of adjacent additional light sources that are positioned at different illumination angles and that are sequentially illuminated; and

determining pupil diameter using said reflected light, wherein determining pupil diameter using said reflected light comprises comparing retinal return to the illumination angles of the light sources.