Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system

• US 4,852,988 A
• Filed: 09/12/1988
• Issued: 08/01/1989
• Est. Priority Date: 09/12/1988
• Status: Expired due to Fees

• Current Assignee: Applied Science Laboratories Incorporated
• Original Assignee: Applied Science Laboratories Incorporated
• Inventors: Velez, Jose, Borah, Joshua D.
• Primary Examiner(s): Bovernick, Rodney B.
• Assistant Examiner(s): DZIERZYNSKI, PAUL M
• Application Number:
  US07/243,330
• Time in Patent Office: 323 Days
• Field of Search: 351/209, 351/210, 351/158, 350/169, 350/174
• US Class Current: 351/210
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0129 comprising devices for correcting parallax
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 5/20 Filters polarising elements G02B5/30
• CPC Class Codes: G02B 5/30 Polarising elements light-modulating devices with active elements G02F1/00

Abstract

A head-mounted, eye-movement, measurement system is provided with an optically flat glass laminated visor through which the observer views the external scene. Mounted so as to be vertically spaced from one side of the eye'"'"'s optic axis is an eye tracker module for recording the observer'"'"'s eye-movement relative to the head, principally by measuring the position of the pupil and corneal reflex, by reflecting near infrared light to and from the observer'"'"'s eye vis-a-vis the front surface of the visor. Mounted so as to be vertically spaced on the opposite side of the eye'"'"'s optic axis is a field-of-view camera which records the external scene viewed by the observer by reflecting external scene light from the back side of the visor. The distances and angular relationship of the visor, camera and eye are controlled to eliminate parallax from the field-of-view camera while also providing a stable arrangement permitting wide-angle scene viewing and accurate recordal of eye movements.

Claims

1. A system for viewing an external scene visually observed through at least one eye of an observer thereof comprising:

(a) helmet means for mounting on the head of an observer;

(b) a field-of-view camera mounted on said helmet and having a field-of-view camera axis generally perpendicular to the optic axis of the obserber'"'"'s eye in the sense that said field-of-view camera'"'"'s optic axis intersects said eye'"'"'s optic axis;

(c) an especially configured visor mounted on said helmet directly in front of said eye, said visor at least partially transparent to light from said scene transmitted to said eye of the observer along said optic axis and reflecting said light from said scene as a mirror image to said field-of-view camera; and

(d) adjustment means associated with said visor, said field-of-view camera and said helmet means for spacing the visor at equal distances between said eye and said field-of-view camera measured from said intersection of said optic axis, and adjusting the angle between said visor and said field-of-view camera axis, to be equal to the angle between said visor and said eye'"'"'s optic axis said angles being measured from the same side of said visor so that parallax is minimized to permit the point-of-view camera to accurately record said external scene as visualized by said eye.

2. The system of claim 1 wherein said visor includes an infrared reflective layer for reflecting light of about infrared frequencies along said field-of-view camera'"'"'s axis, said field-of-view camera being a monochromatic camera sensitive to said reflected light.

3. The system of claim 2 wherein said visor is a glass laminate including a glass substrate having said infrared layer as a coating on one surface thereof reflecting light of about infrared wavelength, a polycarbonate substrate adjacent said glass substrate on the side of said glass substrate opposite said infrared coating, and means to attach said polycarbonate substrate to said glass substrate.

4. The system of claim 3 wherein the thickness of said visor is no more than about 3 mm.

5. The system of claim 4 wherein said visor is sized to yield about a 45 degree vertical×

55 degree horizontal field-of-view.

6. The system of claim 5 wherein said visor has a vertical distance of about 4" and the focal length of the lens of said field-of-view camera is about 8 mm.

7. The system of claim 1 wherein said visor includes a metallic reflecting film on the backside of said visor for reflecting light of visible wavelength along said camera'"'"'s axis, said camera being a camera capable of recording visible light.

8. The system of claim 7 wherein said visor further includes a polarizing film adjacent said metallic film for transmitting polarized light to the eye of said observer, said camera having a polarized filter adjacent the lens thereof and a filter for preventing light of near infrared wavelength from being transmitted through the lens of said camera.

9. The system of claim 8 wherein said visor is a glass laminate including a glass substrate, an infrared layer applied to the front side of said visor facing the eye of said observer for reflecting light of about infrared wave length, a polycarbonate substrate adhesively secured to the back side of said glass substrate, a polarizing film secured to the back side of said polycarbonate substrate, and said metallic film affixed to the back side of said polarizing film.

10. The system of claim 9 wherein said polarizing film is removably clipped to said glass and polycarbonate substrates.

11. The system of claim 9 wherein said polarizing film is adhesively secured to the back side of said polycarbonate substrate.

12. The system of claim 9 wherein said visor is no more than about 4.5 mm thick.

13. The system of claim 12 wherein said visor is sized to yield about a 45 degree vertical×

55 degree horizontal field-of-view.

14. The system of claim 13 wherein said visor has a vertical distance of about 4" and the focal length of the lens of said field-of-view camera is about 8.0 mm.

15. The system of claim 1 further including eye tracking means for determining the point of gaze of said eye of said observer.

16. The system of claim 15 wherein said eye tracking means includes illuminator means for transmitting a light source at near infrared wavelength frequency in a given direction, an eye monitor camera disposed with its lens axis coaxial with said direction of said light source, said illuminator means reflected by said visor towards the pupil of said eye as a light beam and reflected back as a bright pupil disc and corneal reflection spot beam by said visor to said eye monitor camera whereby the corneal and pupil reflection of the eye of said observer is recorded as a point of gaze spot by said eye monitor camera and means for projecting said point of gaze spot onto said scene as recorded by said point-of-view camera.

17. The system of claim 16 wherein said visor includes an infrared reflective layer for reflecting light of about infrared frequencies along said camera'"'"'s axis, said camera being a monochromatic camera sensitive to said reflected light.

18. The system of claim 17 wherein said visor is a glass laminate including a glass substrate having said infrared layer as a coating on one surface thereof reflecting light of about infrared wavelength, a polycarbonate substrate adjacent said glass substrate on the side of said glass substrate opposite said infrared coating, and means to attach said polycarbonate substrate to said glass substrate.

19. The system of claim 18 wherein the thickness of said visor is no more than about 3 mm.

20. The system of claim 19 wherein said visor is sized to yield about a 45 degree vertical×

55 degree horizontal field-of-view.

21. The system of claim 20 wherein said visor has a vertical distance of about 4" and the focal length of the lens of said field-of-view camera is about 8 mm.

22. The system of claim 16 wherein said visor includes a metallic reflecting film on the backside of said visor for reflecting light of visible wavelength along said camera'"'"'s axis, said camera being a camera capable of recording visible light.

23. The system of claim 22 wherein said visor further includes a polarizing film adjacent said metallic film for transmitting polarized light to the eye of said observer, said camera haing a polarized filter adjacent the lens thereof and a filter for preventing light of near infrared wavelength from being transmitted through the lens of said camera.

24. The system of claim 23 wherein said visor is a glass laminate including a glass substrate, an infrared layer applied to the front side of said visor facing the eye of said observer for reflecting light of about infrared wave length, a polycarbonate substrate adhesively secured to the back side of said glass substrate, a polarizing film secured to the back side of said polycarbonate substrate, and said metallic film affixed to the back side of said polarizing film.

25. The system of claim 24 wherein said polarizing film is removably clipped to said glass and polycarbonate substrates.

26. The system of claim 24 wherein said polarizing film is adhesively secured to the back side of said polycarbonate substrate.

27. The system of claim 26 wherein said visor is no more than about 4.5 mm thick.

28. The system of claim 27 wherein said visor is sized to yield about a 45 degree vertical×

55 degree horizontal field-of-view.

29. The system of claim 28 wherein said visor has a vertical distance of about 4" and the focal length of the lens of said field-of-view camera is about 8 mm.

30. A head-mounted eye-movement system for monitoring an observer'"'"'s view of any external scene as seen through at least one of the observer'"'"'s eyes, said system comprising:

(a) a field-of-view camera positioned vertically on one side of the optic axis of said eye for recording said scene;

(b) eye tracking means including an eye tracking source of near infrared light for recording the position of said eye as said observer views said scene vertically positioned on the opposite side of the eye'"'"'s optic axis;

(c) a visor positioned vertically between said field-of-view camera and said eye tracker means at the intersection of said eye'"'"'s optic axis with said field-of-view camera'"'"'s optic axis, said visor transparent to visible light to permit said observer to view said scene while looking through said visor;

(d) optical coating means on said visor, said coating means reflecting said eye tracker light to actuate said eye tracking means while reflecting light from said scene to said field-of-view camera to simultaneously permit said field-of-view camera to record said scene.

31. The head-mounted system of claim 30 wherein said eye tracking means includes an eye tracker camera having an optic axis, said eye tracking source of light generally coaxial with said eye tracker camera'"'"'s optic axis.

32. The head-mounted system of claim 30 further including adjustment means for adjusting the distance between said observer'"'"'s eye and said visor to be approximately equal to the distance between the aperture of said field-of-view camera lens and said visor, and the angle formed between and by the intersection of said optic axis of said field-of-view camera with said visor being approximately equal to the angle formed between and by the intersection of said optic axis of said observer'"'"'s eye with said visor, said angles, for reference purposes, measured on the same side of said visor whereby parallax is minimized.

33. The head-mounted system of claim 32 wherein said eye tracking means includes an eye tracker camera having an optic axis, said eye tracking source of light generally coaxial with said eye tracker camera'"'"'s optic axis.

34. The head-mounted system of claim 33 wherein said eye tracker camera'"'"'s optic axis is approximately parallel to said field-of-view camera'"'"'s optic axis.

35. The head-mounted system of claim 32 wherein said field-of-view camera has an 8 mm focal length lens.

36. The head-mounted system of claim 35 wherein said eye tracker means is reflective to track the movement of said eye over a 55 degree horizontal and 45 degree vertical field-of-view.

37. The head-mounted system of claim 36 wherein said eye tracking means includes an eye tracker camera having an optic axis, said eye tracking source of light generally coaxial with said eye tracker camera'"'"'s optic axis.

38. The head-mounted system of claim 37 wherein said eye tracker camera'"'"'s optic axis is approximately parallel to said field-of-view camera'"'"'s optic axis.

39. The head-mounted system of claim 30 wherein said optical coating means includes an infrared optical coating for reflecting light having near infrared wavelength, said infrared optical coating reflecting said infrared source light on one side thereof for actuating said eye tracking means while reflecting scene light of near infrared wavelength to said field-of-view camera for recording said scene, said field-of-view camera being a monochromatic infrared camera.

40. The head-mounted system of claim 39 further including adjustment means for adjusting the distance between said observer'"'"'s eye and said visor to be approximately equal to the distance between the aperture of said field-of-view camera lens and said visor, and the angle formed between and by the intersection of said optic axis of said field-of-view camera with said visor being approximately equal to the angle formed between and by the intersection of said optic axis of said observer'"'"'s eye with said visor, said angles, for reference purposes, measured on the same side of said visor whereby parallax is minimized.

41. The head-mounted system of claim 40 wherein said eye tracking means includes an eye tracker camera having an optic axis, said eye tracking source of light generally coaxial with said eye tracker camera'"'"'s optic axis.

42. The head-mounted system of claim 41 wherein said eye tracker camera'"'"'s optic axis is approximately parallel to said field-of-view camera'"'"'s optic axis.

43. The head-mounted system of claim 30 wherein said optical coating means includes an infrared optical coating for reflecting light having near infrared wavelength on one side of said visor for actuating said eye tracking means and a visible light optical coating on the opposite side of said visor for reflecting scene light of visible wavelength to said point-of-view camera, said point-of-view camera being a camera capable of recording a visible light.

44. The head-mounted system of claim 43 wherein said visor has a polarizing film adjacent said visible light optical coating for polarizing said scene light, and said field-of-view camera having a polarizing filter lens and an infrared cut filter lens preventing transmission of light having near infrared wavelength to said field-of-view camera.

45. The head-mounted system of claim 44 further including adjustment means for adjusting the distance betweem said observer'"'"'s eye and said visor to be approximately equal to the distance between the aperture of said field-of-view camera lens and said visor, and the angle formed between and by the intersection of said optic axis of said field-of-view camera with said visor being approximately equal to the angle formed between and by the intersection of said optic axis of said observer'"'"'s eye with said visor, said angles, for reference purposes, measured on the same side of said visor whereby parallax is minimized.

46. The head-mounted system of claim 45 wherein said eye tracking means includes an eye tracker camera having an optic axis, said eye tracking source of light generally coaxial with said eye tracker camera'"'"'s optic axis.

47. The head-mounted system of claim 46 wherein said eye tracker camera'"'"'s optic axis is approximately parallel to said field-of-view camera'"'"'s optic axis.

48. The head-mounted system of claim 47 further including head position means for sensing the position of the head of said observer and means for combining data from said eye-tracker camera, said field-of-veiw camera and said head position means to determine said observer'"'"'s absolute point-of-gaze.

49. In a head-mounted eye monitor system including an eye tracker camera, an external eye tracker source of near infrared light, and a field-of-view camera for recording the external scene viewed by at least one eye of the observer, the improvement comprising:

(a) means for mounting at least the lens of said eye tracker camera, in fixed relationship to the head of the observer, vertically spaced from and on one side of the optic axis of said observer'"'"'s eye;

(b) means for mounting at least the lens of said field-of-view camera in fixed relationship to the head of the observer vertically spaced from and on the opposite side of the optic axis of said observer'"'"'s eye from that of said eye tracker camera;

(c) a visor positioned at the intersection of the optic axis of said observer'"'"'s eye with the optic axis of said field-of-view camera and transparent to visible light from said external scene; and

(d) reflective means on said visor for reflecting said eye tracker light from one side of said visor to said eye tracker camera for recording the positions of said observer'"'"'s eye and reflecting light from said external scene from the opposite side of said visor and in the opposite direction to said field-of-view camera for recording said external scene as viewed by said observer'"'"'s eye.

50. The system of claim 49 further including adjustment means for adjusting the distance between said observer'"'"'s eye and said visor to be approximately equal to the distance between the aperture of said field-of-view camera lens and said visor, and for adjusting the angle formed between and by the intersection of said optic axis of said field-of-view camera with said visor to be approximately equal to the angle formed between and by the intersection of said optic axis of said observer'"'"'s eye with said visor, said angles, for reference purposes, measured on the same side of said visor whereby parallax is minimized.

51. The head-mounted system of claim 50 wherein said eye tracking means includes an eye tracker camera having an optic axis, said eye tracking source of light generally coaxial with said eye tracker camera'"'"'s optic axis.

52. The head-mounted system of claim 51 wherein said eye tracker camera'"'"'s optic axis is approximately parallel to said field-of-view camera'"'"'s optic axis.

53. The head-mounted system of claim 52 wherein said optical coating means includes an infrared optical coating for reflecting light having near infrared wavelength, said infrared optical coating reflecting said infrared source light on one side thereof for actuating said eye tracking means while reflecting scene light or near infrared wavelength to said field-of-view camera for recording said scene, said field-of-view camera being a monochromatic infrared camera.

54. The head-mounted system of claim 52 wherein said optical coating means includes an infrared optical coating for reflecting light having near infrared wavelength on one side of said visor for actuating said eye tracking means and a visible light optical coating on the opposite side of said visor for reflecting scene light of visible wavelength to said point-of-view camera, said point-of-view camera being a camera capable of recording a visible light.

55. The head-mounted system of claim 54 wherein aid visor has a polarizing film adjacent said visible light optical coating for polarizing said scene light, and said field-of-view camera having a polarizing filter lens and an infrared cut filter lens preventing transmission of light having near infrared wavelength to said field-of-view camera.

56. An eye-movement monitoring system comprising

an eye-tracker camera,

an external eye-tracker source of near infrared light,

a field-of-view camera for recording the external scene viewed by at least one eye of an observer,

means for mounting at least the lens of said eyetracker camera, vertically spaced from and on one side of the optic axis of said observer'"'"'s eye;

means for mounting at least the lens of said field-of-view camera vertically spaced from and on the opposite side of the optic axis of said observer'"'"'s eye from that of said eye-tracker camera;

a visor positioned at the intersection of the optic axis of said observer'"'"'s eye with the optic axis of said field-of-view camera and transparent to visible light from said external scene; and

reflective means on said visor for reflecting said eye-tracker light from one side of said visor to said eyetracker camera for recording the positions of said observer'"'"'s eye and reflecting light from said external scene from the opposite side of said visor and in the opposite direction to said field-of-view camera for recording said external scene as viewed by said observer'"'"'s eye.

57. The eye-movement monitoring system of claim 56 wherein said means for mounting includes a mounting affixed to the head of said observer.