Virtual retinal display with eye tracking

• US 6,560,028 B2
• Filed: 02/15/2002
• Issued: 05/06/2003
• Est. Priority Date: 01/20/1998
• Status: Expired due to Term

• Current Assignee: University of Washington
• Original Assignee: University of Washington
• Inventors: Johnston, Richard S., Melville, Charles D.
• Primary Examiner(s): Mack, Ricky
• Application Number:
  US10/077,158
• Publication Number:
  US 20020097498A1
• Time in Patent Office: 445 Days
• Field of Search: 359/630, 359/631, 359/633, 345/7, 345/8, 351/206, 351/209, 351/211, 351/246, 382/117
• US Class Current: 359/630
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 7/287 including a sight line detecting device
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

Light emitted from a virtual retinal display light source passes through a beamsplitter to a scanning subsystem and on to an eyepiece and the viewer'"'"'s eye. Some of the light is reflected from the viewer'"'"'s eye passing back along the same path. Such light however is deflected at the beamsplitter toward a photodetector. The reflected light is detected and correlated to the display scanner'"'"'s position. The content of the reflected light and the scanner position for such sample is used to generate a map of the viewer'"'"'s retina. Such map includes ‘landmarks’ such as the viewer'"'"'s optic nerve, fovea, and blood vessels. The map of the viewer'"'"'s retina is stored and used for purposes of viewer identification. The viewer'"'"'s fovea position is monitored to track where the viewer is looking.

Claims

1. A system for authorizing a user access to a computer system, comprising:

an image source for generating light;

a lensing system having an input aligned to the image source for receiving the generated light, the lensing system having an output adapted for transmitting light to a viewer'"'"'s eye, the lensing system defining an optical path from the input to the output, the lensing system comprising a variably transmissive eyepiece which maintains contrast between the transmitted light and an ambient lighting;

a detector which generates a signal responsive to light reflected from the viewer'"'"'s eye; and

a processor receiving the signal and generating a map of the viewer'"'"'s eye based upon the signal, the processor comparing the generated map to a stored map to identify a set of access privileges corresponding to the viewer enabling the viewer to access a computer system.

2. A method of authorizing a user access to a device, comprising:

scanning light onto a retina of the user to form a virtual image;

receiving returning light reflected from the user'"'"'s eye;

deriving a map of features of the user'"'"'s eye from the returning light; and

processing the map to determine whether the user is authorized access to the device.

3. The method of claim 2, wherein said processing comprises:

comparing the derived map to a stored map to identify the user; and

determining whether the identified user has access privilege to the device.

4. The method of claim 2, wherein said processing comprises:

comparing the derived map to a stored map to identify the user; and

implementing a set of access privileges corresponding to the identified user enabling the user to access the device.

5. A system for authorizing a user access to a device, comprising:

means for scanning light onto a retina of the user to form a virtual image;

means for receiving returning light reflected from the user'"'"'s eye;

means for deriving a map of features of the user'"'"'s eye from the returning light;

means for comparing the derived map to a stored map to identify the user; and

means for implementing a set of access privileges corresponding to the identified user enabling the user to access the device.

6. An apparatus for authorizing a user access to a device, the apparatus receiving an image data signal for generating a virtual image upon a viewer'"'"'s eye, the apparatus comprising:

an image light source which modulates image light as a function of the image data signal to output modulated image light which defines the virtual image in a sequence of display pixels;

a scanner receiving the modulated visible light, the scanner deflecting the received visible light along a raster pattern, the scanner receiving a synchronization signal correlating to timing of a portion of the raster pattern;

a photodetector;

wherein the scanner receives returning light reflected from the viewer'"'"'s eye, the scanner deflecting the returning light;

a beamsplitter receiving the deflected returning light from the scanner, the beamsplitter directing said deflected returning light toward the photodetector, the photodetector generating a first signal in response to detection of the returning light;

a processor receiving the first signal and the synchronization signal, for correlating samples of the first signal to a timing position within the synchronization signal;

means for generating a map of the viewer'"'"'s eye based upon the first signal and the synchronization signal;

means for storing the map as a first map, and means for comparing a second map to the first map to determine whether the first map and second map correspond to a same eye; and

means for implementing a set of access privileges corresponding to the identified user enabling the user to access the device.