Blue light adjustment for biometric security

• US 10,127,369 B2
• Filed: 03/03/2017
• Issued: 11/13/2018
• Est. Priority Date: 03/07/2016
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Kaehler, Adrian
• Primary Examiner(s): Wang, Carol
• Application Number:
  US15/449,780
• Publication Number:
  US 20170255766A1
• Time in Patent Office: 620 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: G06V 40/45 Detection of the body part being alive

Abstract

Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.

Claims

1. A head mounted display system configured to project variable levels of blue light to an eye of a user, the display system comprising:

a frame configured to be wearable on the head of the user;

a display configured to project at least blue light into the eye of the user and to modify an intensity of the blue light relative to an intensity of non-blue light;

a camera configured to capture a first image of the eye while the display projects light at a first ratio of intensity of blue light to non-blue light into the eye and configured to capture a second image of the eye while the display projects a second ratio of intensity of blue light to non-blue light different from the first ratio into the eye; and

a hardware processor programmed to;

analyze the images from the camera to determine a change in a pupil parameter between the second image and the first image passes a biometric application threshold;

based at least in part on the determined change, instruct the display to modify a ratio of the intensity of blue light to non-blue light and instruct the camera to capture a third image of the eye;

determine that a change in the pupil parameter between the third image and the first image or the second image matches a biometric characteristic of a human individual; and

based on the determination that a change in the pupil parameter between the third image and the first image or the second image matches a biometric characteristic of a human individual, determine an identity of the human individual.

2. The head mounted display system of claim 1, wherein the display comprises a scanning fiber projector.

3. The head mounted display system of claim 1, wherein the hardware processor is programmed to restrict access to a system application if the identity of the individual does not match an identity of an individual authorized to use the system application.

4. The head mounted display system of claim 3, wherein the system application comprises displaying images as if at a plurality of depths.

5. The head mounted display system of claim 1, wherein the display is configured to modify the intensity of light in a wavelength range of between 445 nm and 525 nm.

6. The head mounted display system of claim 1, wherein the display is configured to increase the second ratio of intensity of blue light to non-blue light by flashing blue light for longer than 10 ms.

7. The head mounted display system of claim 1, wherein the display is configured to project light at two or more colors.

8. The head mounted display system of claim 1, wherein the display is configured to display content as if at a plurality of depths from a user.

9. The head mounted display system of claim 1, wherein the display comprises a plurality of stacked waveguides.

10. The head mounted display system of claim 9, wherein to instruct the display to modify the intensity of blue light relative to non-blue light, the hardware processor is programmed to instruct an image injection device to increase a proportion of blue light injected into a corresponding stacked waveguide of the plurality of stacked waveguides.

11. The head mounted display system of claim 1, wherein the hardware processor is further configured to form an individual biometric model comprising at least one of a first rise time of a pupillary response to the first ratio of intensity of blue light to intensity of non-blue light, a first decay time of the pupillary response to the first ratio of intensity of blue light to intensity of non-blue light, a first delay time of the pupillary response to the first ratio of intensity of blue light to intensity of non-blue light, a first rise curve of the pupillary response to the first ratio of intensity of blue light to intensity of non-blue light, a first decay curve of the pupillary response to the first ratio of intensity of blue light to intensity of non-blue light, a second rise time of a pupillary response to the second ratio of intensity of blue light to intensity of non-blue light, a second decay time of the pupillary response to the second ratio of intensity of blue light to intensity of non-blue light, a second delay time of the pupillary response to the second ratio of intensity of blue light to intensity of non-blue light, a second rise curve of the pupillary response to the second ratio of intensity of blue light to intensity of non-blue light, or a second decay curve of the pupillary response to the second ratio of intensity of blue light to intensity of non-blue light.

12. The head mounted display system of claim 1, wherein the hardware processor is programmed to calculate a cognitive load score based on a change in the pupil parameter.

14. The head mounted display system of claim 1, wherein the hardware processor is programmed to:

determine a current change in the pupil parameter of an individual wearing the head mounted display system;

correlate the current change in the pupil parameter with a modelled change in the pupil parameter of an individual biometric model to generate a cognitive load pupillary response, wherein the modelled change comprises a change in a pupil parameter under a normal cognitive load; and

determine a level of cognitive load based on the cognitive load pupillary response.

13. The head mounted display system of 1, wherein a change in the pupil parameter comprises an increased pupil radius.

15. A method for identifying a human individual using a wearable display system comprising a camera coupled to computing hardware, the wearable display system comprising a stack of waveguides configured to direct light into the eye, the method comprising:

directing reference light comprising a first ratio of an intensity of blue light to an intensity of non-blue light into the eye;

using the camera, capturing a first image of the eye while reference light is directed into the eye;

directing modified light comprising a second ratio of an intensity of blue light to an intensity of non-blue light different from the first ratio into the eye;

using the camera, capturing a second image of the eye while modified light is directed into the eye;

detecting a change in a pupil parameter of the eye between the first image and the second image;

determining that the detected change in the pupil parameter passes a biometric application threshold;

based at least in part on the determination, modifying a ratio of the intensity of blue light to non-blue light;

using the camera, capturing a third image of the eye;

determining that a change in the pupil parameter between the third image and the first image or the second image matches a biometric characteristic of a human individual; and

based on the determination that a change in the pupil parameter between the third image and the first image or the second image matches a biometric characteristic of a human individual, identifying the human individual.

16. The method of claim 15 further comprising allowing access to a system application based on the change in the pupil parameter between the third image and the first image or the second image.

17. The method of claim 16, wherein allowing access to a system application based on the change in the pupil parameter between the third image and the first image or the second image comprises at least one of determining a cognitive load, estimating an eye pose, generating an iris code, or determining an emotional response.

18. The method of claim 15, wherein the pupil parameter comprises at least one of a maximum radius of the pupil, a minimum radius of the pupil, a rise time of a pupillary response to the second ratio of intensity of blue light to intensity of non-blue light, a decay time of a pupillary response to the second ratio of intensity of blue light to intensity of non-blue light, or a delay time of a pupillary response to the second ratio of intensity of blue light to intensity of non-blue light.

19. The method of claim 15, further comprising determining that the change in the pupil parameter between the third image and the first image or the second image matches a change in pupil parameter of at least one of an unconscious human individual, a sleeping individual, a tired individual, an inebriated individual, or an individual under the influence of cognition-impairing substances.

20. The method of claim 15, further comprising determining that an image quality metric measured from the second image exceeds an image quality threshold, the image quality metric comprising a distance between a part of the eye and an eyelid.