EYE IMAGE COLLECTION

• US 20170205875A1
• Filed: 01/17/2017
• Published: 07/20/2017
• Est. Priority Date: 01/19/2016
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Kaehler, Adrian
• Granted Patent: US 11,209,898 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 3/4053 based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/42 Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof

Abstract

Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image collection can include displaying a graphic along a path connecting a plurality of eye pose regions. Eye images at a plurality of locations along the path can be obtained, and an iris code can be generated based at least partly on at least some of the obtained eye images.

Claims

1. A wearable display system comprising:

an image capture device configured to capture eye images from a wearer of the wearable display system;

non-transitory memory configured to store the eye images;

a display comprising a plurality of eye pose regions; and

a processor in communication with the non-transitory memory and the display, the processor programmed to;

cause display of an avatar in a first eye pose region of the plurality of eye pose regions on the display;

obtain a first eye image of an eye from the image capture device, wherein the first eye image is associated with the first eye pose region;

determine that a first image quality metric of the first eye image passes a first image quality threshold;

cause display of the avatar in a second eye pose region of the plurality of eye regions on the display;

obtain a second eye image of the eye from the image capture device, wherein the second eye image is associated with second eye pose region;

determine that a second image quality metric of the second eye image passes a second image quality threshold;

generate an iris code for the eye based at least partly on the first eye image and the second eye image; and

utilize the generated iris code for a subsequent display of an image on the display or a biometric application by the wearable display system.

2. The wearable display system of claim 1, wherein the processor is further programmed to:

receive a mode of display for the avatar in the plurality of eye regions on the display.

3. The wearable display system of claim 2, wherein the mode of display comprises at least one of a random mode, a sequential mode, a flight mode, a blinking mode, a fluctuating mode, a story mode, or a combination thereof.

4. The wearable display system of claim 1, wherein the processor is further programmed to:

receive a mode of display for the avatar in the first eye region on the display.

5. The wearable display system of claim 1,

wherein the first image quality threshold corresponds to an image quality level for the first eye pose region, and

wherein the second image quality threshold corresponds to an image quality level for the second eye pose region.

6. The wearable display system of claim 1,

wherein the first image quality threshold corresponds to an image quality level for the first eye image, and

wherein the second image quality threshold corresponds to an image quality level for the second eye image.

7. The wearable display system of claim 1, wherein the processor is further programmed to:

cause display of the avatar in a third eye pose region of the plurality of eye regions on the display;

obtain a third eye image of the eye from the image capture device, wherein the third eye image is associated with third eye pose region;

determine that a third image quality metric of the third eye image does not pass a third image quality threshold.

8. The wearable display system of claim 7, wherein the processor is further programmed to:

obtain a fourth eye image of the eye from the image capture device, wherein the fourth eye image is associated with the third eye pose region; and

determine that a fourth image quality metric of the fourth eye image passes the third image quality threshold.

9. The wearable display system of claim 8,

wherein to determine the iris code for the eye, the processor is programmed to determine the iris code based at least partly on the first eye image, the second eye image, and the fourth eye image.

10. The wearable display system of claim 8,

wherein the processor is further programmed to:

combine the third eye image and the fourth eye image to obtain a hybrid eye image for the third eye pose region, and

wherein to determine the iris code for the eye, the processor is programmed to determine the iris code based at least partly on the first eye image, the second eye image, and the hybrid eye image.

11. A head mounted display system comprising:

an image capture device configured to capture eye images;

a display comprising a plurality of eye pose regions;

a processor in communication with the image capture device and the display, the processor programmed to;

cause display of a first graphic in a first eye pose region of the plurality of eye pose regions on the display;

obtain a first eye image in the first eye pose region from the image capture device;

determine that a first metric of the first eye image passes a first threshold;

cause display of a second graphic in a second eye pose region of the plurality of eye pose regions on the display;

obtain a second eye image in the second eye pose region from the image capture device; and

determine that a second metric of the second eye image passes a second threshold.

12. The head mounted display system of claim 11, wherein the processor is further programmed to:

determine an iris code based at least partly on the first eye image and the second eye image; and

utilize the determined iris code for a display of an image on the display or a biometric application by the head mounted display system.

13. The head mounted display system of claim 11, wherein the first eye image corresponds to a first eye pose of a user of the head mounted display system.

14. The head mounted display system of claim 11, wherein the display is configured to present the first graphic or the second graphic over a plurality of depth planes to a user of the head mounted display system, wherein the display is configured to present a light field image of the first graphic or the second graphic to a user of the head mounted display system, wherein the display comprises a plurality of stacked waveguides, or a combination thereof.

15. The head mounted display system of claim 11,

wherein the first graphic, when displayed in the first eye pose region of the plurality of eye pose regions on the display, directs the eye toward the first eye pose region of the plurality of eye pose regions on the display, and

wherein the second graphic, when displayed in the second eye pose region of the plurality of eye pose regions on the display, directs the eye toward the second eye pose region of the plurality of eye pose regions on the display.

16. The head mounted display system of claim 11,

wherein the second graphic, when displayed in the second eye pose region of the plurality of eye pose regions on the display, is configured to change an eye pose of the eye.

17. The head mounted display system of claim 11, wherein the first graphic or the second graphic comprises a graphical representation of a butterfly.

18. The head mounted display system of claim 11, wherein the processor is further programmed to:

receive a mode of display for the graphic in the plurality of eye pose regions on the display, wherein the mode of display comprises at least one of a random mode, a sequential mode, a flight mode, a blinking mode, a fluctuating mode, a story mode, or a combination thereof.

19. The head mounted display system of claim 11, wherein the first eye pose region is defined by an eye pose region comprising a minimum azimuthal deflection, a maximum azimuthal deflection, a minimum zenithal deflection, and a maximum zenithal deflection.

20. The head mounted display system of claim 11, wherein the first graphic is the same as the second graphic.