HEAD MOUNTED DISPLAY SYSTEM CONFIGURED TO EXCHANGE BIOMETRIC INFORMATION

• US 20170278122A1
• Filed: 03/17/2017
• Published: 09/28/2017
• Est. Priority Date: 03/22/2016
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Kaehler, Adrian
• Granted Patent: US 10,867,314 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06Q 30/0217 involving input on products or services in exchange for incentives or rewards
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/02 Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
• CPC Class Codes: H04W 12/33 using wearable devices, e.g. using a smartwatch or smart-glasses

Abstract

Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. After displaying a consent request regarding biometric information with the head mounted display system, a response to the consent request that includes a consent indication regarding an aspect of the biometric information can be determined. After obtaining biometric information from a wearer utilizing e.g., a camera of the head mounted display, and processing the biometric information, a biometric information processing result can be generated. The result can be communicated from the head mounted display system to another computing device.

Claims

1. A head mounted display system comprising:

a first image capture device configured to capture a plurality of eye images of an eye;

a second image capture device configured to capture a plurality of outside-world images;

a display configured to display virtual images to the eye of a wearer of the head mounted display; and

a hardware processor programmed to;

communicate a consent request to the wearer of the head mounted display, the request comprising a plurality of consent categories for biometric information of the wearer;

receive a response to the consent request;

determine that the response includes a consent indication from the wearer of the head mounted display, the consent indication regarding a consent category that the wearer has indicated agreement;

obtain the plurality of eye images of the wearer of the head mounted display captured by the first image capture device; and

in response to a request for biometric information from a biometric information acquirer computing device, transmit the plurality of eye images, to the biometric information acquirer computing device, based at least partly on the consent category that the wearer has indicated agreement and the request for biometric information.

2. The head mounted display system of claim 1, wherein the plurality of consent categories for biometric information of the wearer comprises at least one of an offer category, a partial sharing category, a complete sharing category, or any combination thereof.

3. The head mounted display system of claim 2, wherein the consent category that the wearer has indicated agreement corresponds to the complete sharing category.

4. The head mounted display system of claim 2, wherein the partial sharing category includes sharing of the plurality of eye images regarding an item brand or an item product in a retail store.

5. The head mounted display system of claim 1,

wherein the hardware processor is further programmed to:

perform a biometric data operation on the plurality of eye images to obtain biometric information, and

wherein to transmit the plurality of eye images in response to the request for biometric information form the biometric information acquirer computing device, the hardware processor is further programmed to;

in response to the request for biometric information from the biometric information acquirer computing device, transmit a portion of the biometric information obtained based at least partly on the consent category that the wearer has indicated agreement.

6. The head mounted display system of claim 5, wherein the biometric information corresponds to at least one of eye patterns, eye movements, eye fixations, or eye browsing history.

7. The head mounted display system of claim 6, wherein to perform the biometric data operation on the plurality of eye images to obtain biometric information, the hardware processor is further programmed to:

perform a pose estimation or iris code generation using the plurality of eye images.

8. The head mounted display system of claim 1, wherein the hardware processor is further programmed to:

display the consent request utilizing the head mounted display system.

9. The head mounted display system of claim 1, wherein the hardware processor is further programmed to:

in response to receiving the response to the consent request, display a plurality of biometric exchange offers utilizing the head mounted display,

wherein the plurality of biometric exchange offers comprises offers associated with biometric information regarding items from an electronic catalog or biometric information based on a location of the wearer of the head mounted display system.

10. The head mounted display system of claim 9, wherein the hardware processor is further programmed to:

filter the plurality of biometric exchange offers based on a threshold exchange rate.

11. The head mounted display system of claim 9, wherein the hardware processor is further programmed to:

filter the plurality of biometric exchange offers based on an exclusion of an aspect of biometric information, wherein the exclusion is specified by the wearer of the head mounted display system.

12. The head mounted display system of claim 9, wherein the hardware processor is further programmed to:

filter the plurality of biometric exchange offers based on an inclusion of an aspect of an offer, wherein the inclusion is specified by the wearer of the head mounted display system.

13. The head mounted display system of claim 1, wherein the hardware processor is further programmed to:

form a secure connection between the head mounted display system and the biometric information acquirer computing device.

14. The head mounted display system of claim 1, wherein the hardware processor is further programmed to:

process the plurality of eye images captured by the first image capture device and the plurality outside-world images captured by the second image capture device to obtain a behavioral characteristic regarding the wearer of the head mounted display system.

15. The head mounted display system of claim 14, wherein the behavioral characteristic regarding the wear comprises an item brand or an item product in a retail store looked at by the eye of the wearer in the plurality of eye images determined using the plurality of outside-world images.

16. The head mounted display system of claim 14, wherein the hardware processor is further programmed to:

display a second consent request regarding the obtained behavioral characteristic utilizing the head mounted display system.

17. The head mounted display system of claim 16, wherein the hardware processor is further programmed to:

in response to receiving the response to the second consent request regarding the obtained behavioral characteristic, display a second plurality of biometric exchange offers utilizing the head mounted display,

wherein the second plurality of biometric exchange offers comprises;

offers associated with biometric information regarding items from an electronic catalog,

offers associated with biometric information based on a location of the wearer of the head mounted display system,

offers associated with behavioral characteristics of the wearer of the head mounted display system, or

any combination thereof.

18. The head mounted display system of claim 1,

wherein the display is configured to display the consent request to the wearer of the head mounted display, and

wherein to communicate the consent request to the wearer, the hardware processor is configured to display the consent request to the wearer using the display.

19. The head mounted display system of claim 1, wherein the display is configured to present a plurality of depth planes to the wearer or to present a light field image to the wearer.

20. The head mounted display system of claim 1, wherein the display comprises a plurality of stacked waveguides.