Method and apparatus for biometric data capture

• US 9,329,689 B2
• Filed: 03/16/2011
• Issued: 05/03/2016
• Est. Priority Date: 02/28/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Osterhout, Ralph F., Lohse, Robert Michael
• Primary Examiner(s): Reagan, James A
• Application Number:
  US13/049,868
• Publication Number:
  US 20110222745A1
• Time in Patent Office: 1,875 Days
• Field of Search: 705/14.58, 705/1, 705/14.48, 382/117, 348/78
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

A method and apparatus for biometric data capture are provided. The apparatus includes in interactive head-mounted eyepiece worn by a user that includes an optical assembly through which a user views a surrounding environment and displayed content. An integrated processor handles content for display to the user and an optical sensor captures biometric data when the eyepiece is positioned so that a nearby individual is proximate to the eyepiece. Biometric data is captured using the eyepiece and is transmitted to a remote processing facility for interpretation. The remote processing facility interprets the captured biometric data and generates display content based on the interpretation. This display content is delivered to the eyepiece and displayed to the user. Biometric data may include but is not limited to, an iris image, a voice sample and a facial image.

Claims

1. An apparatus for biometric data capture, comprising:

an interactive head-mounted display device including an optical assembly configured to display virtual content and through which at least a portion of a surrounding environment is viewable, an integrated processor for processing the virtual content for display, an integrated image source for introducing the virtual content to the optical assembly, and an integrated optical sensor assembly for capturing biometric data from an individual nearby a user of the interactive head-mounted display device; and

an integrated communications facility configured to transmit the captured biometric data to a facility, and receive from the facility display content for display via the optical assembly, the display content comprising information regarding the individual based on the captured biometric data.

2. The apparatus of claim 1, wherein the integrated optical sensor includes a camera mounted on the interactive head-mounted display device for obtaining biometric images of the individual nearby the user, wherein the integrated communications facility includes a transmission facility for transmitting obtained biometric images to a remote computing facility, and wherein the display content comprises information regarding a positive identification of the individual based on comparing the transmitted biometric data to previously stored biometric data.

3. On an interactive head-mounted display device comprising an optical assembly configured to display virtual content and through which at least a portion of a surrounding environment is viewable, an integrated processor for processing the virtual content for display, an integrated image source for introducing the virtual content to the optical assembly, an integrated optical sensor assembly, and an integrated communications facility, a method for biometric data capture, the method comprising:

capturing, via the integrated optical sensor assembly, biometric data from an individual positioned proximate to a user of the interactive head-mounted display device;

transmitting the captured biometric data to a facility;

receiving from the facility display content comprising information regarding the individual based on an interpretation of the captured biometric data; and

displaying the display content via the optical assembly.

4. The method of claim 3, wherein the display content comprises a report of results of the interpretation of the captured biometric data.

5. The method of claim 4, wherein the report comprises information regarding an identity of the individual based on the captured biometric data.

6. The method of claim 4, wherein the report indicates whether the captured biometric data of the individual proximate to the user matches previously captured biometric data stored in a database.

7. The method of claim 4, wherein the report comprises a request for the user to capture additional biometric data of the individual.

8. The method of claim 7, wherein the additional biometric data requested comprises one or more of an iris image and an audio sample.

9. The method of claim 7, wherein the additional biometric data requested comprises one or more of a facial image and an audio sample.

10. The method of claim 3, wherein the display content comprises social network information about the individual.

11. The method of claim 3, wherein the step of capturing biometric data comprises capturing facial feature data.

12. The method of claim 3, further comprising identifying a location of the individual proximate to the user of the interactive head-mounted display device.

13. An apparatus for biometric data capture, comprising:

an interactive head-mounted display device including an optical assembly configured to display virtual content and through which at least a portion of a surrounding environment is viewable, an integrated processor for processing the virtual content for display, an integrated image source for introducing the virtual content to the optical assembly, and an integrated optical sensor assembly for capturing facial feature data from an individual nearby a user of the interactive head-mounted display device; and

an integrated communications facility configured to transmit the captured facial feature data to a facility, and receive from the facility display content for display via the optical assembly, the display content comprising information regarding an identity of the individual based on the captured facial feature data.

14. The apparatus of claim 13, wherein the integrated optical sensor includes a camera mounted on the interactive head-mounted display device for obtaining facial feature images of the individual nearby the user, and wherein the integrated communications facility includes a transmission facility for transmitting obtained facial feature images to a remote computing facility, and wherein the display content comprises information regarding a positive identification of the individual based on comparing the transmitted facial feature data to previously stored facial feature data.

15. The apparatus of claim 13, wherein the interactive head-mounted display device further comprises one or more microphones for capturing audio data from the individual nearby the user.

16. The apparatus of claim 13, wherein the interactive head-mounted display device further comprises a microphone array for capturing audio data from the individual nearby the user.

17. The apparatus of claim 13, wherein the integrated optical sensor is adapted for capturing iris images of the individual nearby the user.

18. The apparatus of claim 13, wherein the display content comprises social network information about the individual.