Eye imaging in head worn computing

• US 10,191,279 B2
• Filed: 03/18/2014
• Issued: 01/29/2019
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Nortrup, Edward H., Border, John N., Osterhout, Ralph F., Haddick, John D., Lohse, Robert Michael
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US14/218,606
• Publication Number:
  US 20150260986A1
• Time in Patent Office: 1,778 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0189 Sight systems
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user'"'"'s eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user'"'"'s eye and controlling displayed content in accordance therewith.

Claims

1. A head-worn computer with a see-through computer display through which a user is able to see a surrounding environment and upon which a user is able to see digitally presented content, comprising:

an eye imaging camera mounted in the head-worn computer at a position to capture an image of an eye of the user;

an eye illumination system mounted in the head-worn computer at a position to illuminate the eye such that an eye glint is produced and reflected from the eye of the user towards the eye imaging camera;

a processor, in the head-worn computer, adapted to compute a position of the eye from the image of the eye, as determined by a relative position of the eye glint to a portion of the eye, and to compare the position of the eye with dimensions of a field of view of the see-through computer display to determine a position of the eye with respect to the field of view;

the processor further adapted to establish a virtual target line in a direction that intersects a forward direction of the eye and the field of view, forming a field of view intersection; and

causing content to display at the field of view intersection such that the content is aligned with a viewing perspective of the user.

2. The head-worn computer of claim 1, wherein the eye imaging camera is positioned to capture the image of the eye through an optical axis in-line with delivery optics adapted to present image content to the eye of the user.

3. The head-worn computer of claim 1, further comprising a reflective image display, wherein the image of the eye reflects off of the reflective image display prior to being captured by the eye imaging camera.

4. The head-worn computer of claim 1, further comprising a reflective surface positioned between an image display and the eye imaging camera, wherein the eye imaging camera captures the image of the eye after it reflects off of the reflective surface.

5. The head-worn computer of claim 1, further comprising an emissive display and a reflective surface, wherein the eye imaging camera captures the image of the eye after it reflects off of the reflective surface.

6. The head-worn computer of claim 5, wherein the emissive display is an OLED emissive display.

7. The head-worn computer of claim 5, wherein the emissive display is an LED emissive display.

8. The head-worn computer of claim 1, wherein the content comprises an advertisement.

9. The head-worn computer of claim 8, wherein the processor further assesses an amount of time the eye of the user is aligned with the content.

10. The head-worn computer of claim 9, wherein the amount of time is compared with a pre-determined period of time to determine a compensation amount due to an advertiser.