Eye imaging in head worn computing

• US 9,885,868 B2
• Filed: 10/27/2014
• Issued: 02/06/2018
• Est. Priority Date: 01/21/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Border, John N.
• Primary Examiner(s): Ben, Loha
• Application Number:
  US14/524,930
• Publication Number:
  US 20150205104A1
• Time in Patent Office: 1,198 Days
• Field of Search: 359609, 359625, 359629, 359630, 359634, 359636, 351202, 351204-206, 351209-211, 345 7- 9, 345156, 345419, 345630, 348 58, 348 77, 348 78, 348115, 362 972, 362 973
• CPC Class Codes: A61B 3/0008 provided with illuminating means A61B3/117 takes precedence; goniolenses used for laser treatment A61F9/009; illuminating means for optical instruments G02B27/00
• CPC Class Codes: A61B 3/145 by video means
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/14 operating by reflection only
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/19 : Sensors therefor
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 7/144 : camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control

Abstract

Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user'"'"'s eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user'"'"'s eye and controlling displayed content in accordance therewith.

Claims

1. An eye-imaging system for a head-worn display, comprising:

a display adapted to produce image light, the display positioned to project the image light in-line with transfer optics adapted to present the image light to an eye of a user;

an IR light source positioned to illuminate the eye with an IR light; and

a camera positioned to capture eye-image light that originates as a reflection of the IR light off of the eye, wherein the eye-image light travels in-line with an optical path traveled by the image light in the transfer optics and wherein the eye-image light follows an optical path that does not involve the display.

4. An eye-imaging system of claim 1, for a head-worn display, comprising:

a display adapted to produce image light, the display positioned to project the image light in-line with transfer optics adapted to present the image light to an eye of a user;

an IR light source positioned to illuminate the eye with an IR light; and

a camera positioned to capture eye-image light that originates as a reflection of the IR light off of the eye, wherein the eye-image light travels in-line with an optical path traveled by the image light in the transfer optics and wherein the display is a front lit reflective display.

2. An eye-imaging system for a head-worn display, comprising:

a display adapted to produce image light, the display positioned to project the image light in-line with transfer optics adapted to present the image light to an eye of a user;

an IR light source positioned to illuminate the eye with an IR light; and

a camera positioned to capture eye-image light that originates as a reflection of the IR light off of the eye, wherein the eye-image light travels in-line with an optical path traveled by the image light in the transfer optics and wherein the camera is positioned in a dark light trap.

3. The eye-imaging system of claim 2, wherein the dark-light trap includes a recess and the camera is positioned inside of the recess.