Eye imaging in head worn computing

• US 9,684,165 B2
• Filed: 10/27/2014
• Issued: 06/20/2017
• Est. Priority Date: 01/21/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Border, John N.
• Primary Examiner(s): Ben, Loha
• Application Number:
  US14/524,813
• Publication Number:
  US 20150205101A1
• Time in Patent Office: 967 Days
• Field of Search: 359630-634, 359636, 345 7- 9, 345156, 345207, 345419, 345420, 345633, 348 36, 348 47, 348 78, 351 41, 351158, 351205-207, 351209, 351210, 351215
• CPC Class Codes: A61B 3/0008 provided with illuminating means A61B3/117 takes precedence; goniolenses used for laser treatment A61F9/009; illuminating means for optical instruments G02B27/00
• CPC Class Codes: A61B 3/145 by video means
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/14 operating by reflection only
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/19 : Sensors therefor
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 7/144 : camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control

Abstract

Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user'"'"'s eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user'"'"'s eye and controlling displayed content in accordance therewith.

Claims

1. An image source for a head-worn display, comprising:

a digital light processing (DLP) display positioned to reflect on-pixel light in-line with transfer optics adapted to present the on-pixel light to an eye of a user as image light, the DLP display further positioned to reflect off-pixel light in-line with a dark light trap; and

a camera positioned to capture eye-image light originating as a reflection from the eye of the user, wherein, prior to being captured by the camera, the eye-image light reflects off of a plurality of mirrors of the DLP display and then off of a reflective surface positioned to reflect the eye-image light towards the camera.

2. The image source of claim 1, wherein the eye-image light is reflected off of off-pixel mirrors of the DLP display.

3. The image source of claim 1, wherein the eye-image light is reflected off of no-power-pixel mirrors of the DLP display.

4. The image source of claim 1, wherein the reflective surface is a partially reflective and partially transmissive surface.

5. The image source of claim 4, wherein the reflection and transmission properties are polarization dependent.

6. The image source of claim 1, wherein the eye-image light is captured by the camera simultaneously with image light being transferred to the eye of the user.

7. The image source of claim 1, wherein a subset of mirrors of the DLP display are dedicated to reflect eye-image light.