See-through computer display systems

• US 10,379,365 B2
• Filed: 04/17/2017
• Issued: 08/13/2019
• Est. Priority Date: 01/21/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Inventors: Osterhout, Ralph F., Border, John N., Lohse, Robert Michael, Haddick, John D., Shams, Nima L.
• Primary Examiner(s): Choi, William
• Application Number:
  US15/488,916
• Publication Number:
  US 20170220865A1
• Time in Patent Office: 848 Days
• Field of Search: 359630, 345 7- 9
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0169 Supporting or connecting means other than the external walls
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G02B 27/281 used for attenuating light intensity, e.g. comprising rotatable polarising elements
• CPC Class Codes: G02B 27/286 for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another G02B5/3083 takes precedence; light guide coupling means utilising polarising elements G02B6/34
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/203 for portable computers, e.g. for laptops
• CPC Class Codes: G06F 1/206 comprising thermal management
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0317 : in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/03545 : Pens or stylus
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10028 : Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2219/016 : Exploded view
• CPC Class Codes: G06T 7/529 : from texture
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/36 : Indoor scenes
• CPC Class Codes: G06V 20/39 : Urban scenes
• CPC Class Codes: G10L 15/20 : Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Aspects of the present invention relate to providing see-through computer display optics.

Claims

1. A method comprising:

receiving, from a user of a head worn computer having one or more sensors, a selection of a target pattern that is detectable by the head worn computer, wherein the target pattern identifies a size of an object;

receiving data via the one or more sensors, the data comprising one or more patterns;

developing a depth map based on the data, the depth map indicative of a size of an object in an environment surrounding the head worn computer; and

generating an alert in response to a determination, based on the depth map, that a potential match exists between a pattern in the data and the target pattern.

2. The method of claim 1 wherein the one or more sensors is a camera that captures images of the environment surrounding the head worn computer and the target pattern comprises a portion of an image indicated by a user of the head worn computer.

3. The method of claim 2 wherein the portion of the image identifies an object shape.

4. The method of claim 2 wherein the portion of the image identifies a color.

5. The method of claim 2 wherein the user indicates the target pattern by pointing to the portion of the image.

6. The method of claim 2 wherein the user indicates the target pattern by circling the portion of the image.

7. The method of claim 2 wherein the camera comprises an infrared camera or an ultraviolet camera.

8. The method of claim 1 wherein the one or more sensors is a camera that captures images of the environment surrounding the head worn computer and the target pattern comprises text.

9. The method of claim 8 wherein the environment comprises a retail setting or a warehouse.

10. The method of claim 8 wherein the text is associated with navigation.

11. The method of claim 1 wherein the user identifies the target pattern from previously captured data.

12. The method of claim 1 wherein the user identifies the target pattern from live data captured by the one or more sensors.

13. The method of claim 1 wherein the one or more sensors includes a rangefinder or a depth camera and the target pattern includes the size of the object.

14. A method comprising:

receiving, from a user of a head worn computer having one or more sensors, a selection of a target pattern that is detectable by the head worn computer;

receiving data via the one or more sensors, the data comprising one or more patterns;

developing a depth map based on the data, the depth map indicative of an object in an environment surrounding the head worn computer; and

generating an alert in response to a determination, based on the depth map, that a potential match exists between a pattern in the data and the target pattern,

wherein the one or more sensors is a microphone that captures sound in the environment and the target pattern comprises a target sound.

15. The method of claim 14 wherein the target sound comprises a spoken word and a user of the head worn computer identifies the target sound by speaking the spoken word.

16. The method of claim 14 wherein a user of the head worn computer identifies the target sound from a previously captured audio recording.