See-through computer display systems

• US 9,746,676 B2
• Filed: 06/17/2015
• Issued: 08/29/2017
• Est. Priority Date: 01/21/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Shams, Nima L., Haddick, John D., Lohse, Robert Michael, Border, John N., Osterhout, Ralph F.
• Primary Examiner(s): CHOI, WILLIAM C
• Application Number:
  US14/742,249
• Publication Number:
  US 20160018648A1
• Time in Patent Office: 804 Days
• Field of Search: 359630, 345 7- 9
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0169 Supporting or connecting means other than the external walls
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G02B 27/281 used for attenuating light intensity, e.g. comprising rotatable polarising elements
• CPC Class Codes: G02B 27/286 for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another G02B5/3083 takes precedence; light guide coupling means utilising polarising elements G02B6/34
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/203 for portable computers, e.g. for laptops
• CPC Class Codes: G06F 1/206 comprising thermal management
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0317 : in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/03545 : Pens or stylus
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10028 : Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2219/016 : Exploded view
• CPC Class Codes: G06T 7/529 : from texture
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/36 : Indoor scenes
• CPC Class Codes: G06V 20/39 : Urban scenes
• CPC Class Codes: G10L 15/20 : Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Aspects of the present invention relate to providing see-through computer display optics.

Claims

1. A method for searching for a user identified pattern using a head worn computer that includes a sensor, comprising:

causing a user to select an item in a search mode of the head-worn computer (“

HWC”

);

causing the HWC to gather data with the sensor, wherein the sensor is adapted to collect infrared light, and analyzing the data to compare patterns in the data to the selected item; and

causing the HWC to alert the user when a potential match occurs between a pattern in the gathered data and the selected item.

2. The method of claim 1 wherein the sensor is a camera that captures images of the environment surrounding the user and the target pattern is a portion of an image indicated by the user.

3. The method of claim 2 wherein the portion of an image is an object shape.

4. The method of claim 2 wherein the portion of an image is a color.

5. The method of claim 2 wherein the user indicates the target pattern by pointing to a portion of an image.

6. The method of claim 2 wherein the user indicates the target pattern by circling a portion of an image.

7. The method of claim 2 wherein the camera is an infrared or ultraviolet camera.

8. The method of claim 1 wherein the sensor is a camera that captures images of the environment surrounding the user and the target pattern is text.

9. The method of claim 8 wherein the environment is a retail setting or a warehouse.

10. The method of claim 8 wherein the text is associated with navigation.

11. The method of claim 1 wherein the user identifies the target pattern from previously captured data.

12. The method of claim 1 wherein the user identifies the target pattern from live data being captured by the sensors on the HWC.

13. The method of claim 1 wherein the sensor is a microphone that captures sound in the surrounding environment and the target pattern is a target sound.

14. The method of claim 13 wherein the target sound is a spoken word and the user identifies the target sound by speaking the word.

15. The method of claim 13 wherein the user identifies the target sound from a previously captured audio recording.

16. The method of claim 1 wherein the sensors includes a rangefinder or a camera capable of providing a depth and the target pattern includes a size of an object.