SEE-THROUGH COMPUTER DISPLAY SYSTEMS

• US 20160018648A1
• Filed: 06/17/2015
• Published: 01/21/2016
• Est. Priority Date: 01/21/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Osterhout, Ralph F., Border, John N., Lohse, Robert Michael, Haddick, John D., Shams, Nima L.
• Granted Patent: US 9,746,676 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0169 Supporting or connecting means other than the external walls
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G02B 27/281 used for attenuating light intensity, e.g. comprising rotatable polarising elements
• CPC Class Codes: G02B 27/286 for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another G02B5/3083 takes precedence; light guide coupling means utilising polarising elements G02B6/34
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/203 for portable computers, e.g. for laptops
• CPC Class Codes: G06F 1/206 comprising thermal management
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0317 : in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/03545 : Pens or stylus
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10028 : Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2219/016 : Exploded view
• CPC Class Codes: G06T 7/529 : from texture
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/36 : Indoor scenes
• CPC Class Codes: G06V 20/39 : Urban scenes
• CPC Class Codes: G10L 15/20 : Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Aspects of the present invention relate to providing see-through computer display optics.

Claims

1. A method for searching for a user identified pattern using a head worn computer that includes sensors, comprising:

a. the user selecting a search mode;

b. the user identifying a target pattern that is detectable by the sensors;

c. the HWC gathering data with the sensors and analyzing the data to compare patterns in the data to the target pattern; and

d. the HWC alerting the user when a potential match occurs between a pattern in the gathered data and the target pattern.

2. The method of claim 1 wherein the sensor is a camera that captures images of the environment surrounding the user and the target pattern is a portion of an image indicated by the user.

3. The method of claim 2 wherein the portion of an image is an object shape.

4. The method of claim 2 wherein the portion of an image is a color.

5. The method of claim 2 wherein the user indicates the target pattern by pointing to a portion of an image.

6. The method of claim 2 wherein the user indicates the target pattern by circling a portion of an image.

7. The method of claim 1 wherein the sensor is a camera that captures images of the environment surrounding the user and the target pattern is text.

8. The method of claim 7 wherein the environment is a retail setting or a warehouse.

9. The method of claim 7 wherein the text is associated with navigation.

10. The method of claim 2 wherein the camera is an infrared or ultraviolet camera.

11. The method of claim 1 wherein the user identifies the target pattern from previously captured data.

12. The method of claim 1 wherein the user identifies the target pattern from live data being captured by the sensors on the HWC.

13. The method of claim 1 wherein the sensor is a microphone that captures sound in the surrounding environment and the target pattern is a target sound.

14. The method of claim 13 wherein the target sound is a spoken word and the user identifies the target sound by speaking the word.

15. The method of claim 13 wherein the user identifies the target sound from a previously captured audio recording.

16. The method of claim 13 wherein the user identifies the target sound from a previously captured audio recording.

17. The method of claim 1 wherein the sensors includes a rangefinder or a camera capable of providing a depth and the target pattern includes a size of an object.